2023-12-07T00:00:41.300 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T00:00:41.300 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_vshankar@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi/7480365 -- /home/teuthworker/archive/vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi/7480365/orig.config.yaml 2023-12-07T00:00:41.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T00:00:41.460 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi/7480365 branch: wip-vshankar-testing-20231206.125818 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7480365' kernel: client: sha1: distro flavor: default kdb: true sha1: 9471594ae3a4c6992c4327df9a789df8f2b6aeae ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20231206.125818 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a2cd52c00149b5caff897ea7f79d0529b62620da ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2cd52c00149b5caff897ea7f79d0529b62620da kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231206.125818 sha1: a2cd52c00149b5caff897ea7f79d0529b62620da owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4099 sha1: a2cd52c00149b5caff897ea7f79d0529b62620da sleep_before_teardown: 0 subset: 359/1024 suite: fs suite_branch: wip-vshankar-testing-20231206.125818 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a2cd52c00149b5caff897ea7f79d0529b62620da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-06_15:12:46 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-07T00:00:41.460 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa; will attempt to use it 2023-12-07T00:00:41.461 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa/tasks 2023-12-07T00:00:41.462 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-07T00:00:41.463 INFO:teuthology.task.internal:Checking packages... 2023-12-07T00:00:41.488 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a2cd52c00149b5caff897ea7f79d0529b62620da' 2023-12-07T00:00:41.488 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T00:00:41.488 INFO:teuthology.packaging:ref: None 2023-12-07T00:00:41.488 INFO:teuthology.packaging:tag: None 2023-12-07T00:00:41.488 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231206.125818 2023-12-07T00:00:41.488 INFO:teuthology.packaging:sha1: a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-07T00:00:41.488 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20231206.125818 2023-12-07T00:00:41.627 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-46.ga2cd52c0 2023-12-07T00:00:41.628 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-07T00:00:41.677 INFO:teuthology.task.internal:no buildpackages task found 2023-12-07T00:00:41.677 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-07T00:00:41.686 INFO:teuthology.task.internal:Saving configuration 2023-12-07T00:00:41.706 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-07T00:00:41.716 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T00:00:41.742 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi/7480365', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 23:55:41.990077', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-07T00:00:41.767 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi/7480365', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 23:55:41.988238', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-07T00:00:41.767 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-07T00:00:41.786 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-07T00:00:41.786 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-07T00:00:41.786 INFO:teuthology.run_tasks:Running task console_log... 2023-12-07T00:00:41.866 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f00059c4a60>, signals=[15]) 2023-12-07T00:00:41.867 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-07T00:00:41.898 INFO:teuthology.task.internal:Opening connections... 2023-12-07T00:00:41.898 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:00:41.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T00:00:41.966 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T00:00:41.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T00:00:42.033 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-07T00:00:42.049 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-12-07T00:00:42.070 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-12-07T00:00:42.071 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-07T00:00:42.130 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T00:00:42.131 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:00:42.131 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-07T00:00:42.131 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-07T00:00:42.131 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-07T00:00:42.131 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-07T00:00:42.131 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-12-07T00:00:42.157 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-12-07T00:00:42.178 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-12-07T00:00:42.178 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-12-07T00:00:42.238 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.6 (Ootpa)" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.6" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:00:42.239 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-07T00:00:42.240 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-07T00:00:42.240 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-07T00:00:42.240 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-07T00:00:42.240 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-12-07T00:00:42.256 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-07T00:00:42.269 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-07T00:00:42.277 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-07T00:00:42.277 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2023-12-07T00:00:42.280 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2023-12-07T00:00:42.298 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-07T00:00:42.310 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-07T00:00:42.310 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2023-12-07T00:00:42.339 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2023-12-07T00:00:42.364 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-07T00:00:42.431 INFO:teuthology.run_tasks:Running task kernel... 2023-12-07T00:00:42.467 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'} 2023-12-07T00:00:42.467 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-12-07T00:00:42.467 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-12-07T00:00:42.468 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T00:00:42.468 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T00:00:42.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T00:00:42.487 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2023-12-07T00:00:42.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T00:00:42.488 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-12-07T00:00:42.547 INFO:teuthology.orchestra.run.smithi179.stdout:4.18.0-372.9.1.el8.x86_64 2023-12-07T00:00:42.547 INFO:teuthology.task.kernel:Running kernel on smithi179: 4.18.0-372.9.1.el8.x86_64 2023-12-07T00:00:42.548 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum install -y kernel 2023-12-07T00:00:42.550 INFO:teuthology.orchestra.run.smithi190.stdout:4.18.0-372.9.1.el8.x86_64 2023-12-07T00:00:42.550 INFO:teuthology.task.kernel:Running kernel on smithi190: 4.18.0-372.9.1.el8.x86_64 2023-12-07T00:00:42.550 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum install -y kernel 2023-12-07T00:00:43.700 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-12-07T00:00:43.700 INFO:teuthology.orchestra.run.smithi179.stdout:Unable to read consumer identity 2023-12-07T00:00:43.737 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-12-07T00:00:43.737 INFO:teuthology.orchestra.run.smithi190.stdout:Unable to read consumer identity 2023-12-07T00:00:45.198 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-12-07T00:00:45.267 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-12-07T00:00:45.890 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-12-07T00:00:46.343 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-12-07T00:00:49.465 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 394 kB/s | 24 kB 00:00 2023-12-07T00:00:49.818 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 433 kB/s | 24 kB 00:00 2023-12-07T00:00:50.176 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-07T00:00:50.223 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-07T00:00:50.224 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-12-07T00:00:50.224 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-07T00:00:50.346 DEBUG:teuthology.orchestra.run.smithi190:> echo no | sudo yum reinstall kernel || true 2023-12-07T00:00:50.553 INFO:teuthology.orchestra.run.smithi179.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-07T00:00:50.612 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-12-07T00:00:50.613 INFO:teuthology.orchestra.run.smithi179.stdout:Nothing to do. 2023-12-07T00:00:50.613 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-12-07T00:00:50.678 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-12-07T00:00:50.678 INFO:teuthology.orchestra.run.smithi190.stdout:Unable to read consumer identity 2023-12-07T00:00:50.745 DEBUG:teuthology.orchestra.run.smithi179:> echo no | sudo yum reinstall kernel || true 2023-12-07T00:00:50.938 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:01 ago on Thu 07 Dec 2023 12:00:49 AM UTC. 2023-12-07T00:00:50.979 INFO:teuthology.orchestra.run.smithi190.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-07T00:00:51.024 INFO:teuthology.orchestra.run.smithi190.stderr:Error: No packages marked for reinstall. 2023-12-07T00:00:51.070 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum reinstall -y kernel || true 2023-12-07T00:00:51.076 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-12-07T00:00:51.076 INFO:teuthology.orchestra.run.smithi179.stdout:Unable to read consumer identity 2023-12-07T00:00:51.336 INFO:teuthology.orchestra.run.smithi179.stdout:Last metadata expiration check: 0:00:02 ago on Thu 07 Dec 2023 12:00:49 AM UTC. 2023-12-07T00:00:51.378 INFO:teuthology.orchestra.run.smithi179.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-07T00:00:51.398 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-12-07T00:00:51.399 INFO:teuthology.orchestra.run.smithi190.stdout:Unable to read consumer identity 2023-12-07T00:00:51.405 INFO:teuthology.orchestra.run.smithi179.stderr:Error: No packages marked for reinstall. 2023-12-07T00:00:51.451 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum reinstall -y kernel || true 2023-12-07T00:00:51.655 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:02 ago on Thu 07 Dec 2023 12:00:49 AM UTC. 2023-12-07T00:00:51.695 INFO:teuthology.orchestra.run.smithi190.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-07T00:00:51.720 INFO:teuthology.orchestra.run.smithi190.stderr:Error: No packages marked for reinstall. 2023-12-07T00:00:51.767 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T00:00:51.782 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-12-07T00:00:51.783 INFO:teuthology.orchestra.run.smithi179.stdout:Unable to read consumer identity 2023-12-07T00:00:51.847 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-12-07T00:00:51.847 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-12-07T00:00:51.847 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-07T00:00:51.848 DEBUG:teuthology.parallel:result is None 2023-12-07T00:00:52.038 INFO:teuthology.orchestra.run.smithi179.stdout:Last metadata expiration check: 0:00:03 ago on Thu 07 Dec 2023 12:00:49 AM UTC. 2023-12-07T00:00:52.077 INFO:teuthology.orchestra.run.smithi179.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-07T00:00:52.103 INFO:teuthology.orchestra.run.smithi179.stderr:Error: No packages marked for reinstall. 2023-12-07T00:00:52.149 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q kernel | sort -rV | head -n 1 2023-12-07T00:00:52.229 INFO:teuthology.orchestra.run.smithi179.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-12-07T00:00:52.229 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-12-07T00:00:52.229 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-07T00:00:52.229 DEBUG:teuthology.parallel:result is None 2023-12-07T00:00:52.230 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-07T00:00:52.236 INFO:teuthology.task.internal:Creating test directory... 2023-12-07T00:00:52.236 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T00:00:52.238 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T00:00:52.256 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-07T00:00:52.263 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-07T00:00:52.271 INFO:teuthology.task.internal:Creating archive directory... 2023-12-07T00:00:52.271 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T00:00:52.294 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T00:00:52.321 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-07T00:00:52.336 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-07T00:00:52.336 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T00:00:52.358 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T00:00:52.401 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T00:00:52.417 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T00:00:52.420 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T00:00:52.431 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T00:00:52.433 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-07T00:00:52.490 INFO:teuthology.task.internal:Configuring sudo... 2023-12-07T00:00:52.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T00:00:52.493 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T00:00:52.521 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-07T00:00:52.538 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-07T00:00:52.538 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T00:00:52.559 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T00:00:52.576 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T00:00:52.656 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T00:00:52.707 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T00:00:52.791 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T00:00:52.831 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:00:52.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T00:00:52.898 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T00:00:52.942 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T00:00:52.994 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T00:00:53.077 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T00:00:53.119 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:00:53.119 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T00:00:53.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2023-12-07T00:00:53.190 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2023-12-07T00:00:53.271 INFO:teuthology.orchestra.run.smithi179.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T00:00:53.290 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-07T00:00:53.700 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-07T00:00:53.714 INFO:teuthology.task.internal:Starting timer... 2023-12-07T00:00:53.714 INFO:teuthology.run_tasks:Running task pcp... 2023-12-07T00:00:53.741 INFO:teuthology.run_tasks:Running task selinux... 2023-12-07T00:00:53.752 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-07T00:00:53.752 DEBUG:teuthology.orchestra.run.smithi179:> sudo service auditd rotate 2023-12-07T00:00:53.818 INFO:teuthology.orchestra.run.smithi179.stdout:Rotating logs: 2023-12-07T00:00:53.820 DEBUG:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2023-12-07T00:00:53.887 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: 2023-12-07T00:00:53.889 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-07T00:00:53.889 DEBUG:teuthology.orchestra.run.smithi179:> /usr/sbin/getenforce 2023-12-07T00:00:53.916 INFO:teuthology.orchestra.run.smithi179.stdout:Permissive 2023-12-07T00:00:53.917 DEBUG:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2023-12-07T00:00:53.942 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2023-12-07T00:00:53.942 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi179.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': 'permissive'} 2023-12-07T00:00:53.942 DEBUG:teuthology.orchestra.run.smithi179:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T00:00:53.983 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T00:00:53.983 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-07T00:00:54.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T00:00:54.010 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-07T00:00:54.010 DEBUG:teuthology.orchestra.run.smithi179:> sudo /usr/sbin/setenforce permissive 2023-12-07T00:00:54.074 DEBUG:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2023-12-07T00:00:54.132 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-07T00:00:54.148 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-07T00:00:54.148 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-07T00:00:54.166 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-07T00:00:54.168 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi179.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-07T00:10:52.430 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi179.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2023-12-07T00:10:52.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-12-07T00:10:52.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T00:10:52.501 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-12-07T00:10:52.571 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-12-07T00:10:52.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-07T00:10:52.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T00:10:52.642 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-12-07T00:10:52.713 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-12-07T00:10:52.713 INFO:teuthology.run_tasks:Running task clock... 2023-12-07T00:10:52.724 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-07T00:10:52.724 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T00:10:52.725 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T00:10:52.727 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T00:10:52.727 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T00:10:52.758 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-07T00:10:52.772 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-07T00:10:52.786 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-07T00:10:52.801 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-07T00:10:52.836 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: ntpd: command not found 2023-12-07T00:10:52.848 INFO:teuthology.orchestra.run.smithi179.stdout:506 Cannot talk to daemon 2023-12-07T00:10:52.863 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-07T00:10:52.875 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2023-12-07T00:10:52.877 INFO:teuthology.orchestra.run.smithi179.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-07T00:10:52.887 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2023-12-07T00:10:52.901 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-07T00:10:52.915 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-07T00:10:52.945 INFO:teuthology.orchestra.run.smithi179.stderr:bash: ntpq: command not found 2023-12-07T00:10:52.950 INFO:teuthology.orchestra.run.smithi179.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T00:10:52.950 INFO:teuthology.orchestra.run.smithi179.stdout:=============================================================================== 2023-12-07T00:10:52.950 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T00:10:52.950 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T00:10:52.950 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T00:10:52.950 INFO:teuthology.orchestra.run.smithi179.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T00:10:52.987 INFO:teuthology.orchestra.run.smithi190.stderr:bash: ntpq: command not found 2023-12-07T00:10:52.991 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-07T00:10:52.991 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2023-12-07T00:10:52.991 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T00:10:52.991 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T00:10:52.991 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T00:10:52.991 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-07T00:10:52.992 INFO:teuthology.run_tasks:Running task install... 2023-12-07T00:10:53.001 DEBUG:teuthology.task.install:project ceph 2023-12-07T00:10:53.001 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}} 2023-12-07T00:10:53.001 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'} 2023-12-07T00:10:53.002 INFO:teuthology.task.install:Using flavor: default 2023-12-07T00:10:53.007 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-07T00:10:53.007 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-07T00:10:53.008 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'tag': None, 'wait_for_package': False} 2023-12-07T00:10:53.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-07T00:10:53.010 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'tag': None, 'wait_for_package': False} 2023-12-07T00:10:53.010 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-07T00:10:53.157 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/8/flavors/default/ 2023-12-07T00:10:53.158 INFO:teuthology.task.install.rpm:Package version is 19.0.0-46.ga2cd52c0 2023-12-07T00:10:53.293 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/8/flavors/default/ 2023-12-07T00:10:53.293 INFO:teuthology.task.install.rpm:Package version is 19.0.0-46.ga2cd52c0 2023-12-07T00:10:53.322 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-07T00:10:53.323 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:10:53.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-07T00:10:53.351 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-07T00:10:53.351 DEBUG:teuthology.orchestra.run.smithi179:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2cd52c00149b5caff897ea7f79d0529b62620da/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-07T00:10:53.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-07T00:10:53.496 DEBUG:teuthology.orchestra.run.smithi179:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-07T00:10:53.556 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231206.125818/a2cd52c00149b5caff897ea7f79d0529b62620da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-07T00:10:53.557 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:10:53.557 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-07T00:10:53.563 INFO:teuthology.orchestra.run.smithi179.stdout:check_obsoletes = 1 2023-12-07T00:10:53.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum clean all 2023-12-07T00:10:53.589 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-07T00:10:53.589 DEBUG:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2cd52c00149b5caff897ea7f79d0529b62620da/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-07T00:10:53.659 DEBUG:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-07T00:10:53.740 DEBUG:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-07T00:10:53.807 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2023-12-07T00:10:53.809 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum clean all 2023-12-07T00:10:53.936 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-12-07T00:10:54.180 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-12-07T00:10:54.297 INFO:teuthology.orchestra.run.smithi179.stdout:44 files removed 2023-12-07T00:10:54.345 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-07T00:10:54.572 INFO:teuthology.orchestra.run.smithi190.stdout:44 files removed 2023-12-07T00:10:54.619 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-07T00:10:54.675 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-12-07T00:10:54.949 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-12-07T00:10:55.897 INFO:teuthology.orchestra.run.smithi179.stdout:ceph packages for x86_64 108 kB/s | 81 kB 00:00 2023-12-07T00:10:56.072 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 125 kB/s | 81 kB 00:00 2023-12-07T00:10:56.515 INFO:teuthology.orchestra.run.smithi179.stdout:ceph noarch packages 16 kB/s | 9.5 kB 00:00 2023-12-07T00:10:56.756 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 15 kB/s | 9.5 kB 00:00 2023-12-07T00:10:57.157 INFO:teuthology.orchestra.run.smithi179.stdout:ceph source packages 2.4 kB/s | 1.5 kB 00:00 2023-12-07T00:10:57.441 INFO:teuthology.orchestra.run.smithi179.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-12-07T00:10:57.515 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-12-07T00:10:57.724 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-12-07T00:10:59.335 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-12-07T00:11:02.858 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 407 kB/s | 24 kB 00:00 2023-12-07T00:11:03.776 INFO:teuthology.orchestra.run.smithi190.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-12-07T00:11:04.494 INFO:teuthology.orchestra.run.smithi179.stdout:Extra Packages for Enterprise Linux 2.3 MB/s | 16 MB 00:07 2023-12-07T00:11:08.108 INFO:teuthology.orchestra.run.smithi179.stdout:lab-extras 581 kB/s | 24 kB 00:00 2023-12-07T00:11:09.019 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-12-07T00:11:11.870 INFO:teuthology.orchestra.run.smithi190.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-12-07T00:11:17.001 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-12-07T00:11:22.850 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-07T00:11:22.851 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-07T00:11:22.865 INFO:teuthology.orchestra.run.smithi190.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-07T00:11:22.866 INFO:teuthology.orchestra.run.smithi190.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-07T00:11:22.867 INFO:teuthology.orchestra.run.smithi190.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-07T00:11:22.868 INFO:teuthology.orchestra.run.smithi190.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-07T00:11:22.870 INFO:teuthology.orchestra.run.smithi190.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-07T00:11:22.873 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-07T00:11:22.875 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-07T00:11:23.008 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout:=========================================================================================================================== 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout:=========================================================================================================================== 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 6.4 k 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 5.4 M 2023-12-07T00:11:23.021 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 919 k 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 171 k 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 1.6 M 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 133 k 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 1.8 M 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 7.4 M 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 50 k 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 14 M 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 49 M 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 262 k 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 415 k 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 262 k 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 18 k 2023-12-07T00:11:23.022 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 31 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 838 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 139 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 197 k 2023-12-07T00:11:23.023 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 371 k 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 364 k 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 107 k 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 94 k 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 3.6 M 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 180 k 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 3.8 M 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 3.7 M 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-12-07T00:11:23.024 INFO:teuthology.orchestra.run.smithi190.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 23 M 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 28 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 2.3 M 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 243 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 4.6 M 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 18 M 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 15 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 24 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-07T00:11:23.025 INFO:teuthology.orchestra.run.smithi190.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 183 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 517 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 6.9 M 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-07T00:11:23.026 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-07T00:11:23.027 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 45 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 128 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-07T00:11:23.028 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-07T00:11:23.029 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-07T00:11:23.030 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout:Enabling module streams: 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql 10 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout:=========================================================================================================================== 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout:Install 128 Packages 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 3 Packages 2023-12-07T00:11:23.031 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:11:23.032 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 209 M 2023-12-07T00:11:23.032 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-12-07T00:11:23.219 INFO:teuthology.orchestra.run.smithi190.stdout:(1/131): ceph-19.0.0-46.ga2cd52c0.el8.x86_64.rp 53 kB/s | 6.4 kB 00:00 2023-12-07T00:11:23.419 INFO:teuthology.orchestra.run.smithi190.stdout:(2/131): ceph-fuse-19.0.0-46.ga2cd52c0.el8.x86_ 4.5 MB/s | 919 kB 00:00 2023-12-07T00:11:23.461 INFO:teuthology.orchestra.run.smithi190.stdout:(3/131): ceph-immutable-object-cache-19.0.0-46. 4.0 MB/s | 171 kB 00:00 2023-12-07T00:11:23.753 INFO:teuthology.orchestra.run.smithi190.stdout:(4/131): ceph-mds-19.0.0-46.ga2cd52c0.el8.x86_6 7.9 MB/s | 2.3 MB 00:00 2023-12-07T00:11:23.945 INFO:teuthology.orchestra.run.smithi190.stdout:(5/131): ceph-mgr-19.0.0-46.ga2cd52c0.el8.x86_6 8.5 MB/s | 1.6 MB 00:00 2023-12-07T00:11:24.070 INFO:teuthology.orchestra.run.smithi190.stdout:(6/131): ceph-base-19.0.0-46.ga2cd52c0.el8.x86_ 5.5 MB/s | 5.4 MB 00:00 2023-12-07T00:11:24.412 INFO:teuthology.orchestra.run.smithi190.stdout:(7/131): ceph-mon-19.0.0-46.ga2cd52c0.el8.x86_6 10 MB/s | 4.6 MB 00:00 2023-12-07T00:11:25.704 INFO:teuthology.orchestra.run.smithi190.stdout:(8/131): ceph-common-19.0.0-46.ga2cd52c0.el8.x8 8.6 MB/s | 23 MB 00:02 2023-12-07T00:11:25.788 INFO:teuthology.orchestra.run.smithi190.stdout:(9/131): ceph-selinux-19.0.0-46.ga2cd52c0.el8.x 292 kB/s | 24 kB 00:00 2023-12-07T00:11:26.055 INFO:teuthology.orchestra.run.smithi190.stdout:(10/131): ceph-radosgw-19.0.0-46.ga2cd52c0.el8. 8.4 MB/s | 14 MB 00:01 2023-12-07T00:11:26.138 INFO:teuthology.orchestra.run.smithi190.stdout:(11/131): cephfs-mirror-19.0.0-46.ga2cd52c0.el8 3.1 MB/s | 262 kB 00:00 2023-12-07T00:11:26.197 INFO:teuthology.orchestra.run.smithi190.stdout:(12/131): libcephfs-devel-19.0.0-46.ga2cd52c0.e 532 kB/s | 31 kB 00:00 2023-12-07T00:11:26.347 INFO:teuthology.orchestra.run.smithi190.stdout:(13/131): libcephfs2-19.0.0-46.ga2cd52c0.el8.x8 5.5 MB/s | 838 kB 00:00 2023-12-07T00:11:26.414 INFO:teuthology.orchestra.run.smithi190.stdout:(14/131): libcephsqlite-19.0.0-46.ga2cd52c0.el8 2.7 MB/s | 183 kB 00:00 2023-12-07T00:11:26.473 INFO:teuthology.orchestra.run.smithi190.stdout:(15/131): librados-devel-19.0.0-46.ga2cd52c0.el 2.3 MB/s | 139 kB 00:00 2023-12-07T00:11:26.656 INFO:teuthology.orchestra.run.smithi190.stdout:(16/131): ceph-osd-19.0.0-46.ga2cd52c0.el8.x86_ 7.0 MB/s | 18 MB 00:02 2023-12-07T00:11:26.698 INFO:teuthology.orchestra.run.smithi190.stdout:(17/131): libradosstriper1-19.0.0-46.ga2cd52c0. 2.2 MB/s | 517 kB 00:00 2023-12-07T00:11:26.749 INFO:teuthology.orchestra.run.smithi190.stdout:(18/131): python3-ceph-argparse-19.0.0-46.ga2cd 892 kB/s | 45 kB 00:00 2023-12-07T00:11:26.815 INFO:teuthology.orchestra.run.smithi190.stdout:(19/131): python3-ceph-common-19.0.0-46.ga2cd52 1.9 MB/s | 128 kB 00:00 2023-12-07T00:11:26.882 INFO:teuthology.orchestra.run.smithi190.stdout:(20/131): python3-cephfs-19.0.0-46.ga2cd52c0.el 2.9 MB/s | 197 kB 00:00 2023-12-07T00:11:26.958 INFO:teuthology.orchestra.run.smithi190.stdout:(21/131): python3-rados-19.0.0-46.ga2cd52c0.el8 4.8 MB/s | 371 kB 00:00 2023-12-07T00:11:27.025 INFO:teuthology.orchestra.run.smithi190.stdout:(22/131): python3-rbd-19.0.0-46.ga2cd52c0.el8.x 5.3 MB/s | 364 kB 00:00 2023-12-07T00:11:27.083 INFO:teuthology.orchestra.run.smithi190.stdout:(23/131): python3-rgw-19.0.0-46.ga2cd52c0.el8.x 1.8 MB/s | 107 kB 00:00 2023-12-07T00:11:27.133 INFO:teuthology.orchestra.run.smithi190.stdout:(24/131): rbd-fuse-19.0.0-46.ga2cd52c0.el8.x86_ 1.8 MB/s | 94 kB 00:00 2023-12-07T00:11:27.617 INFO:teuthology.orchestra.run.smithi190.stdout:(25/131): rbd-mirror-19.0.0-46.ga2cd52c0.el8.x8 7.4 MB/s | 3.6 MB 00:00 2023-12-07T00:11:27.693 INFO:teuthology.orchestra.run.smithi190.stdout:(26/131): librgw2-19.0.0-46.ga2cd52c0.el8.x86_6 6.7 MB/s | 6.9 MB 00:01 2023-12-07T00:11:27.718 INFO:teuthology.orchestra.run.smithi190.stdout:(27/131): rbd-nbd-19.0.0-46.ga2cd52c0.el8.x86_6 1.8 MB/s | 180 kB 00:00 2023-12-07T00:11:27.768 INFO:teuthology.orchestra.run.smithi190.stdout:(28/131): ceph-mgr-cephadm-19.0.0-46.ga2cd52c0. 2.6 MB/s | 133 kB 00:00 2023-12-07T00:11:27.793 INFO:teuthology.orchestra.run.smithi190.stdout:(29/131): ceph-grafana-dashboards-19.0.0-46.ga2 278 kB/s | 28 kB 00:00 2023-12-07T00:11:28.035 INFO:teuthology.orchestra.run.smithi190.stdout:(30/131): ceph-mgr-dashboard-19.0.0-46.ga2cd52c 6.6 MB/s | 1.8 MB 00:00 2023-12-07T00:11:28.110 INFO:teuthology.orchestra.run.smithi190.stdout:(31/131): ceph-mgr-modules-core-19.0.0-46.ga2cd 3.2 MB/s | 243 kB 00:00 2023-12-07T00:11:28.161 INFO:teuthology.orchestra.run.smithi190.stdout:(32/131): ceph-mgr-rook-19.0.0-46.ga2cd52c0.el8 1.0 MB/s | 50 kB 00:00 2023-12-07T00:11:28.219 INFO:teuthology.orchestra.run.smithi179.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-07T00:11:28.219 INFO:teuthology.orchestra.run.smithi190.stdout:(33/131): ceph-prometheus-alerts-19.0.0-46.ga2c 257 kB/s | 15 kB 00:00 2023-12-07T00:11:28.220 INFO:teuthology.orchestra.run.smithi179.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-07T00:11:28.235 INFO:teuthology.orchestra.run.smithi179.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-07T00:11:28.236 INFO:teuthology.orchestra.run.smithi179.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-07T00:11:28.237 INFO:teuthology.orchestra.run.smithi179.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-07T00:11:28.238 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-07T00:11:28.240 INFO:teuthology.orchestra.run.smithi179.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-07T00:11:28.245 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-07T00:11:28.245 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-07T00:11:28.286 INFO:teuthology.orchestra.run.smithi190.stdout:(34/131): ceph-volume-19.0.0-46.ga2cd52c0.el8.n 3.8 MB/s | 262 kB 00:00 2023-12-07T00:11:28.370 INFO:teuthology.orchestra.run.smithi190.stdout:(35/131): cephadm-19.0.0-46.ga2cd52c0.el8.noarc 4.9 MB/s | 415 kB 00:00 2023-12-07T00:11:28.381 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-12-07T00:11:28.393 INFO:teuthology.orchestra.run.smithi179.stdout:=========================================================================================================================== 2023-12-07T00:11:28.393 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2023-12-07T00:11:28.393 INFO:teuthology.orchestra.run.smithi179.stdout:=========================================================================================================================== 2023-12-07T00:11:28.393 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2023-12-07T00:11:28.393 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-12-07T00:11:28.393 INFO:teuthology.orchestra.run.smithi179.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-07T00:11:28.393 INFO:teuthology.orchestra.run.smithi179.stdout: ceph x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 6.4 k 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 5.4 M 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 919 k 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 171 k 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 1.6 M 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 133 k 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 1.8 M 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 7.4 M 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 50 k 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 14 M 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 49 M 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 262 k 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 415 k 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 262 k 2023-12-07T00:11:28.394 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 18 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 31 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 838 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 139 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 197 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 371 k 2023-12-07T00:11:28.395 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 364 k 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 107 k 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 94 k 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 3.6 M 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 180 k 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: librados2 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 3.8 M 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 3.7 M 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 23 M 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 28 k 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 2.3 M 2023-12-07T00:11:28.396 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 243 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 4.6 M 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 18 M 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts noarch 2:19.0.0-46.ga2cd52c0.el8 ceph-noarch 15 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 24 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 183 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-12-07T00:11:28.397 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 517 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2 x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 6.9 M 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-07T00:11:28.398 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 45 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common x86_64 2:19.0.0-46.ga2cd52c0.el8 ceph 128 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-07T00:11:28.399 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-07T00:11:28.400 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-07T00:11:28.401 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout:Enabling module streams: 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql 10 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:11:28.402 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2023-12-07T00:11:28.403 INFO:teuthology.orchestra.run.smithi179.stdout:=========================================================================================================================== 2023-12-07T00:11:28.403 INFO:teuthology.orchestra.run.smithi179.stdout:Install 128 Packages 2023-12-07T00:11:28.403 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 3 Packages 2023-12-07T00:11:28.403 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:11:28.403 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 209 M 2023-12-07T00:11:28.403 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2023-12-07T00:11:28.428 INFO:teuthology.orchestra.run.smithi190.stdout:(36/131): cephfs-top-19.0.0-46.ga2cd52c0.el8.no 310 kB/s | 18 kB 00:00 2023-12-07T00:11:28.662 INFO:teuthology.orchestra.run.smithi190.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-12-07T00:11:28.721 INFO:teuthology.orchestra.run.smithi190.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-12-07T00:11:28.805 INFO:teuthology.orchestra.run.smithi179.stdout:(1/131): ceph-19.0.0-46.ga2cd52c0.el8.x86_64.rp 26 kB/s | 6.4 kB 00:00 2023-12-07T00:11:28.805 INFO:teuthology.orchestra.run.smithi190.stdout:(39/131): ceph-mgr-diskprediction-local-19.0.0- 7.3 MB/s | 7.4 MB 00:01 2023-12-07T00:11:28.847 INFO:teuthology.orchestra.run.smithi190.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 600 kB/s | 75 kB 00:00 2023-12-07T00:11:28.905 INFO:teuthology.orchestra.run.smithi190.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 747 kB/s | 44 kB 00:00 2023-12-07T00:11:29.272 INFO:teuthology.orchestra.run.smithi179.stdout:(2/131): ceph-fuse-19.0.0-46.ga2cd52c0.el8.x86_ 1.9 MB/s | 919 kB 00:00 2023-12-07T00:11:29.339 INFO:teuthology.orchestra.run.smithi190.stdout:(42/131): ceph-test-19.0.0-46.ga2cd52c0.el8.x86 14 MB/s | 49 MB 00:03 2023-12-07T00:11:29.364 INFO:teuthology.orchestra.run.smithi190.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 404 kB/s | 185 kB 00:00 2023-12-07T00:11:29.372 INFO:teuthology.orchestra.run.smithi179.stdout:(3/131): ceph-immutable-object-cache-19.0.0-46. 1.7 MB/s | 171 kB 00:00 2023-12-07T00:11:29.423 INFO:teuthology.orchestra.run.smithi190.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 279 kB/s | 16 kB 00:00 2023-12-07T00:11:29.465 INFO:teuthology.orchestra.run.smithi190.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2023-12-07T00:11:29.490 INFO:teuthology.orchestra.run.smithi190.stdout:(46/131): python3-asyncssh-2.7.0-2.el8.noarch.r 695 kB/s | 476 kB 00:00 2023-12-07T00:11:29.506 INFO:teuthology.orchestra.run.smithi179.stdout:(4/131): ceph-base-19.0.0-46.ga2cd52c0.el8.x86_ 5.7 MB/s | 5.4 MB 00:00 2023-12-07T00:11:29.515 INFO:teuthology.orchestra.run.smithi190.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2023-12-07T00:11:29.566 INFO:teuthology.orchestra.run.smithi190.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 223 kB/s | 11 kB 00:00 2023-12-07T00:11:29.624 INFO:teuthology.orchestra.run.smithi190.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 607 kB/s | 81 kB 00:00 2023-12-07T00:11:29.647 INFO:teuthology.orchestra.run.smithi179.stdout:(5/131): ceph-mgr-19.0.0-46.ga2cd52c0.el8.x86_6 11 MB/s | 1.6 MB 00:00 2023-12-07T00:11:29.649 INFO:teuthology.orchestra.run.smithi190.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2023-12-07T00:11:29.683 INFO:teuthology.orchestra.run.smithi190.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.7 MB/s | 384 kB 00:00 2023-12-07T00:11:29.700 INFO:teuthology.orchestra.run.smithi190.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 972 kB/s | 49 kB 00:00 2023-12-07T00:11:29.750 INFO:teuthology.orchestra.run.smithi190.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 880 kB/s | 59 kB 00:00 2023-12-07T00:11:29.776 INFO:teuthology.orchestra.run.smithi190.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 802 kB/s | 60 kB 00:00 2023-12-07T00:11:29.826 INFO:teuthology.orchestra.run.smithi190.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2023-12-07T00:11:29.868 INFO:teuthology.orchestra.run.smithi190.stdout:(56/131): python3-kubernetes-11.0.0-6.el8.noarc 4.8 MB/s | 1.2 MB 00:00 2023-12-07T00:11:29.885 INFO:teuthology.orchestra.run.smithi190.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 573 kB/s | 34 kB 00:00 2023-12-07T00:11:29.910 INFO:teuthology.orchestra.run.smithi190.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-12-07T00:11:29.935 INFO:teuthology.orchestra.run.smithi190.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-12-07T00:11:29.961 INFO:teuthology.orchestra.run.smithi190.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 851 kB/s | 64 kB 00:00 2023-12-07T00:11:29.978 INFO:teuthology.orchestra.run.smithi190.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 279 kB/s | 19 kB 00:00 2023-12-07T00:11:29.990 INFO:teuthology.orchestra.run.smithi179.stdout:(6/131): ceph-mon-19.0.0-46.ga2cd52c0.el8.x86_6 14 MB/s | 4.6 MB 00:00 2023-12-07T00:11:29.994 INFO:teuthology.orchestra.run.smithi190.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2023-12-07T00:11:30.011 INFO:teuthology.orchestra.run.smithi190.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-12-07T00:11:30.031 INFO:teuthology.orchestra.run.smithi179.stdout:(7/131): ceph-mds-19.0.0-46.ga2cd52c0.el8.x86_6 3.5 MB/s | 2.3 MB 00:00 2023-12-07T00:11:30.036 INFO:teuthology.orchestra.run.smithi190.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 468 kB/s | 27 kB 00:00 2023-12-07T00:11:30.062 INFO:teuthology.orchestra.run.smithi190.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-12-07T00:11:30.088 INFO:teuthology.orchestra.run.smithi190.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2023-12-07T00:11:30.113 INFO:teuthology.orchestra.run.smithi190.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 808 kB/s | 61 kB 00:00 2023-12-07T00:11:30.138 INFO:teuthology.orchestra.run.smithi190.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-12-07T00:11:30.163 INFO:teuthology.orchestra.run.smithi190.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-12-07T00:11:30.188 INFO:teuthology.orchestra.run.smithi190.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-12-07T00:11:30.239 INFO:teuthology.orchestra.run.smithi190.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 623 kB/s | 47 kB 00:00 2023-12-07T00:11:30.256 INFO:teuthology.orchestra.run.smithi190.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.2 MB/s | 200 kB 00:00 2023-12-07T00:11:30.281 INFO:teuthology.orchestra.run.smithi190.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-12-07T00:11:30.323 INFO:teuthology.orchestra.run.smithi190.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-12-07T00:11:30.380 INFO:teuthology.orchestra.run.smithi190.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 489 kB/s | 48 kB 00:00 2023-12-07T00:11:30.398 INFO:teuthology.orchestra.run.smithi190.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-12-07T00:11:30.424 INFO:teuthology.orchestra.run.smithi190.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 978 kB/s | 43 kB 00:00 2023-12-07T00:11:30.449 INFO:teuthology.orchestra.run.smithi190.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-12-07T00:11:30.474 INFO:teuthology.orchestra.run.smithi190.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-12-07T00:11:30.516 INFO:teuthology.orchestra.run.smithi190.stdout:(80/131): thrift-0.13.0-2.el8.x86_64.rpm 4.3 MB/s | 1.7 MB 00:00 2023-12-07T00:11:30.542 INFO:teuthology.orchestra.run.smithi190.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 279 kB/s | 19 kB 00:00 2023-12-07T00:11:30.583 INFO:teuthology.orchestra.run.smithi190.stdout:(82/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.1 MB/s | 560 kB 00:00 2023-12-07T00:11:30.609 INFO:teuthology.orchestra.run.smithi190.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-12-07T00:11:30.634 INFO:teuthology.orchestra.run.smithi190.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 356 kB/s | 18 kB 00:00 2023-12-07T00:11:30.668 INFO:teuthology.orchestra.run.smithi190.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.5 MB/s | 559 kB 00:00 2023-12-07T00:11:30.701 INFO:teuthology.orchestra.run.smithi190.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-12-07T00:11:30.726 INFO:teuthology.orchestra.run.smithi190.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-12-07T00:11:30.752 INFO:teuthology.orchestra.run.smithi190.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-12-07T00:11:30.768 INFO:teuthology.orchestra.run.smithi190.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-12-07T00:11:30.794 INFO:teuthology.orchestra.run.smithi190.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-12-07T00:11:30.819 INFO:teuthology.orchestra.run.smithi190.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-12-07T00:11:30.844 INFO:teuthology.orchestra.run.smithi190.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-12-07T00:11:30.870 INFO:teuthology.orchestra.run.smithi190.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 767 kB/s | 39 kB 00:00 2023-12-07T00:11:30.903 INFO:teuthology.orchestra.run.smithi190.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-12-07T00:11:30.937 INFO:teuthology.orchestra.run.smithi190.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-12-07T00:11:30.962 INFO:teuthology.orchestra.run.smithi190.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.3 MB/s | 138 kB 00:00 2023-12-07T00:11:31.021 INFO:teuthology.orchestra.run.smithi190.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.6 MB/s | 2.3 MB 00:00 2023-12-07T00:11:31.046 INFO:teuthology.orchestra.run.smithi190.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-12-07T00:11:31.063 INFO:teuthology.orchestra.run.smithi190.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-12-07T00:11:31.089 INFO:teuthology.orchestra.run.smithi190.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-12-07T00:11:31.147 INFO:teuthology.orchestra.run.smithi190.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 3.8 MB/s | 323 kB 00:00 2023-12-07T00:11:31.164 INFO:teuthology.orchestra.run.smithi190.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 517 kB/s | 39 kB 00:00 2023-12-07T00:11:31.206 INFO:teuthology.orchestra.run.smithi190.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-12-07T00:11:31.240 INFO:teuthology.orchestra.run.smithi190.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-12-07T00:11:31.248 INFO:teuthology.orchestra.run.smithi179.stdout:(8/131): ceph-osd-19.0.0-46.ga2cd52c0.el8.x86_6 14 MB/s | 18 MB 00:01 2023-12-07T00:11:31.265 INFO:teuthology.orchestra.run.smithi190.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-12-07T00:11:31.290 INFO:teuthology.orchestra.run.smithi190.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-07T00:11:31.298 INFO:teuthology.orchestra.run.smithi179.stdout:(9/131): ceph-selinux-19.0.0-46.ga2cd52c0.el8.x 487 kB/s | 24 kB 00:00 2023-12-07T00:11:31.332 INFO:teuthology.orchestra.run.smithi190.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-12-07T00:11:31.374 INFO:teuthology.orchestra.run.smithi190.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 637 kB/s | 27 kB 00:00 2023-12-07T00:11:31.426 INFO:teuthology.orchestra.run.smithi190.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-12-07T00:11:31.466 INFO:teuthology.orchestra.run.smithi190.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-12-07T00:11:31.541 INFO:teuthology.orchestra.run.smithi190.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2023-12-07T00:11:31.592 INFO:teuthology.orchestra.run.smithi190.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-12-07T00:11:31.634 INFO:teuthology.orchestra.run.smithi190.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-12-07T00:11:31.700 INFO:teuthology.orchestra.run.smithi190.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2023-12-07T00:11:31.726 INFO:teuthology.orchestra.run.smithi190.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-12-07T00:11:31.751 INFO:teuthology.orchestra.run.smithi190.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-12-07T00:11:31.776 INFO:teuthology.orchestra.run.smithi190.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-12-07T00:11:31.801 INFO:teuthology.orchestra.run.smithi190.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-12-07T00:11:31.835 INFO:teuthology.orchestra.run.smithi190.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-12-07T00:11:31.994 INFO:teuthology.orchestra.run.smithi190.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-12-07T00:11:32.019 INFO:teuthology.orchestra.run.smithi190.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-12-07T00:11:32.052 INFO:teuthology.orchestra.run.smithi190.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 5.9 MB/s | 202 kB 00:00 2023-12-07T00:11:32.103 INFO:teuthology.orchestra.run.smithi190.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-12-07T00:11:32.187 INFO:teuthology.orchestra.run.smithi190.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 13 MB/s | 4.9 MB 00:00 2023-12-07T00:11:32.253 INFO:teuthology.orchestra.run.smithi190.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-12-07T00:11:32.304 INFO:teuthology.orchestra.run.smithi190.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-12-07T00:11:32.362 INFO:teuthology.orchestra.run.smithi190.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-12-07T00:11:32.446 INFO:teuthology.orchestra.run.smithi190.stdout:(128/131): postgresql-server-10.21-2.module+el8 15 MB/s | 5.1 MB 00:00 2023-12-07T00:11:32.457 INFO:teuthology.orchestra.run.smithi179.stdout:(10/131): ceph-common-19.0.0-46.ga2cd52c0.el8.x 5.8 MB/s | 23 MB 00:03 2023-12-07T00:11:32.496 INFO:teuthology.orchestra.run.smithi190.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-12-07T00:11:32.549 INFO:teuthology.orchestra.run.smithi179.stdout:(11/131): cephfs-mirror-19.0.0-46.ga2cd52c0.el8 2.8 MB/s | 262 kB 00:00 2023-12-07T00:11:32.641 INFO:teuthology.orchestra.run.smithi179.stdout:(12/131): libcephfs-devel-19.0.0-46.ga2cd52c0.e 338 kB/s | 31 kB 00:00 2023-12-07T00:11:32.800 INFO:teuthology.orchestra.run.smithi179.stdout:(13/131): ceph-radosgw-19.0.0-46.ga2cd52c0.el8. 5.0 MB/s | 14 MB 00:02 2023-12-07T00:11:32.967 INFO:teuthology.orchestra.run.smithi179.stdout:(14/131): libcephfs2-19.0.0-46.ga2cd52c0.el8.x8 2.5 MB/s | 838 kB 00:00 2023-12-07T00:11:33.068 INFO:teuthology.orchestra.run.smithi179.stdout:(15/131): librados-devel-19.0.0-46.ga2cd52c0.el 1.4 MB/s | 139 kB 00:00 2023-12-07T00:11:33.096 INFO:teuthology.orchestra.run.smithi190.stdout:(130/131): librados2-19.0.0-46.ga2cd52c0.el8.x8 4.8 MB/s | 3.8 MB 00:00 2023-12-07T00:11:33.168 INFO:teuthology.orchestra.run.smithi179.stdout:(16/131): libradosstriper1-19.0.0-46.ga2cd52c0. 5.1 MB/s | 517 kB 00:00 2023-12-07T00:11:33.422 INFO:teuthology.orchestra.run.smithi190.stdout:(131/131): librbd1-19.0.0-46.ga2cd52c0.el8.x86_ 3.5 MB/s | 3.7 MB 00:01 2023-12-07T00:11:33.424 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-12-07T00:11:33.425 INFO:teuthology.orchestra.run.smithi190.stdout:Total 20 MB/s | 209 MB 00:10 2023-12-07T00:11:33.584 INFO:teuthology.orchestra.run.smithi179.stdout:(17/131): libcephsqlite-19.0.0-46.ga2cd52c0.el8 233 kB/s | 183 kB 00:00 2023-12-07T00:11:33.768 INFO:teuthology.orchestra.run.smithi179.stdout:(18/131): python3-ceph-argparse-19.0.0-46.ga2cd 244 kB/s | 45 kB 00:00 2023-12-07T00:11:34.010 INFO:teuthology.orchestra.run.smithi179.stdout:(19/131): python3-ceph-common-19.0.0-46.ga2cd52 532 kB/s | 128 kB 00:00 2023-12-07T00:11:34.110 INFO:teuthology.orchestra.run.smithi179.stdout:(20/131): librgw2-19.0.0-46.ga2cd52c0.el8.x86_6 7.3 MB/s | 6.9 MB 00:00 2023-12-07T00:11:34.277 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-12-07T00:11:34.396 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-12-07T00:11:34.396 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-12-07T00:11:34.678 INFO:teuthology.orchestra.run.smithi179.stdout:(21/131): ceph-test-19.0.0-46.ga2cd52c0.el8.x86 15 MB/s | 49 MB 00:03 2023-12-07T00:11:34.694 INFO:teuthology.orchestra.run.smithi179.stdout:(22/131): python3-cephfs-19.0.0-46.ga2cd52c0.el 287 kB/s | 197 kB 00:00 2023-12-07T00:11:34.720 INFO:teuthology.orchestra.run.smithi179.stdout:(23/131): python3-rados-19.0.0-46.ga2cd52c0.el8 610 kB/s | 371 kB 00:00 2023-12-07T00:11:34.745 INFO:teuthology.orchestra.run.smithi179.stdout:(24/131): python3-rbd-19.0.0-46.ga2cd52c0.el8.x 5.3 MB/s | 364 kB 00:00 2023-12-07T00:11:34.773 INFO:teuthology.orchestra.run.smithi179.stdout:(25/131): rbd-fuse-19.0.0-46.ga2cd52c0.el8.x86_ 1.8 MB/s | 94 kB 00:00 2023-12-07T00:11:34.829 INFO:teuthology.orchestra.run.smithi179.stdout:(26/131): python3-rgw-19.0.0-46.ga2cd52c0.el8.x 795 kB/s | 107 kB 00:00 2023-12-07T00:11:34.854 INFO:teuthology.orchestra.run.smithi179.stdout:(27/131): rbd-nbd-19.0.0-46.ga2cd52c0.el8.x86_6 2.1 MB/s | 180 kB 00:00 2023-12-07T00:11:34.904 INFO:teuthology.orchestra.run.smithi179.stdout:(28/131): ceph-grafana-dashboards-19.0.0-46.ga2 372 kB/s | 28 kB 00:00 2023-12-07T00:11:34.988 INFO:teuthology.orchestra.run.smithi179.stdout:(29/131): rbd-mirror-19.0.0-46.ga2cd52c0.el8.x8 15 MB/s | 3.6 MB 00:00 2023-12-07T00:11:35.005 INFO:teuthology.orchestra.run.smithi179.stdout:(30/131): ceph-mgr-cephadm-19.0.0-46.ga2cd52c0. 879 kB/s | 133 kB 00:00 2023-12-07T00:11:35.097 INFO:teuthology.orchestra.run.smithi179.stdout:(31/131): ceph-mgr-modules-core-19.0.0-46.ga2cd 2.6 MB/s | 243 kB 00:00 2023-12-07T00:11:35.206 INFO:teuthology.orchestra.run.smithi179.stdout:(32/131): ceph-mgr-rook-19.0.0-46.ga2cd52c0.el8 463 kB/s | 50 kB 00:00 2023-12-07T00:11:35.290 INFO:teuthology.orchestra.run.smithi179.stdout:(33/131): ceph-prometheus-alerts-19.0.0-46.ga2c 179 kB/s | 15 kB 00:00 2023-12-07T00:11:35.390 INFO:teuthology.orchestra.run.smithi179.stdout:(34/131): ceph-mgr-diskprediction-local-19.0.0- 18 MB/s | 7.4 MB 00:00 2023-12-07T00:11:35.407 INFO:teuthology.orchestra.run.smithi179.stdout:(35/131): ceph-volume-19.0.0-46.ga2cd52c0.el8.n 2.2 MB/s | 262 kB 00:00 2023-12-07T00:11:35.472 INFO:teuthology.orchestra.run.smithi179.stdout:(36/131): cephadm-19.0.0-46.ga2cd52c0.el8.noarc 5.0 MB/s | 415 kB 00:00 2023-12-07T00:11:35.499 INFO:teuthology.orchestra.run.smithi179.stdout:(37/131): cephfs-top-19.0.0-46.ga2cd52c0.el8.no 196 kB/s | 18 kB 00:00 2023-12-07T00:11:35.514 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-12-07T00:11:35.518 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-12-07T00:11:35.833 INFO:teuthology.orchestra.run.smithi179.stdout:(38/131): ceph-mgr-dashboard-19.0.0-46.ga2cd52c 1.9 MB/s | 1.8 MB 00:00 2023-12-07T00:11:36.025 INFO:teuthology.orchestra.run.smithi179.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 112 kB/s | 59 kB 00:00 2023-12-07T00:11:36.184 INFO:teuthology.orchestra.run.smithi179.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 430 kB/s | 306 kB 00:00 2023-12-07T00:11:36.293 INFO:teuthology.orchestra.run.smithi179.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2023-12-07T00:11:36.318 INFO:teuthology.orchestra.run.smithi179.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.6 MB/s | 476 kB 00:00 2023-12-07T00:11:36.360 INFO:teuthology.orchestra.run.smithi179.stdout:(43/131): libunwind-1.3.1-3.el8.x86_64.rpm 142 kB/s | 75 kB 00:00 2023-12-07T00:11:36.402 INFO:teuthology.orchestra.run.smithi179.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-12-07T00:11:36.427 INFO:teuthology.orchestra.run.smithi179.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 302 kB/s | 33 kB 00:00 2023-12-07T00:11:36.502 INFO:teuthology.orchestra.run.smithi179.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 115 kB/s | 16 kB 00:00 2023-12-07T00:11:36.527 INFO:teuthology.orchestra.run.smithi179.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-12-07T00:11:36.561 INFO:teuthology.orchestra.run.smithi179.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-12-07T00:11:36.636 INFO:teuthology.orchestra.run.smithi179.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-12-07T00:11:36.670 INFO:teuthology.orchestra.run.smithi179.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-12-07T00:11:36.687 INFO:teuthology.orchestra.run.smithi179.stdout:(51/131): python3-google-auth-1.1.1-10.el8.noar 443 kB/s | 81 kB 00:00 2023-12-07T00:11:36.788 INFO:teuthology.orchestra.run.smithi179.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 416 kB/s | 49 kB 00:00 2023-12-07T00:11:36.813 INFO:teuthology.orchestra.run.smithi179.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 468 kB/s | 59 kB 00:00 2023-12-07T00:11:36.913 INFO:teuthology.orchestra.run.smithi179.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 481 kB/s | 60 kB 00:00 2023-12-07T00:11:36.997 INFO:teuthology.orchestra.run.smithi179.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-12-07T00:11:37.022 INFO:teuthology.orchestra.run.smithi179.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-12-07T00:11:37.047 INFO:teuthology.orchestra.run.smithi179.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.2 MB/s | 283 kB 00:00 2023-12-07T00:11:37.098 INFO:teuthology.orchestra.run.smithi179.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 334 kB/s | 34 kB 00:00 2023-12-07T00:11:37.156 INFO:teuthology.orchestra.run.smithi179.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2023-12-07T00:11:37.182 INFO:teuthology.orchestra.run.smithi179.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 479 kB/s | 64 kB 00:00 2023-12-07T00:11:37.199 INFO:teuthology.orchestra.run.smithi179.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-12-07T00:11:37.257 INFO:teuthology.orchestra.run.smithi179.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 237 kB/s | 24 kB 00:00 2023-12-07T00:11:37.291 INFO:teuthology.orchestra.run.smithi179.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 268 kB/s | 29 kB 00:00 2023-12-07T00:11:37.316 INFO:teuthology.orchestra.run.smithi179.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-12-07T00:11:37.367 INFO:teuthology.orchestra.run.smithi179.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-12-07T00:11:37.417 INFO:teuthology.orchestra.run.smithi179.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.9 MB/s | 251 kB 00:00 2023-12-07T00:11:37.442 INFO:teuthology.orchestra.run.smithi179.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 486 kB/s | 61 kB 00:00 2023-12-07T00:11:37.501 INFO:teuthology.orchestra.run.smithi179.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 637 kB/s | 85 kB 00:00 2023-12-07T00:11:37.526 INFO:teuthology.orchestra.run.smithi179.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 210 kB/s | 23 kB 00:00 2023-12-07T00:11:37.552 INFO:teuthology.orchestra.run.smithi179.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-12-07T00:11:37.610 INFO:teuthology.orchestra.run.smithi179.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-12-07T00:11:37.652 INFO:teuthology.orchestra.run.smithi179.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 8.3 MB/s | 1.7 MB 00:00 2023-12-07T00:11:37.678 INFO:teuthology.orchestra.run.smithi179.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 810 kB/s | 54 kB 00:00 2023-12-07T00:11:37.728 INFO:teuthology.orchestra.run.smithi179.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.2 MB/s | 323 kB 00:00 2023-12-07T00:11:37.753 INFO:teuthology.orchestra.run.smithi179.stdout:(75/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2023-12-07T00:11:37.787 INFO:teuthology.orchestra.run.smithi179.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 661 kB/s | 39 kB 00:00 2023-12-07T00:11:37.821 INFO:teuthology.orchestra.run.smithi179.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-12-07T00:11:37.854 INFO:teuthology.orchestra.run.smithi179.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-12-07T00:11:37.879 INFO:teuthology.orchestra.run.smithi179.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-12-07T00:11:37.905 INFO:teuthology.orchestra.run.smithi179.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-12-07T00:11:37.938 INFO:teuthology.orchestra.run.smithi179.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-12-07T00:11:37.997 INFO:teuthology.orchestra.run.smithi179.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 456 kB/s | 27 kB 00:00 2023-12-07T00:11:38.039 INFO:teuthology.orchestra.run.smithi179.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-12-07T00:11:38.273 INFO:teuthology.orchestra.run.smithi179.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 188 kB/s | 44 kB 00:00 2023-12-07T00:11:38.373 INFO:teuthology.orchestra.run.smithi179.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-12-07T00:11:38.424 INFO:teuthology.orchestra.run.smithi179.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-12-07T00:11:38.499 INFO:teuthology.orchestra.run.smithi179.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.9 MB/s | 225 kB 00:00 2023-12-07T00:11:38.558 INFO:teuthology.orchestra.run.smithi179.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2023-12-07T00:11:38.583 INFO:teuthology.orchestra.run.smithi179.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 766 kB/s | 64 kB 00:00 2023-12-07T00:11:38.717 INFO:teuthology.orchestra.run.smithi179.stdout:(90/131): python3-scipy-1.0.0-21.module+el8.5.0 12 MB/s | 14 MB 00:01 2023-12-07T00:11:38.742 INFO:teuthology.orchestra.run.smithi179.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 126 kB/s | 20 kB 00:00 2023-12-07T00:11:38.767 INFO:teuthology.orchestra.run.smithi179.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 603 kB/s | 126 kB 00:00 2023-12-07T00:11:38.793 INFO:teuthology.orchestra.run.smithi179.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-12-07T00:11:38.826 INFO:teuthology.orchestra.run.smithi179.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-12-07T00:11:38.852 INFO:teuthology.orchestra.run.smithi179.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-12-07T00:11:38.894 INFO:teuthology.orchestra.run.smithi179.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-12-07T00:11:38.936 INFO:teuthology.orchestra.run.smithi179.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-12-07T00:11:39.036 INFO:teuthology.orchestra.run.smithi179.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2023-12-07T00:11:39.111 INFO:teuthology.orchestra.run.smithi179.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-12-07T00:11:39.162 INFO:teuthology.orchestra.run.smithi179.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-12-07T00:11:39.203 INFO:teuthology.orchestra.run.smithi179.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2023-12-07T00:11:39.246 INFO:teuthology.orchestra.run.smithi179.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-12-07T00:11:39.271 INFO:teuthology.orchestra.run.smithi179.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-12-07T00:11:39.296 INFO:teuthology.orchestra.run.smithi179.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-12-07T00:11:39.322 INFO:teuthology.orchestra.run.smithi179.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-12-07T00:11:39.347 INFO:teuthology.orchestra.run.smithi179.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 958 kB/s | 48 kB 00:00 2023-12-07T00:11:39.364 INFO:teuthology.orchestra.run.smithi179.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-12-07T00:11:39.389 INFO:teuthology.orchestra.run.smithi179.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 1.0 MB/s | 43 kB 00:00 2023-12-07T00:11:39.414 INFO:teuthology.orchestra.run.smithi179.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-12-07T00:11:39.440 INFO:teuthology.orchestra.run.smithi179.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-12-07T00:11:39.524 INFO:teuthology.orchestra.run.smithi179.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.6 MB/s | 5.1 MB 00:00 2023-12-07T00:11:39.549 INFO:teuthology.orchestra.run.smithi179.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 172 kB/s | 19 kB 00:00 2023-12-07T00:11:39.574 INFO:teuthology.orchestra.run.smithi179.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.4 MB/s | 560 kB 00:00 2023-12-07T00:11:39.600 INFO:teuthology.orchestra.run.smithi179.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.0 MB/s | 155 kB 00:00 2023-12-07T00:11:39.625 INFO:teuthology.orchestra.run.smithi179.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-12-07T00:11:39.670 INFO:teuthology.orchestra.run.smithi179.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.6 MB/s | 559 kB 00:00 2023-12-07T00:11:39.701 INFO:teuthology.orchestra.run.smithi179.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-12-07T00:11:39.726 INFO:teuthology.orchestra.run.smithi179.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-12-07T00:11:39.751 INFO:teuthology.orchestra.run.smithi179.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-12-07T00:11:39.777 INFO:teuthology.orchestra.run.smithi179.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-12-07T00:11:39.802 INFO:teuthology.orchestra.run.smithi179.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-12-07T00:11:39.827 INFO:teuthology.orchestra.run.smithi179.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-12-07T00:11:39.844 INFO:teuthology.orchestra.run.smithi179.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-12-07T00:11:39.861 INFO:teuthology.orchestra.run.smithi179.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-12-07T00:11:39.895 INFO:teuthology.orchestra.run.smithi179.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 13 MB/s | 644 kB 00:00 2023-12-07T00:11:39.920 INFO:teuthology.orchestra.run.smithi179.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-12-07T00:11:39.946 INFO:teuthology.orchestra.run.smithi179.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-12-07T00:11:40.013 INFO:teuthology.orchestra.run.smithi179.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.7 MB/s | 2.3 MB 00:00 2023-12-07T00:11:40.063 INFO:teuthology.orchestra.run.smithi179.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-12-07T00:11:40.404 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-12-07T00:11:40.620 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-12-07T00:11:40.621 INFO:teuthology.orchestra.run.smithi179.stdout:(130/131): librbd1-19.0.0-46.ga2cd52c0.el8.x86_ 5.5 MB/s | 3.7 MB 00:00 2023-12-07T00:11:40.836 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-12-07T00:11:41.013 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-12-07T00:11:41.117 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-12-07T00:11:41.330 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-12-07T00:11:41.722 INFO:teuthology.orchestra.run.smithi179.stdout:(131/131): librados2-19.0.0-46.ga2cd52c0.el8.x8 2.1 MB/s | 3.8 MB 00:01 2023-12-07T00:11:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2023-12-07T00:11:41.727 INFO:teuthology.orchestra.run.smithi179.stdout:Total 16 MB/s | 209 MB 00:13 2023-12-07T00:11:41.730 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-12-07T00:11:41.980 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:19.0.0-46.ga2cd52c0.el8.x86_64 5/134 2023-12-07T00:11:42.396 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:19.0.0-46.ga2cd52c0.el8.x86_64 5/134 2023-12-07T00:11:42.556 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2023-12-07T00:11:42.605 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:19.0.0-46.ga2cd52c0.el8.x86_64 6/134 2023-12-07T00:11:42.676 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2023-12-07T00:11:42.676 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2023-12-07T00:11:42.726 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:19.0.0-46.ga2cd52c0.el8.x86_64 6/134 2023-12-07T00:11:42.930 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:19.0.0-46.ga2cd52c0.el8.x86_64 7/134 2023-12-07T00:11:43.027 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:19.0.0-46.ga2cd52c0.el8.x86_64 7/134 2023-12-07T00:11:43.210 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:19.0.0-46.ga2cd52c0.el8.x86_64 8/134 2023-12-07T00:11:43.838 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2023-12-07T00:11:43.842 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2023-12-07T00:11:43.993 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-12-07T00:11:44.180 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:19.0.0-46.ga2cd52c0.el8.x86_64 10/134 2023-12-07T00:11:44.313 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:19.0.0-46.ga2cd52c0.el8.x86_64 10/134 2023-12-07T00:11:44.566 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libpq-13.5-1.el8.x86_64 11/134 2023-12-07T00:11:44.774 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/134 2023-12-07T00:11:45.497 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/134 2023-12-07T00:11:45.761 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/134 2023-12-07T00:11:45.971 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephsqlite-2:19.0.0-46.ga2cd52c0.el8.x86_64 15/134 2023-12-07T00:11:46.079 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephsqlite-2:19.0.0-46.ga2cd52c0.el8.x86_64 15/134 2023-12-07T00:11:46.246 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:19.0.0-46.ga2cd52c0.el8.x86_6 16/134 2023-12-07T00:11:46.394 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:19.0.0-46.ga2cd52c0.el8.x86_6 16/134 2023-12-07T00:11:46.575 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/134 2023-12-07T00:11:46.785 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 18/134 2023-12-07T00:11:46.943 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 19/134 2023-12-07T00:11:47.079 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 20/134 2023-12-07T00:11:47.210 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 20/134 2023-12-07T00:11:47.396 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 21/134 2023-12-07T00:11:48.009 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 21/134 2023-12-07T00:11:48.187 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 22/134 2023-12-07T00:11:48.783 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2023-12-07T00:11:48.783 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 22/134 2023-12-07T00:11:48.978 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.15-3.el8.x86_64 23/134 2023-12-07T00:11:49.261 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-12-07T00:11:49.417 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-12-07T00:11:49.659 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-12-07T00:11:49.716 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 23/134 2023-12-07T00:11:49.821 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-12-07T00:11:49.944 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-12-07T00:11:50.011 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/134 2023-12-07T00:11:50.171 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-12-07T00:11:50.226 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 25/134 2023-12-07T00:11:50.451 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/134 2023-12-07T00:11:50.571 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-12-07T00:11:50.795 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librados2-2:19.0.0-46.ga2cd52c0.el8.x86_64 6/134 2023-12-07T00:11:50.920 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el8.x8 27/134 2023-12-07T00:11:51.065 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el8. 28/134 2023-12-07T00:11:51.211 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-2:19.0.0-46.ga2cd52c0.el8.x86_64 6/134 2023-12-07T00:11:51.323 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:19.0.0-46.ga2cd52c0.el8.x86_64 29/134 2023-12-07T00:11:51.420 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : librbd1-2:19.0.0-46.ga2cd52c0.el8.x86_64 7/134 2023-12-07T00:11:51.553 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/134 2023-12-07T00:11:51.554 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-2:19.0.0-46.ga2cd52c0.el8.x86_64 7/134 2023-12-07T00:11:51.787 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs2-2:19.0.0-46.ga2cd52c0.el8.x86_64 8/134 2023-12-07T00:11:51.871 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephfs2-2:19.0.0-46.ga2cd52c0.el8.x86_64 8/134 2023-12-07T00:11:52.684 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rados-2:19.0.0-46.ga2cd52c0.el8.x86_64 9/134 2023-12-07T00:11:52.862 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librgw2-2:19.0.0-46.ga2cd52c0.el8.x86_64 10/134 2023-12-07T00:11:52.950 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librgw2-2:19.0.0-46.ga2cd52c0.el8.x86_64 10/134 2023-12-07T00:11:53.215 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpq-13.5-1.el8.x86_64 11/134 2023-12-07T00:11:53.317 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/134 2023-12-07T00:11:53.406 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/134 2023-12-07T00:11:53.804 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/134 2023-12-07T00:11:54.052 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/134 2023-12-07T00:11:54.245 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephsqlite-2:19.0.0-46.ga2cd52c0.el8.x86_64 15/134 2023-12-07T00:11:54.318 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/134 2023-12-07T00:11:54.359 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libcephsqlite-2:19.0.0-46.ga2cd52c0.el8.x86_64 15/134 2023-12-07T00:11:54.659 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 32/134 2023-12-07T00:11:54.930 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 33/134 2023-12-07T00:11:55.053 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libradosstriper1-2:19.0.0-46.ga2cd52c0.el8.x86_6 16/134 2023-12-07T00:11:55.154 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/134 2023-12-07T00:11:55.161 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libradosstriper1-2:19.0.0-46.ga2cd52c0.el8.x86_6 16/134 2023-12-07T00:11:55.295 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/134 2023-12-07T00:11:55.381 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-4.9-2.el8.noarch 35/134 2023-12-07T00:11:55.429 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/134 2023-12-07T00:11:55.556 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/134 2023-12-07T00:11:55.578 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/134 2023-12-07T00:11:55.796 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 37/134 2023-12-07T00:11:55.975 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 38/134 2023-12-07T00:11:56.192 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 39/134 2023-12-07T00:11:56.228 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/134 2023-12-07T00:11:56.351 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 40/134 2023-12-07T00:11:56.370 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/134 2023-12-07T00:11:56.505 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 41/134 2023-12-07T00:11:56.678 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : uuid-1.6.2-43.el8.x86_64 42/134 2023-12-07T00:11:56.751 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 42/134 2023-12-07T00:11:56.952 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/134 2023-12-07T00:11:56.993 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 43/134 2023-12-07T00:11:57.153 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/134 2023-12-07T00:11:57.223 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : automake-1.16.1-7.el8.noarch 44/134 2023-12-07T00:11:57.394 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/134 2023-12-07T00:11:57.471 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/134 2023-12-07T00:11:57.732 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : jq-1.6-3.el8.x86_64 46/134 2023-12-07T00:11:57.859 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/134 2023-12-07T00:11:57.931 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 47/134 2023-12-07T00:11:58.105 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/134 2023-12-07T00:11:58.142 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/134 2023-12-07T00:11:58.289 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 49/134 2023-12-07T00:11:58.345 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/134 2023-12-07T00:11:58.489 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.7-15.el8.x86_64 50/134 2023-12-07T00:11:58.539 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/134 2023-12-07T00:11:58.631 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 51/134 2023-12-07T00:11:58.767 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/134 2023-12-07T00:11:58.884 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 52/134 2023-12-07T00:11:58.967 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/134 2023-12-07T00:11:59.093 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 53/134 2023-12-07T00:11:59.212 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/134 2023-12-07T00:11:59.384 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el8.x8 27/134 2023-12-07T00:11:59.494 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 54/134 2023-12-07T00:11:59.497 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el8. 28/134 2023-12-07T00:11:59.821 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 55/134 2023-12-07T00:12:00.155 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 56/134 2023-12-07T00:12:00.389 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 57/134 2023-12-07T00:12:00.415 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cephfs-2:19.0.0-46.ga2cd52c0.el8.x86_64 29/134 2023-12-07T00:12:00.631 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 58/134 2023-12-07T00:12:00.718 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 30/134 2023-12-07T00:12:00.937 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 31/134 2023-12-07T00:12:00.976 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 59/134 2023-12-07T00:12:01.180 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/134 2023-12-07T00:12:01.201 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 60/134 2023-12-07T00:12:01.377 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/134 2023-12-07T00:12:01.403 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/134 2023-12-07T00:12:01.659 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 62/134 2023-12-07T00:12:01.843 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 63/134 2023-12-07T00:12:02.014 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 64/134 2023-12-07T00:12:02.333 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 65/134 2023-12-07T00:12:02.608 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 66/134 2023-12-07T00:12:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 67/134 2023-12-07T00:12:03.095 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 68/134 2023-12-07T00:12:03.172 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/134 2023-12-07T00:12:03.310 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 69/134 2023-12-07T00:12:03.486 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 34/134 2023-12-07T00:12:03.505 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 70/134 2023-12-07T00:12:03.731 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rsa-4.9-2.el8.noarch 35/134 2023-12-07T00:12:03.764 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 71/134 2023-12-07T00:12:03.906 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/134 2023-12-07T00:12:04.042 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 72/134 2023-12-07T00:12:04.146 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 37/134 2023-12-07T00:12:04.189 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 73/134 2023-12-07T00:12:04.347 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 74/134 2023-12-07T00:12:04.359 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-rbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 38/134 2023-12-07T00:12:04.532 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : librados-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 39/134 2023-12-07T00:12:04.554 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 75/134 2023-12-07T00:12:04.724 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 40/134 2023-12-07T00:12:04.732 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 76/134 2023-12-07T00:12:04.893 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 41/134 2023-12-07T00:12:04.922 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 77/134 2023-12-07T00:12:05.071 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 78/134 2023-12-07T00:12:05.096 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fuse-2.9.7-15.el8.x86_64 42/134 2023-12-07T00:12:05.224 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 79/134 2023-12-07T00:12:05.272 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 43/134 2023-12-07T00:12:05.466 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 80/134 2023-12-07T00:12:05.518 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 44/134 2023-12-07T00:12:05.714 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/134 2023-12-07T00:12:05.758 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 45/134 2023-12-07T00:12:05.924 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/134 2023-12-07T00:12:06.150 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 46/134 2023-12-07T00:12:06.165 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/134 2023-12-07T00:12:06.425 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/134 2023-12-07T00:12:06.446 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 47/134 2023-12-07T00:12:06.608 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 85/134 2023-12-07T00:12:06.636 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/134 2023-12-07T00:12:06.809 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 86/134 2023-12-07T00:12:06.889 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 49/134 2023-12-07T00:12:07.098 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 50/134 2023-12-07T00:12:07.467 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 51/134 2023-12-07T00:12:07.709 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 52/134 2023-12-07T00:12:07.868 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 87/134 2023-12-07T00:12:07.930 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 53/134 2023-12-07T00:12:08.137 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 88/134 2023-12-07T00:12:08.165 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/134 2023-12-07T00:12:08.358 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 55/134 2023-12-07T00:12:08.383 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/134 2023-12-07T00:12:08.513 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 56/134 2023-12-07T00:12:08.701 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/134 2023-12-07T00:12:08.813 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 57/134 2023-12-07T00:12:09.010 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/134 2023-12-07T00:12:09.064 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 58/134 2023-12-07T00:12:09.209 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/134 2023-12-07T00:12:09.321 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 59/134 2023-12-07T00:12:09.435 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/134 2023-12-07T00:12:09.533 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 60/134 2023-12-07T00:12:09.740 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 61/134 2023-12-07T00:12:09.877 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 62/134 2023-12-07T00:12:10.067 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : uuid-1.6.2-43.el8.x86_64 63/134 2023-12-07T00:12:10.121 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 63/134 2023-12-07T00:12:10.363 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 64/134 2023-12-07T00:12:10.545 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : automake-1.16.1-7.el8.noarch 65/134 2023-12-07T00:12:10.734 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 66/134 2023-12-07T00:12:10.817 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 66/134 2023-12-07T00:12:11.048 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : jq-1.6-3.el8.x86_64 67/134 2023-12-07T00:12:11.240 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 68/134 2023-12-07T00:12:11.409 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 69/134 2023-12-07T00:12:11.604 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 70/134 2023-12-07T00:12:11.882 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 71/134 2023-12-07T00:12:12.083 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 72/134 2023-12-07T00:12:12.264 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 73/134 2023-12-07T00:12:12.412 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 74/134 2023-12-07T00:12:12.594 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 75/134 2023-12-07T00:12:12.822 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 76/134 2023-12-07T00:12:13.004 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 77/134 2023-12-07T00:12:13.145 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 78/134 2023-12-07T00:12:13.183 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 94/134 2023-12-07T00:12:13.323 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 79/134 2023-12-07T00:12:13.426 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 94/134 2023-12-07T00:12:13.505 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 80/134 2023-12-07T00:12:13.696 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 81/134 2023-12-07T00:12:13.931 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/134 2023-12-07T00:12:14.005 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 94/134 2023-12-07T00:12:14.164 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/134 2023-12-07T00:12:14.359 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:19.0.0-46.ga2cd52c0.el8.x86_64 95/134 2023-12-07T00:12:14.391 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/134 2023-12-07T00:12:14.428 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:19.0.0-46.ga2cd52c0.el8.x86_64 95/134 2023-12-07T00:12:14.574 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 85/134 2023-12-07T00:12:14.600 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:19.0.0-46.ga2cd52c0.el8.x86_64 96/134 2023-12-07T00:12:14.780 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 86/134 2023-12-07T00:12:15.896 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 87/134 2023-12-07T00:12:16.145 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 88/134 2023-12-07T00:12:16.399 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/134 2023-12-07T00:12:16.725 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/134 2023-12-07T00:12:17.028 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/134 2023-12-07T00:12:17.225 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 92/134 2023-12-07T00:12:17.434 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 93/134 2023-12-07T00:12:21.112 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 94/134 2023-12-07T00:12:21.342 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 94/134 2023-12-07T00:12:21.917 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 94/134 2023-12-07T00:12:22.190 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-base-2:19.0.0-46.ga2cd52c0.el8.x86_64 95/134 2023-12-07T00:12:22.291 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-base-2:19.0.0-46.ga2cd52c0.el8.x86_64 95/134 2023-12-07T00:12:22.449 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-selinux-2:19.0.0-46.ga2cd52c0.el8.x86_64 96/134 2023-12-07T00:12:33.285 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:19.0.0-46.ga2cd52c0.el8.x86_64 96/134 2023-12-07T00:12:33.286 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2023-12-07T00:12:33.286 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2023-12-07T00:12:33.286 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2023-12-07T00:12:33.286 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /run 2023-12-07T00:12:33.286 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2023-12-07T00:12:33.287 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2023-12-07T00:12:33.287 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2023-12-07T00:12:33.287 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2023-12-07T00:12:33.287 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2023-12-07T00:12:33.287 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:12:33.631 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-volume-2:19.0.0-46.ga2cd52c0.el8.noarch 97/134 2023-12-07T00:12:35.239 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-volume-2:19.0.0-46.ga2cd52c0.el8.noarch 97/134 2023-12-07T00:12:35.456 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:19.0.0-46.ga2cd52c0.el8.x86_64 98/134 2023-12-07T00:12:35.675 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:19.0.0-46.ga2cd52c0.el8.x86_64 98/134 2023-12-07T00:12:35.830 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:19.0.0-46.ga2cd52c0.el8.x86_64 99/134 2023-12-07T00:12:36.285 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:19.0.0-46.ga2cd52c0.el8.x86_64 99/134 2023-12-07T00:12:36.505 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:19.0.0-46.ga2cd52c0.el8.x86_64 100/134 2023-12-07T00:12:36.522 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:19.0.0-46.ga2cd52c0.el8.x86_64 100/134 2023-12-07T00:12:38.229 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 101/134 2023-12-07T00:12:38.433 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 101/134 2023-12-07T00:12:38.595 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el8 102/134 2023-12-07T00:12:38.796 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 103/134 2023-12-07T00:12:38.996 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el8.noarc 104/134 2023-12-07T00:12:39.221 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el8.noarc 104/134 2023-12-07T00:12:39.488 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el8.noa 105/134 2023-12-07T00:12:40.447 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el8.noa 105/134 2023-12-07T00:12:40.596 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 106/134 2023-12-07T00:12:40.688 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 106/134 2023-12-07T00:12:41.071 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el8. 107/134 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-selinux-2:19.0.0-46.ga2cd52c0.el8.x86_64 96/134 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /sys 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /proc 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /run 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /mnt 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /var/tmp 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /home 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /tmp 2023-12-07T00:12:41.084 INFO:teuthology.orchestra.run.smithi179.stdout:skipping the directory /dev 2023-12-07T00:12:41.085 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:12:41.280 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:19.0.0-46.ga2cd52c0.el8.x86_64 108/134 2023-12-07T00:12:41.316 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:19.0.0-46.ga2cd52c0.el8.x86_64 108/134 2023-12-07T00:12:41.439 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-volume-2:19.0.0-46.ga2cd52c0.el8.noarch 97/134 2023-12-07T00:12:41.504 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el8.noarch 109/134 2023-12-07T00:12:41.515 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el8.noarch 109/134 2023-12-07T00:12:42.854 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:19.0.0-46.ga2cd52c0.el8.x86_64 110/134 2023-12-07T00:12:43.057 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-volume-2:19.0.0-46.ga2cd52c0.el8.noarch 97/134 2023-12-07T00:12:43.121 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 111/134 2023-12-07T00:12:43.156 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 111/134 2023-12-07T00:12:43.262 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-osd-2:19.0.0-46.ga2cd52c0.el8.x86_64 98/134 2023-12-07T00:12:43.337 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 112/134 2023-12-07T00:12:43.379 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 112/134 2023-12-07T00:12:43.482 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-osd-2:19.0.0-46.ga2cd52c0.el8.x86_64 98/134 2023-12-07T00:12:43.554 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 113/134 2023-12-07T00:12:43.655 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mds-2:19.0.0-46.ga2cd52c0.el8.x86_64 99/134 2023-12-07T00:12:43.909 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 113/134 2023-12-07T00:12:44.087 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 114/134 2023-12-07T00:12:44.114 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mds-2:19.0.0-46.ga2cd52c0.el8.x86_64 99/134 2023-12-07T00:12:44.296 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mon-2:19.0.0-46.ga2cd52c0.el8.x86_64 100/134 2023-12-07T00:12:44.314 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mon-2:19.0.0-46.ga2cd52c0.el8.x86_64 100/134 2023-12-07T00:12:46.089 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 101/134 2023-12-07T00:12:46.297 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 101/134 2023-12-07T00:12:46.428 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el8 102/134 2023-12-07T00:12:46.661 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 103/134 2023-12-07T00:12:46.863 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el8.noarc 104/134 2023-12-07T00:12:47.099 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el8.noarc 104/134 2023-12-07T00:12:47.361 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el8.noa 105/134 2023-12-07T00:12:48.321 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el8.noa 105/134 2023-12-07T00:12:48.462 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 106/134 2023-12-07T00:12:48.553 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 106/134 2023-12-07T00:12:48.736 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 114/134 2023-12-07T00:12:48.962 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el8. 107/134 2023-12-07T00:12:49.178 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-2:19.0.0-46.ga2cd52c0.el8.x86_64 108/134 2023-12-07T00:12:49.215 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-2:19.0.0-46.ga2cd52c0.el8.x86_64 108/134 2023-12-07T00:12:49.396 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el8.noarch 109/134 2023-12-07T00:12:49.449 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el8.noarch 109/134 2023-12-07T00:12:49.603 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:19.0.0-46.ga2cd52c0.el8.x86_64 115/134 2023-12-07T00:12:49.931 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-12-07T00:12:50.198 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 117/134 2023-12-07T00:12:50.462 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-12-07T00:12:50.644 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-12-07T00:12:50.718 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-2:19.0.0-46.ga2cd52c0.el8.x86_64 110/134 2023-12-07T00:12:50.836 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-12-07T00:12:50.936 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 111/134 2023-12-07T00:12:50.970 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 111/134 2023-12-07T00:12:51.098 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-12-07T00:12:51.146 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 112/134 2023-12-07T00:12:51.187 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 112/134 2023-12-07T00:12:51.273 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 121/134 2023-12-07T00:12:51.321 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 113/134 2023-12-07T00:12:51.428 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-12-07T00:12:51.676 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 113/134 2023-12-07T00:12:51.829 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 114/134 2023-12-07T00:12:53.613 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-07T00:12:53.911 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-07T00:12:53.929 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-07T00:12:54.094 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-top-2:19.0.0-46.ga2cd52c0.el8.noarch 124/134 2023-12-07T00:12:54.402 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 125/134 2023-12-07T00:12:54.703 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 126/134 2023-12-07T00:12:55.104 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-12-07T00:12:55.310 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-12-07T00:12:55.393 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-12-07T00:12:55.627 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-12-07T00:12:55.640 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-12-07T00:12:55.793 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-12-07T00:12:55.802 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-12-07T00:12:55.929 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-12-07T00:12:55.929 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-07T00:12:56.121 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-07T00:12:56.122 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-07T00:12:56.398 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-07T00:12:56.488 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: rbd-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 114/134 2023-12-07T00:12:56.584 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-07T00:12:56.782 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-test-2:19.0.0-46.ga2cd52c0.el8.x86_64 115/134 2023-12-07T00:12:56.953 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-12-07T00:12:57.083 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-12-07T00:12:57.083 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:19.0.0-46.ga2cd52c0.el8.x86_64 1/134 2023-12-07T00:12:57.083 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:19.0.0-46.ga2cd52c0.el8.x86_64 2/134 2023-12-07T00:12:57.083 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 3/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 4/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 5/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:19.0.0-46.ga2cd52c0.el8.x86_64 6/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:19.0.0-46.ga2cd52c0.el8.x86_64 7/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:19.0.0-46.ga2cd52c0.el8.x86_64 8/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:19.0.0-46.ga2cd52c0.el8.x86_64 9/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 10/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:19.0.0-46.ga2cd52c0.el8.x86_64 11/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:19.0.0-46.ga2cd52c0.el8.x86_64 12/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 13/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 14/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:19.0.0-46.ga2cd52c0.el8.x86_64 15/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephsqlite-2:19.0.0-46.ga2cd52c0.el8.x86_64 16/134 2023-12-07T00:12:57.084 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 17/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:19.0.0-46.ga2cd52c0.el8.x86_6 18/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:19.0.0-46.ga2cd52c0.el8.x86_64 19/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el8. 20/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el8.x8 21/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:19.0.0-46.ga2cd52c0.el8.x86_64 22/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:19.0.0-46.ga2cd52c0.el8.x86_64 23/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 24/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 25/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 26/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 27/134 2023-12-07T00:12:57.085 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 28/134 2023-12-07T00:12:57.095 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 29/134 2023-12-07T00:12:57.095 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el8.noarc 30/134 2023-12-07T00:12:57.095 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el8.noa 31/134 2023-12-07T00:12:57.095 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 32/134 2023-12-07T00:12:57.095 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el8. 33/134 2023-12-07T00:12:57.095 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el8.noarch 34/134 2023-12-07T00:12:57.095 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el8 35/134 2023-12-07T00:12:57.095 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-volume-2:19.0.0-46.ga2cd52c0.el8.noarch 36/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 37/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-top-2:19.0.0-46.ga2cd52c0.el8.noarch 38/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-12-07T00:12:57.096 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-12-07T00:12:57.097 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-12-07T00:12:57.098 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-12-07T00:12:57.099 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-12-07T00:12:57.100 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-12-07T00:12:57.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-12-07T00:12:57.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-12-07T00:12:57.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-12-07T00:12:57.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-12-07T00:12:57.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-12-07T00:12:57.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-12-07T00:12:57.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-12-07T00:12:57.101 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-12-07T00:12:57.102 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:19.0.0-46.ga2cd52c0.el8.x86_64 129/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:19.0.0-46.ga2cd52c0.el8.x86_64 131/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-07T00:12:57.103 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-12-07T00:12:57.146 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-12-07T00:12:58.039 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-12-07T00:12:58.348 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-12-07T00:12:58.545 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ceph-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 119/134 2023-12-07T00:12:58.790 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-12-07T00:12:58.948 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 121/134 2023-12-07T00:12:59.062 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-12-07T00:13:01.315 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-07T00:13:01.569 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-07T00:13:01.587 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-07T00:13:01.786 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : cephfs-top-2:19.0.0-46.ga2cd52c0.el8.noarch 124/134 2023-12-07T00:13:02.018 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 125/134 2023-12-07T00:13:02.323 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rbd-nbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 126/134 2023-12-07T00:13:02.623 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-07T00:13:02.623 INFO:teuthology.orchestra.run.smithi190.stdout:Installed products updated. 2023-12-07T00:13:02.645 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-12-07T00:13:02.818 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-12-07T00:13:02.827 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-12-07T00:13:02.851 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:02.851 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2023-12-07T00:13:02.851 INFO:teuthology.orchestra.run.smithi190.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-12-07T00:13:02.851 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.851 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.851 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-12-07T00:13:02.851 INFO:teuthology.orchestra.run.smithi190.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-12-07T00:13:02.851 INFO:teuthology.orchestra.run.smithi190.stdout: automake-1.16.1-7.el8.noarch 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: bison-3.0.4-10.el8.x86_64 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.852 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: flex-2.6.1-9.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-2.9.7-15.el8.x86_64 2023-12-07T00:13:02.853 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: jq-1.6-3.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: libpq-13.5-1.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-12-07T00:13:02.854 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-07T00:13:02.855 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.15-3.el8.x86_64 2023-12-07T00:13:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-12-07T00:13:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-12-07T00:13:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-07T00:13:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-07T00:13:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-07T00:13:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-07T00:13:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-07T00:13:02.856 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-07T00:13:02.857 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.0.6-13.el8.noarch 2023-12-07T00:13:02.858 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-2.6-1.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2017.2-9.el8.noarch 2023-12-07T00:13:02.859 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-07T00:13:02.860 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-12-07T00:13:02.861 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:02.862 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-12-07T00:13:03.006 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-12-07T00:13:03.044 DEBUG:teuthology.parallel:result is None 2023-12-07T00:13:03.176 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-12-07T00:13:03.266 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-12-07T00:13:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-12-07T00:13:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-12-07T00:13:03.456 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-07T00:13:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-07T00:13:03.663 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-07T00:13:03.931 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-07T00:13:04.117 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-2:19.0.0-46.ga2cd52c0.el8.x86_64 1/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-base-2:19.0.0-46.ga2cd52c0.el8.x86_64 2/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 3/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 4/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c 5/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mds-2:19.0.0-46.ga2cd52c0.el8.x86_64 6/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-2:19.0.0-46.ga2cd52c0.el8.x86_64 7/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mon-2:19.0.0-46.ga2cd52c0.el8.x86_64 8/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-osd-2:19.0.0-46.ga2cd52c0.el8.x86_64 9/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-radosgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 10/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-selinux-2:19.0.0-46.ga2cd52c0.el8.x86_64 11/134 2023-12-07T00:13:04.623 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-test-2:19.0.0-46.ga2cd52c0.el8.x86_64 12/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 13/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 14/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephfs2-2:19.0.0-46.ga2cd52c0.el8.x86_64 15/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcephsqlite-2:19.0.0-46.ga2cd52c0.el8.x86_64 16/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 17/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libradosstriper1-2:19.0.0-46.ga2cd52c0.el8.x86_6 18/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librgw2-2:19.0.0-46.ga2cd52c0.el8.x86_64 19/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el8. 20/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-ceph-common-2:19.0.0-46.ga2cd52c0.el8.x8 21/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cephfs-2:19.0.0-46.ga2cd52c0.el8.x86_64 22/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rados-2:19.0.0-46.ga2cd52c0.el8.x86_64 23/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 24/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 25/134 2023-12-07T00:13:04.624 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 26/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 27/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rbd-nbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 28/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el 29/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el8.noarc 30/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el8.noa 31/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd5 32/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el8. 33/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el8.noarch 34/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el8 35/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ceph-volume-2:19.0.0-46.ga2cd52c0.el8.noarch 36/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 37/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : cephfs-top-2:19.0.0-46.ga2cd52c0.el8.noarch 38/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-12-07T00:13:04.625 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-12-07T00:13:04.626 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-12-07T00:13:04.627 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-12-07T00:13:04.628 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-12-07T00:13:04.629 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-12-07T00:13:04.629 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-12-07T00:13:04.629 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-12-07T00:13:04.629 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-12-07T00:13:04.629 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-12-07T00:13:04.629 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-12-07T00:13:04.629 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-12-07T00:13:04.630 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-12-07T00:13:04.630 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-12-07T00:13:04.630 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-12-07T00:13:04.630 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-12-07T00:13:04.630 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-12-07T00:13:04.630 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-12-07T00:13:04.630 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-12-07T00:13:04.631 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-12-07T00:13:04.632 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-12-07T00:13:04.633 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-2:19.0.0-46.ga2cd52c0.el8.x86_64 129/134 2023-12-07T00:13:04.633 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-12-07T00:13:04.633 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-2:19.0.0-46.ga2cd52c0.el8.x86_64 131/134 2023-12-07T00:13:04.633 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-07T00:13:04.633 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-12-07T00:13:10.250 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-07T00:13:10.250 INFO:teuthology.orchestra.run.smithi179.stdout:Installed products updated. 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout: librados2-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout: automake-1.16.1-7.el8.noarch 2023-12-07T00:13:10.480 INFO:teuthology.orchestra.run.smithi179.stdout: bison-3.0.4-10.el8.x86_64 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-grafana-dashboards-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-immutable-object-cache-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.481 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-rook-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-osd-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-prometheus-alerts-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-radosgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-selinux-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-test-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: cephadm-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: cephfs-top-2:19.0.0-46.ga2cd52c0.el8.noarch 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: flex-2.6.1-9.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: fuse-2.9.7-15.el8.x86_64 2023-12-07T00:13:10.482 INFO:teuthology.orchestra.run.smithi179.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: jq-1.6-3.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libcephsqlite-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libpq-13.5-1.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: librados-devel-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: libradosstriper1-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.483 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: librgw2-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-0.3.15-3.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-07T00:13:10.484 INFO:teuthology.orchestra.run.smithi179.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cephfs-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-07T00:13:10.485 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako-1.0.6-13.el8.noarch 2023-12-07T00:13:10.486 INFO:teuthology.orchestra.run.smithi179.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-portend-2.6-1.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pytz-2017.2-9.el8.noarch 2023-12-07T00:13:10.487 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rgw-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-07T00:13:10.488 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-fuse-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-mirror-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-2:19.0.0-46.ga2cd52c0.el8.x86_64 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-12-07T00:13:10.489 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-07T00:13:10.490 INFO:teuthology.orchestra.run.smithi179.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-07T00:13:10.490 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:10.490 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-12-07T00:13:10.667 DEBUG:teuthology.parallel:result is None 2023-12-07T00:13:10.668 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-07T00:13:10.806 DEBUG:teuthology.orchestra.run.smithi179:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-07T00:13:10.830 INFO:teuthology.orchestra.run.smithi179.stdout:19.0.0-46.ga2cd52c0.el8 2023-12-07T00:13:10.830 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-46.ga2cd52c0.el8 2023-12-07T00:13:10.831 INFO:teuthology.task.install:The correct ceph version 19.0.0-46.ga2cd52c0 is installed. 2023-12-07T00:13:10.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a2cd52c00149b5caff897ea7f79d0529b62620da 2023-12-07T00:13:10.967 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-07T00:13:10.997 INFO:teuthology.orchestra.run.smithi190.stdout:19.0.0-46.ga2cd52c0.el8 2023-12-07T00:13:10.998 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-46.ga2cd52c0.el8 2023-12-07T00:13:10.998 INFO:teuthology.task.install:The correct ceph version 19.0.0-46.ga2cd52c0 is installed. 2023-12-07T00:13:10.998 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-07T00:13:10.999 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:10.999 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-07T00:13:11.041 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:11.041 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-07T00:13:11.086 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-07T00:13:11.087 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:11.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2023-12-07T00:13:11.114 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-07T00:13:11.181 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:11.181 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2023-12-07T00:13:11.209 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-07T00:13:11.278 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-07T00:13:11.278 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:11.278 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-07T00:13:11.304 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-07T00:13:11.370 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:11.370 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-07T00:13:11.398 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-07T00:13:11.465 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-07T00:13:11.465 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:11.465 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2023-12-07T00:13:11.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-07T00:13:11.556 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:11.557 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2023-12-07T00:13:11.583 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-07T00:13:11.649 INFO:teuthology.run_tasks:Running task ceph... 2023-12-07T00:13:11.728 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-07T00:13:11.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2023-12-07T00:13:11.731 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2023-12-07T00:13:11.759 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-07T00:13:11.759 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-07T00:13:11.798 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-07T00:13:11.826 INFO:tasks.ceph:Creating extra log directories... 2023-12-07T00:13:11.826 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-07T00:13:11.864 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-07T00:13:11.899 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-07T00:13:11.899 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-07T00:13:11.899 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-07T00:13:11.900 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:11.900 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-07T00:13:11.944 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-07T00:13:12.098 DEBUG:teuthology.orchestra.run.smithi179:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-07T00:13:12.124 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:12.124 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-07T00:13:12.141 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-07T00:13:12.267 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-07T00:13:12.299 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-07T00:13:12.299 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-07T00:13:12.300 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi/7480365', 'branch': 'wip-vshankar-testing-20231206.125818', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7480365', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-06_15:12:46-fs-wip-vshankar-testing-20231206.125818-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231206.125818'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231206.125818', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4099, 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'sleep_before_teardown': 0, 'subset': '359/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231206.125818', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a2cd52c00149b5caff897ea7f79d0529b62620da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '9471594ae3a4c6992c4327df9a789df8f2b6aeae'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a2cd52c00149b5caff897ea7f79d0529b62620da', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-06_15:12:46', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-07T00:13:12.300 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-07T00:13:12.302 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-07T00:13:12.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2023-12-07T00:13:12.359 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2023-12-07T00:13:12.419 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:12.419 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T00:13:12.439 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T00:13:12.439 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 390518 Links: 1 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-12-07 00:13:04.317785992 +0000 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-12-07 00:10:23.217437829 +0000 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-12-07 00:10:23.217437829 +0000 2023-12-07T00:13:12.497 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-12-07T00:13:12.498 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T00:13:12.561 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-12-07T00:13:12.562 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-12-07T00:13:12.562 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000275202 s, 1.9 MB/s 2023-12-07T00:13:12.563 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T00:13:12.620 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2023-12-07T00:13:12.678 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T00:13:12.678 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T00:13:12.678 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 383941 Links: 1 2023-12-07T00:13:12.678 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T00:13:12.678 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T00:13:12.679 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-12-07 00:13:04.317785992 +0000 2023-12-07T00:13:12.679 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-12-07 00:10:23.744426107 +0000 2023-12-07T00:13:12.679 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-12-07 00:10:23.744426107 +0000 2023-12-07T00:13:12.679 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-12-07T00:13:12.679 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T00:13:12.743 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-12-07T00:13:12.743 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-12-07T00:13:12.743 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000219254 s, 2.3 MB/s 2023-12-07T00:13:12.744 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T00:13:12.802 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2023-12-07T00:13:12.860 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T00:13:12.861 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T00:13:12.861 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 390695 Links: 1 2023-12-07T00:13:12.861 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T00:13:12.861 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T00:13:12.861 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-12-07 00:13:04.317785992 +0000 2023-12-07T00:13:12.861 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-12-07 00:10:24.259414652 +0000 2023-12-07T00:13:12.861 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-12-07 00:10:24.259414652 +0000 2023-12-07T00:13:12.861 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-12-07T00:13:12.861 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T00:13:12.925 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-12-07T00:13:12.925 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-12-07T00:13:12.926 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000223689 s, 2.3 MB/s 2023-12-07T00:13:12.927 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T00:13:12.984 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2023-12-07T00:13:13.041 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T00:13:13.041 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T00:13:13.041 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 6h/6d Inode: 390821 Links: 1 2023-12-07T00:13:13.041 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T00:13:13.042 INFO:teuthology.orchestra.run.smithi179.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T00:13:13.042 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2023-12-07 00:13:04.317785992 +0000 2023-12-07T00:13:13.042 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2023-12-07 00:10:24.772403241 +0000 2023-12-07T00:13:13.042 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2023-12-07 00:10:24.772403241 +0000 2023-12-07T00:13:13.042 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2023-12-07T00:13:13.043 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T00:13:13.106 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2023-12-07T00:13:13.106 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2023-12-07T00:13:13.106 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000194415 s, 2.6 MB/s 2023-12-07T00:13:13.108 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T00:13:13.165 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:13.166 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:13.166 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T00:13:13.184 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T00:13:13.184 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2023-12-07T00:13:13.242 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T00:13:13.242 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T00:13:13.242 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 389608 Links: 1 2023-12-07T00:13:13.242 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T00:13:13.242 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T00:13:13.243 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-12-07 00:12:56.784947597 +0000 2023-12-07T00:13:13.243 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-07 00:09:31.110751401 +0000 2023-12-07T00:13:13.243 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-07 00:09:31.110751401 +0000 2023-12-07T00:13:13.243 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-12-07T00:13:13.243 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T00:13:13.310 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-12-07T00:13:13.310 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-12-07T00:13:13.310 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.00025497 s, 2.0 MB/s 2023-12-07T00:13:13.311 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T00:13:13.370 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2023-12-07T00:13:13.428 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T00:13:13.428 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T00:13:13.428 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 391633 Links: 1 2023-12-07T00:13:13.428 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T00:13:13.428 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T00:13:13.428 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-12-07 00:12:56.785947568 +0000 2023-12-07T00:13:13.429 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-07 00:09:31.648736043 +0000 2023-12-07T00:13:13.429 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-07 00:09:31.648736043 +0000 2023-12-07T00:13:13.429 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-12-07T00:13:13.429 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T00:13:13.494 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-12-07T00:13:13.495 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-12-07T00:13:13.495 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000251011 s, 2.0 MB/s 2023-12-07T00:13:13.496 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T00:13:13.553 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2023-12-07T00:13:13.610 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T00:13:13.610 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T00:13:13.610 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 390683 Links: 1 2023-12-07T00:13:13.611 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T00:13:13.611 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T00:13:13.611 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-12-07 00:12:56.785947568 +0000 2023-12-07T00:13:13.611 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-07 00:09:32.168721199 +0000 2023-12-07T00:13:13.611 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-07 00:09:32.168721199 +0000 2023-12-07T00:13:13.611 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-12-07T00:13:13.611 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T00:13:13.675 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-12-07T00:13:13.676 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-12-07T00:13:13.676 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000204483 s, 2.5 MB/s 2023-12-07T00:13:13.677 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T00:13:13.734 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2023-12-07T00:13:13.791 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T00:13:13.791 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T00:13:13.791 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 387032 Links: 1 2023-12-07T00:13:13.791 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T00:13:13.791 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-12-07T00:13:13.791 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-12-07 00:12:56.785947568 +0000 2023-12-07T00:13:13.791 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-12-07 00:09:32.693706212 +0000 2023-12-07T00:13:13.791 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-12-07 00:09:32.693706212 +0000 2023-12-07T00:13:13.792 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-12-07T00:13:13.792 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T00:13:13.856 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-12-07T00:13:13.856 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-12-07T00:13:13.856 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000243878 s, 2.1 MB/s 2023-12-07T00:13:13.857 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T00:13:13.915 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:13.915 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-07T00:13:13.915 INFO:tasks.ceph:Generating config... 2023-12-07T00:13:13.916 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-07T00:13:13.916 INFO:tasks.ceph:[client] debug client = 20 2023-12-07T00:13:13.917 INFO:tasks.ceph:[client] debug ms = 1 2023-12-07T00:13:13.917 INFO:tasks.ceph:[client] pid file = 2023-12-07T00:13:13.917 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-07T00:13:13.917 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-07T00:13:13.917 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-07T00:13:13.917 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-07T00:13:13.917 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-07T00:13:13.917 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-07T00:13:13.917 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-07T00:13:13.917 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-07T00:13:13.917 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-07T00:13:13.917 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-07T00:13:13.917 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-07T00:13:13.918 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-07T00:13:13.918 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-07T00:13:13.918 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-07T00:13:13.918 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-07T00:13:13.918 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-07T00:13:13.918 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-07T00:13:13.918 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-07T00:13:13.918 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-07T00:13:13.918 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-07T00:13:13.918 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-07T00:13:13.918 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-07T00:13:13.918 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-07T00:13:13.918 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-07T00:13:13.918 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-07T00:13:13.919 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-07T00:13:13.919 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-07T00:13:13.919 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-07T00:13:13.919 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-07T00:13:13.919 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-07T00:13:13.919 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-07T00:13:13.919 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-07T00:13:13.919 INFO:tasks.ceph:Setting up mon.a... 2023-12-07T00:13:13.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-07T00:13:13.982 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.keyring 2023-12-07T00:13:13.986 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-07T00:13:14.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T00:13:14.059 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.179'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2023-12-07T00:13:14.060 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.179,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-07T00:13:14.061 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:14.061 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-07T00:13:14.116 DEBUG:teuthology.orchestra.run.smithi179:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.179 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:14.203 INFO:teuthology.orchestra.run.smithi179.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:14.204 INFO:teuthology.orchestra.run.smithi179.stdout:monmaptool: generated fsid 4803447b-a0af-4501-a3c6-e46974a67250 2023-12-07T00:13:14.204 INFO:teuthology.orchestra.run.smithi179.stdout:setting min_mon_release = pacific 2023-12-07T00:13:14.204 INFO:teuthology.orchestra.run.smithi179.stdout:epoch 0 2023-12-07T00:13:14.204 INFO:teuthology.orchestra.run.smithi179.stdout:fsid 4803447b-a0af-4501-a3c6-e46974a67250 2023-12-07T00:13:14.204 INFO:teuthology.orchestra.run.smithi179.stdout:last_changed 2023-12-07T00:13:14.205363+0000 2023-12-07T00:13:14.204 INFO:teuthology.orchestra.run.smithi179.stdout:created 2023-12-07T00:13:14.205363+0000 2023-12-07T00:13:14.204 INFO:teuthology.orchestra.run.smithi179.stdout:min_mon_release 16 (pacific) 2023-12-07T00:13:14.204 INFO:teuthology.orchestra.run.smithi179.stdout:election_strategy: 1 2023-12-07T00:13:14.205 INFO:teuthology.orchestra.run.smithi179.stdout:0: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.a 2023-12-07T00:13:14.205 INFO:teuthology.orchestra.run.smithi179.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2023-12-07T00:13:14.205 INFO:teuthology.orchestra.run.smithi179.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2023-12-07T00:13:14.205 INFO:teuthology.orchestra.run.smithi179.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-07T00:13:14.208 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-07T00:13:14.226 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4803447b-a0af-4501-a3c6-e46974a67250... 2023-12-07T00:13:14.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-07T00:13:14.269 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-07T00:13:14.310 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2023-12-07T00:13:14.310 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2023-12-07T00:13:14.311 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2023-12-07T00:13:14.312 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2023-12-07T00:13:14.313 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.179,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on skipped message = False 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = 4803447b-a0af-4501-a3c6-e46974a67250 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2023-12-07T00:13:14.314 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.315 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 20 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 20 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 10 2023-12-07T00:13:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.317 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2023-12-07T00:13:14.318 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2023-12-07T00:13:14.319 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = "" 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2023-12-07T00:13:14.320 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2023-12-07T00:13:14.321 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2023-12-07T00:13:14.322 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2023-12-07T00:13:14.322 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2023-12-07T00:13:14.322 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2023-12-07T00:13:14.322 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.323 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2023-12-07T00:13:14.324 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.179,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on skipped message = False 2023-12-07T00:13:14.325 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 4803447b-a0af-4501-a3c6-e46974a67250 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2023-12-07T00:13:14.326 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.327 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2023-12-07T00:13:14.328 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-12-07T00:13:14.329 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.330 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.331 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2023-12-07T00:13:14.332 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-12-07T00:13:14.333 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2023-12-07T00:13:14.334 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2023-12-07T00:13:14.334 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2023-12-07T00:13:14.334 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2023-12-07T00:13:14.334 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-12-07T00:13:14.334 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-12-07T00:13:14.334 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-12-07T00:13:14.335 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-07T00:13:14.336 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-07T00:13:14.432 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-07T00:13:14.433 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:14.433 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-07T00:13:14.452 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:14.453 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-07T00:13:14.509 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:13:14.509 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:14.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-07T00:13:14.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T00:13:14.586 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:14.587 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:14.643 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T00:13:14.643 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:14.644 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-07T00:13:14.644 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-07T00:13:14.686 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:14.686 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:14.745 INFO:tasks.ceph:Setting up mon nodes... 2023-12-07T00:13:14.745 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-07T00:13:14.745 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-07T00:13:14.798 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-07T00:13:14.801 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-07T00:13:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-07T00:13:15.010 INFO:tasks.ceph:Setting up mds nodes... 2023-12-07T00:13:15.010 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-07T00:13:15.063 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-07T00:13:15.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-07T00:13:15.091 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-07T00:13:15.185 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-07T00:13:15.188 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-07T00:13:15.214 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-07T00:13:15.277 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-07T00:13:15.280 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-07T00:13:15.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-07T00:13:15.403 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-07T00:13:15.406 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-07T00:13:15.432 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-07T00:13:15.433 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-07T00:13:15.475 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-07T00:13:15.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-07T00:13:15.571 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-07T00:13:15.584 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-07T00:13:15.628 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-07T00:13:15.641 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-07T00:13:15.683 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-07T00:13:15.696 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-07T00:13:15.696 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-07T00:13:15.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-07T00:13:15.722 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:15.723 INFO:tasks.ceph:role: osd.0 2023-12-07T00:13:15.723 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:13:15.723 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-07T00:13:15.797 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T00:13:15.797 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T00:13:15.797 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T00:13:15.797 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T00:13:15.797 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T00:13:15.798 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-12-07T00:13:15.798 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T00:13:15.798 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T00:13:15.798 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T00:13:15.798 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T00:13:16.225 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-12-07T00:13:16.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-12-07T00:13:16.228 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-07T00:13:16.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-07T00:13:16.442 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-07T00:13:16.510 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:16.510 INFO:tasks.ceph:role: osd.1 2023-12-07T00:13:16.510 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:13:16.510 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T00:13:16.586 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T00:13:17.005 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-12-07T00:13:17.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-12-07T00:13:17.007 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-07T00:13:17.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-07T00:13:17.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-07T00:13:17.218 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:17.218 INFO:tasks.ceph:role: osd.2 2023-12-07T00:13:17.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:13:17.218 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-07T00:13:17.294 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T00:13:17.294 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T00:13:17.294 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T00:13:17.295 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T00:13:17.295 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T00:13:17.295 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-12-07T00:13:17.295 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T00:13:17.295 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T00:13:17.295 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T00:13:17.295 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T00:13:17.739 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-12-07T00:13:17.741 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-12-07T00:13:17.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-07T00:13:17.916 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-07T00:13:17.951 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-07T00:13:18.019 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:18.020 INFO:tasks.ceph:role: osd.3 2023-12-07T00:13:18.020 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:13:18.020 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-07T00:13:18.095 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T00:13:18.096 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T00:13:18.542 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2023-12-07T00:13:18.542 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2023-12-07T00:13:18.542 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-07T00:13:18.720 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-07T00:13:18.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:18.863 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:18.864+0000 7fc49ceb6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-07T00:13:18.863 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:18.864+0000 7fc49ceb6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-07T00:13:18.863 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:18.864+0000 7fc49ceb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T00:13:18.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:18.864+0000 7fc49ceb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T00:13:18.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:18.864+0000 7fc49ceb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-07T00:13:18.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:18.864+0000 7fc49ceb6640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-07T00:13:21.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-07T00:13:21.769 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:21.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:21.860+0000 7fd8b8ab5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-07T00:13:21.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:21.861+0000 7fd8b8ab5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-07T00:13:21.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:21.861+0000 7fd8b8ab5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T00:13:21.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:21.861+0000 7fd8b8ab5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T00:13:21.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:21.861+0000 7fd8b8ab5640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-07T00:13:21.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:21.861+0000 7fd8b8ab5640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-07T00:13:24.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-07T00:13:24.769 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:24.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:24.860+0000 7fbf3745a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-07T00:13:24.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:24.861+0000 7fbf3745a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-07T00:13:24.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:24.861+0000 7fbf3745a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T00:13:24.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:24.861+0000 7fbf3745a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T00:13:24.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:24.861+0000 7fbf3745a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-07T00:13:24.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:24.861+0000 7fbf3745a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-07T00:13:27.726 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-07T00:13:27.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:27.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:27.849+0000 7f5daebb0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-07T00:13:27.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:27.850+0000 7f5daebb0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-07T00:13:27.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:27.850+0000 7f5daebb0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T00:13:27.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:27.850+0000 7f5daebb0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T00:13:27.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:27.850+0000 7f5daebb0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-07T00:13:27.849 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:27.850+0000 7f5daebb0640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-07T00:13:30.732 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-07T00:13:30.763 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-07T00:13:30.798 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:30.798 INFO:tasks.ceph:role: osd.4 2023-12-07T00:13:30.798 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T00:13:30.798 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-07T00:13:30.877 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T00:13:30.877 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T00:13:30.877 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T00:13:30.877 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T00:13:30.877 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T00:13:30.878 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-12-07T00:13:30.878 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T00:13:30.878 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T00:13:30.878 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T00:13:30.878 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T00:13:31.311 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-12-07T00:13:31.313 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-12-07T00:13:31.313 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-07T00:13:31.494 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-07T00:13:31.532 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-07T00:13:31.602 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:31.602 INFO:tasks.ceph:role: osd.5 2023-12-07T00:13:31.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T00:13:31.602 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-07T00:13:31.677 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T00:13:31.677 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T00:13:31.677 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T00:13:31.678 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T00:13:31.678 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T00:13:31.678 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-12-07T00:13:31.678 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T00:13:31.678 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T00:13:31.678 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T00:13:31.678 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T00:13:32.096 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-12-07T00:13:32.098 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-12-07T00:13:32.098 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-07T00:13:32.210 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-07T00:13:32.244 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-07T00:13:32.312 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:32.312 INFO:tasks.ceph:role: osd.6 2023-12-07T00:13:32.313 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T00:13:32.313 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T00:13:32.388 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T00:13:32.389 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T00:13:32.835 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-12-07T00:13:32.837 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-12-07T00:13:32.837 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-07T00:13:32.985 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-07T00:13:33.020 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-07T00:13:33.090 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-07T00:13:33.090 INFO:tasks.ceph:role: osd.7 2023-12-07T00:13:33.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T00:13:33.090 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-07T00:13:33.165 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-07T00:13:33.165 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-07T00:13:33.165 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-07T00:13:33.165 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-07T00:13:33.166 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-07T00:13:33.166 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-12-07T00:13:33.166 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-07T00:13:33.166 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-07T00:13:33.166 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-07T00:13:33.166 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-07T00:13:33.599 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-12-07T00:13:33.602 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-12-07T00:13:33.602 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-07T00:13:33.788 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-07T00:13:33.823 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:33.933 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:33.933+0000 7fd519f82640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-07T00:13:33.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:33.933+0000 7fd519f82640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-07T00:13:33.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:33.933+0000 7fd519f82640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-07T00:13:33.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:33.933+0000 7fd519f82640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-07T00:13:33.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:33.933+0000 7fd519f82640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-07T00:13:33.934 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:33.934+0000 7fd519f82640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-07T00:13:36.802 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-07T00:13:36.831 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:36.919 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:36.919+0000 7f85d3cb0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-07T00:13:36.920 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:36.919+0000 7f85d3cb0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-07T00:13:36.920 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:36.919+0000 7f85d3cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-07T00:13:36.920 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:36.919+0000 7f85d3cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-07T00:13:36.920 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:36.919+0000 7f85d3cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-07T00:13:36.920 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:36.920+0000 7f85d3cb0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-07T00:13:39.777 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-07T00:13:39.808 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:39.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:39.900+0000 7f6438820640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-07T00:13:39.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:39.900+0000 7f6438820640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-07T00:13:39.902 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:39.900+0000 7f6438820640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-07T00:13:39.902 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:39.900+0000 7f6438820640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-07T00:13:39.902 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:39.900+0000 7f6438820640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-07T00:13:39.902 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:39.900+0000 7f6438820640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-07T00:13:42.302 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:13:42.305 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:13:42.768 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-07T00:13:42.799 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:42.894 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:42.895+0000 7f06c0d0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-07T00:13:42.894 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:42.895+0000 7f06c0d0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-07T00:13:42.894 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:42.895+0000 7f06c0d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-07T00:13:42.894 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:42.895+0000 7f06c0d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-07T00:13:42.894 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:42.895+0000 7f06c0d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-07T00:13:42.895 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:42.895+0000 7f06c0d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-07T00:13:45.757 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-07T00:13:45.788 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-07T00:13:45.789 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:45.789 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-07T00:13:45.820 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:45.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-07T00:13:45.890 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:45.891 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-07T00:13:45.960 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:45.960 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-07T00:13:46.028 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:46.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-07T00:13:46.097 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:46.097 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-07T00:13:46.164 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:46.164 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-07T00:13:46.231 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.231 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-07T00:13:46.262 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.263 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-07T00:13:46.332 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.332 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-07T00:13:46.401 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.401 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-07T00:13:46.471 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.471 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-07T00:13:46.540 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.540 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-07T00:13:46.607 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.607 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-07T00:13:46.675 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:46.675 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-07T00:13:46.693 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:46.693 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-07T00:13:46.750 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.750 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-07T00:13:46.766 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:46.767 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-07T00:13:46.823 INFO:tasks.ceph:Adding keys to all mons... 2023-12-07T00:13:46.824 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-07T00:13:46.826 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-07T00:13:46.867 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2023-12-07T00:13:46.867 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAaDnFlb5e4LxAA8WhAU9WVKoKrw5QAkIK2og== 2023-12-07T00:13:46.867 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2023-12-07T00:13:46.867 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFld5XjAxAAlqLX0uQYwvZBYpYMTo3EHw== 2023-12-07T00:13:46.867 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2023-12-07T00:13:46.867 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFlTjcvCxAAtTRPaO2uvSyimXKlQMUDkg== 2023-12-07T00:13:46.867 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2023-12-07T00:13:46.867 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAeDnFlFOKQMxAAVDLsjaf7U2k1i1q/kPhjeQ== 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAhDnFldWtfMxAAFOwl5PnLLTK54+f6HeU34A== 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAkDnFlNkpfMxAAIhNThQ08aTk4tgO8P41F4g== 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAnDnFlWvq1MhAA/3JzOja4gfgLDwy+nL7ZAg== 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFloxCIABAAc0WOAHsl0kdfalbJVSbfbQ== 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFlFKKpEBAAkl0JSeCy+Z7iLNUte/Vvjw== 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFlb1wtGBAAKubUS6ssVi5kfB8jgXmsIQ== 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAtDnFleu69NxAAamp+tmZPubJThrYgLkfUsw== 2023-12-07T00:13:46.868 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAwDnFl5InnNhAAK8YoIMLt8RBrCwwqpNTaow== 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAzDnFlBTq9NRAA9vh72E53jrag9B3dSqh5bQ== 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQA2DnFlfOZkNRAABid8AKmAAc/EZzAKkxGizA== 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFlnRJ6HBAAOpJ30jTvFKlEPFblPq5rqw== 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout:[client.2] 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFlDlMzIhAAbU5WOXOCAdz/7d0g3Bleqg== 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFlY9WVJRAA870McClSUyFaixZlLOrU1g== 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout:[client.3] 2023-12-07T00:13:46.869 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFl+orcKBAAhLwNbSVBe06hzrBTz8Uibw== 2023-12-07T00:13:46.889 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2023-12-07T00:13:46.889 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAaDnFlb5e4LxAA8WhAU9WVKoKrw5QAkIK2og== 2023-12-07T00:13:46.889 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFld5XjAxAAlqLX0uQYwvZBYpYMTo3EHw== 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFlTjcvCxAAtTRPaO2uvSyimXKlQMUDkg== 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAeDnFlFOKQMxAAVDLsjaf7U2k1i1q/kPhjeQ== 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAhDnFldWtfMxAAFOwl5PnLLTK54+f6HeU34A== 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAkDnFlNkpfMxAAIhNThQ08aTk4tgO8P41F4g== 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAnDnFlWvq1MhAA/3JzOja4gfgLDwy+nL7ZAg== 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2023-12-07T00:13:46.890 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFloxCIABAAc0WOAHsl0kdfalbJVSbfbQ== 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFlFKKpEBAAkl0JSeCy+Z7iLNUte/Vvjw== 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFlb1wtGBAAKubUS6ssVi5kfB8jgXmsIQ== 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAtDnFleu69NxAAamp+tmZPubJThrYgLkfUsw== 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAwDnFl5InnNhAAK8YoIMLt8RBrCwwqpNTaow== 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAzDnFlBTq9NRAA9vh72E53jrag9B3dSqh5bQ== 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQA2DnFlfOZkNRAABid8AKmAAc/EZzAKkxGizA== 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFlnRJ6HBAAOpJ30jTvFKlEPFblPq5rqw== 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout:[client.2] 2023-12-07T00:13:46.891 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFlDlMzIhAAbU5WOXOCAdz/7d0g3Bleqg== 2023-12-07T00:13:46.892 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2023-12-07T00:13:46.892 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFlY9WVJRAA870McClSUyFaixZlLOrU1g== 2023-12-07T00:13:46.892 INFO:teuthology.orchestra.run.smithi190.stdout:[client.3] 2023-12-07T00:13:46.892 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQAbDnFl+orcKBAAhLwNbSVBe06hzrBTz8Uibw== 2023-12-07T00:13:46.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T00:13:46.914 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T00:13:46.987 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T00:13:46.989 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T00:13:47.045 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T00:13:47.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T00:13:47.104 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.106 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.158 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.161 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.213 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.215 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.269 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T00:13:47.326 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-07T00:13:47.379 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T00:13:47.381 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T00:13:47.437 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T00:13:47.439 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-07T00:13:47.495 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.497 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.550 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.552 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.605 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.608 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.661 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.664 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-07T00:13:47.717 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T00:13:47.719 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T00:13:47.776 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T00:13:47.778 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T00:13:47.835 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T00:13:47.837 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T00:13:47.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T00:13:47.896 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-07T00:13:47.952 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-07T00:13:47.952 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-07T00:13:47.978 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-07T00:13:48.077 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-07T00:13:48.103 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-07T00:13:48.130 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-07T00:13:48.228 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-07T00:13:48.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-07T00:13:48.321 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-07T00:13:48.419 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-07T00:13:48.445 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:48.447 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-07T00:13:48.502 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-07T00:13:48.502 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-07T00:13:48.502 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-07T00:13:48.505 INFO:tasks.ceph.mon.a:Started 2023-12-07T00:13:48.505 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-07T00:13:48.505 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-07T00:13:48.544 INFO:tasks.ceph.mon.b:Started 2023-12-07T00:13:48.544 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-07T00:13:48.544 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-07T00:13:48.546 INFO:tasks.ceph.mon.c:Started 2023-12-07T00:13:48.546 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-07T00:13:48.547 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-07T00:13:48.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-07T00:13:48.549 INFO:tasks.ceph.mgr.y:Started 2023-12-07T00:13:48.549 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-07T00:13:48.549 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-07T00:13:48.551 INFO:tasks.ceph.mgr.x:Started 2023-12-07T00:13:48.551 INFO:tasks.ceph:Setting crush tunables to default 2023-12-07T00:13:48.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd crush tunables default 2023-12-07T00:13:48.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.675+0000 7fed174de700 1 Processor -- start 2023-12-07T00:13:48.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.676+0000 7fed174de700 1 -- start start 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.676+0000 7fed174de700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 0x7fed100cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.676+0000 7fed174de700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed100cc590 0x7fed100d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.676+0000 7fed174de700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 0x7fed10099b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.676+0000 7fed174de700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed100cd740 con 0x7fed100cc590 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.676+0000 7fed174de700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1015c150 con 0x7fed1015bd70 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.676+0000 7fed174de700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed100ccac0 con 0x7fed100d0730 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed14a79700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed100cc590 0x7fed100d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed14a79700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fed100cc590 0x7fed100d01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38138/0 (socket says 172.21.15.179:38138) 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed14a79700 1 -- 172.21.15.179:0/1711698768 learned_addr learned my addr 172.21.15.179:0/1711698768 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed1527a700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 0x7fed100cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed14a79700 1 -- 172.21.15.179:0/1711698768 >> v2:172.21.15.179:3300/0 conn(0x7fed100cc590 msgr2=0x7fed100d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-07T00:13:48.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed14a79700 1 -- 172.21.15.179:0/1711698768 >> v2:172.21.15.179:3300/0 conn(0x7fed100cc590 msgr2=0x7fed100d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed14a79700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.179:3300/0 conn(0x7fed100cc590 0x7fed100d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed15a7b700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 0x7fed10099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed14a79700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.179:3300/0 conn(0x7fed100cc590 0x7fed100d01f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed1527a700 1 -- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 msgr2=0x7fed100cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed1527a700 1 -- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 msgr2=0x7fed100cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed1527a700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 0x7fed100cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed1527a700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 0x7fed100cdb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed15a7b700 1 -- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 msgr2=0x7fed10099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed15a7b700 1 -- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 msgr2=0x7fed10099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed15a7b700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 0x7fed10099b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-07T00:13:48.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.677+0000 7fed15a7b700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 0x7fed10099b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-07T00:13:48.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed14a79700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.179:3300/0 conn(0x7fed100cc590 0x7fed100d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed1527a700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 0x7fed100cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed15a7b700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 0x7fed10099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed14a79700 1 -- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 msgr2=0x7fed10099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed14a79700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 0x7fed10099b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed14a79700 1 -- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 msgr2=0x7fed100cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed14a79700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 0x7fed100cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed14a79700 1 -- 172.21.15.179:0/1711698768 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed100ccda0 con 0x7fed100cc590 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed15a7b700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 0x7fed10099b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed14a79700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 0x7fed100d01f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fed10072a00 tx=0x7fed0c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2535fdf6e2913638 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed07fff700 1 -- 172.21.15.179:0/1711698768 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c00c070 con 0x7fed100cc590 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed07fff700 1 -- 172.21.15.179:0/1711698768 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0c013610 con 0x7fed100cc590 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.878+0000 7fed07fff700 1 -- 172.21.15.179:0/1711698768 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0139a0 con 0x7fed100cc590 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 -- 172.21.15.179:0/1711698768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 msgr2=0x7fed100d01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:48.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 0x7fed100d01f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fed10072a00 tx=0x7fed0c009c20 comp rx=0 tx=0).stop 2023-12-07T00:13:48.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 -- 172.21.15.179:0/1711698768 shutdown_connections 2023-12-07T00:13:48.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed100d0730 0x7fed10099b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 --2- 172.21.15.179:0/1711698768 >> v2:172.21.15.190:3300/0 conn(0x7fed1015bd70 0x7fed100cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 --2- 172.21.15.179:0/1711698768 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 0x7fed100d01f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 -- 172.21.15.179:0/1711698768 >> 172.21.15.179:0/1711698768 conn(0x7fed100b34e0 msgr2=0x7fed100b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:48.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 -- 172.21.15.179:0/1711698768 shutdown_connections 2023-12-07T00:13:48.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.879+0000 7fed174de700 1 -- 172.21.15.179:0/1711698768 wait complete. 2023-12-07T00:13:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.880+0000 7fed174de700 1 Processor -- start 2023-12-07T00:13:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.880+0000 7fed174de700 1 -- start start 2023-12-07T00:13:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed174de700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 0x7fed1015e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed174de700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed100d0730 0x7fed100b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed174de700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1015bd70 0x7fed100b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed174de700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1009b790 con 0x7fed100cc590 2023-12-07T00:13:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed174de700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1009ba00 con 0x7fed100d0730 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed174de700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed1009bce0 con 0x7fed1015bd70 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed15a7b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1015bd70 0x7fed100b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed1527a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 0x7fed1015e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed14a79700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed100d0730 0x7fed100b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed15a7b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1015bd70 0x7fed100b7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:38582/0 (socket says 172.21.15.179:38582) 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed15a7b700 1 -- 172.21.15.179:0/667592221 learned_addr learned my addr 172.21.15.179:0/667592221 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed1527a700 1 -- 172.21.15.179:0/667592221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1015bd70 msgr2=0x7fed100b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.881+0000 7fed1527a700 1 --2- 172.21.15.179:0/667592221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1015bd70 0x7fed100b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.882+0000 7fed1527a700 1 -- 172.21.15.179:0/667592221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed100d0730 msgr2=0x7fed100b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.882+0000 7fed1527a700 1 --2- 172.21.15.179:0/667592221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed100d0730 0x7fed100b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.882+0000 7fed1527a700 1 -- 172.21.15.179:0/667592221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0095a0 con 0x7fed100cc590 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.882+0000 7fed1527a700 1 --2- 172.21.15.179:0/667592221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 0x7fed1015e510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed000096d0 tx=0x7fed000099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.883+0000 7fed05ffb700 1 -- 172.21.15.179:0/667592221 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed000146d0 con 0x7fed100cc590 2023-12-07T00:13:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.883+0000 7fed05ffb700 1 -- 172.21.15.179:0/667592221 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed00014830 con 0x7fed100cc590 2023-12-07T00:13:48.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.883+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1009bfc0 con 0x7fed100cc590 2023-12-07T00:13:48.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.883+0000 7fed05ffb700 1 -- 172.21.15.179:0/667592221 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed00014ba0 con 0x7fed100cc590 2023-12-07T00:13:48.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.883+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed100b7850 con 0x7fed100cc590 2023-12-07T00:13:48.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.883+0000 7fed05ffb700 1 -- 172.21.15.179:0/667592221 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fed00014d00 con 0x7fed100cc590 2023-12-07T00:13:48.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.883+0000 7fed05ffb700 1 -- 172.21.15.179:0/667592221 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fed0001c3b0 con 0x7fed100cc590 2023-12-07T00:13:48.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.884+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed100685f0 con 0x7fed100cc590 2023-12-07T00:13:48.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.886+0000 7fed05ffb700 1 -- 172.21.15.179:0/667592221 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fed0003cce0 con 0x7fed100cc590 2023-12-07T00:13:48.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.975+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fed100b43d0 con 0x7fed100cc590 2023-12-07T00:13:48.976 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.977+0000 7fed05ffb700 1 -- 172.21.15.179:0/667592221 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fed0002b070 con 0x7fed100cc590 2023-12-07T00:13:48.977 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 msgr2=0x7fed1015e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 --2- 172.21.15.179:0/667592221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 0x7fed1015e510 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed000096d0 tx=0x7fed000099e0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 shutdown_connections 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 --2- 172.21.15.179:0/667592221 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed1015bd70 0x7fed100b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 --2- 172.21.15.179:0/667592221 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed100cc590 0x7fed1015e510 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 --2- 172.21.15.179:0/667592221 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed100d0730 0x7fed100b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 >> 172.21.15.179:0/667592221 conn(0x7fed100b34e0 msgr2=0x7fed100b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 shutdown_connections 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:48.978+0000 7fed174de700 1 -- 172.21.15.179:0/667592221 wait complete. 2023-12-07T00:13:48.978 INFO:teuthology.orchestra.run.smithi179.stderr:adjusted tunables profile to default 2023-12-07T00:13:48.990 INFO:tasks.ceph:check_enable_crimson: False 2023-12-07T00:13:48.990 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-07T00:13:48.990 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:48.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-07T00:13:48.991 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:48.991+0000 7f087d362200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-07T00:13:49.002 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:49.003+0000 7f8a70862200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-07T00:13:49.016 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:49.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-07T00:13:49.055 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:49.056+0000 7f087d362200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-07T00:13:49.071 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:49.072+0000 7f8a70862200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-07T00:13:49.083 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:49.084 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-07T00:13:49.131 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:49.132+0000 7f087d362200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-07T00:13:49.150 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:13:49.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-07T00:13:49.151 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:49.153+0000 7f8a70862200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-07T00:13:49.177 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:49.177 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-07T00:13:49.203 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:49.203 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-07T00:13:49.211 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:49.212+0000 7f087d362200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-07T00:13:49.235 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:49.236+0000 7f8a70862200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-07T00:13:49.239 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:49.239 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-07T00:13:49.305 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:13:49.305 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-07T00:13:49.363 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:49.364+0000 7f087d362200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-07T00:13:49.371 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 2834c04f-b470-4390-86dc-fdef4bc770b9 0 2023-12-07T00:13:49.377 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:49.378+0000 7f8a70862200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-07T00:13:49.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.533+0000 7f153fac3700 1 Processor -- start 2023-12-07T00:13:49.532 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.533+0000 7f153fac3700 1 -- start start 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153fac3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f1538099b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153fac3700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f153809a0d0 0x7f153815d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153fac3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15380d03d0 con 0x7f1538162100 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153fac3700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f153809a560 con 0x7f153809a0d0 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153fac3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1538162940 con 0x7f15381624e0 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153d05e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f1538099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153d05e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f1538099b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34596/0 (socket says 172.21.15.190:34596) 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153d85f700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f1538162100 0x7f15380cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53104/0 (socket says 172.21.15.190:53104) 2023-12-07T00:13:49.535 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153d05e700 1 -- 172.21.15.190:0/2826110675 learned_addr learned my addr 172.21.15.190:0/2826110675 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153e060700 1 --2- 172.21.15.190:0/2826110675 >> v2:172.21.15.179:3300/0 conn(0x7f153809a0d0 0x7f153815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153d05e700 1 -- 172.21.15.190:0/2826110675 >> v2:172.21.15.179:3300/0 conn(0x7f153809a0d0 msgr2=0x7f153815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153d05e700 1 --2- 172.21.15.190:0/2826110675 >> v2:172.21.15.179:3300/0 conn(0x7f153809a0d0 0x7f153815d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153d05e700 1 -- 172.21.15.190:0/2826110675 >> v1:172.21.15.190:6789/0 conn(0x7f1538162100 legacy=0x7f15380cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153d05e700 1 -- 172.21.15.190:0/2826110675 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15380d06a0 con 0x7f15381624e0 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.534+0000 7f153c85d700 1 -- 172.21.15.190:0/2826110675 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223537549 0 0) 0x7f15380d03d0 con 0x7f1538162100 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153d05e700 1 --2- 172.21.15.190:0/2826110675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f1538099b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15280098f0 tx=0x7f1528009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955aaf6c93fd9f9b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153c85d700 1 -- 172.21.15.190:0/2826110675 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528011830 con 0x7f15381624e0 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153c85d700 1 -- 172.21.15.190:0/2826110675 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528011990 con 0x7f15381624e0 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153c85d700 1 -- 172.21.15.190:0/2826110675 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528011d20 con 0x7f15381624e0 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153fac3700 1 -- 172.21.15.190:0/2826110675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 msgr2=0x7f1538099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.536 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153fac3700 1 --2- 172.21.15.190:0/2826110675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f1538099b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15280098f0 tx=0x7f1528009c00 comp rx=0 tx=0).stop 2023-12-07T00:13:49.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153fac3700 1 -- 172.21.15.190:0/2826110675 shutdown_connections 2023-12-07T00:13:49.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153fac3700 1 --2- 172.21.15.190:0/2826110675 >> v2:172.21.15.179:3300/0 conn(0x7f153809a0d0 0x7f153815d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153fac3700 1 --2- 172.21.15.190:0/2826110675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f1538099b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153fac3700 1 -- 172.21.15.190:0/2826110675 >> 172.21.15.190:0/2826110675 conn(0x7f15380b34e0 msgr2=0x7f15380b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:49.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153fac3700 1 -- 172.21.15.190:0/2826110675 shutdown_connections 2023-12-07T00:13:49.537 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.535+0000 7f153fac3700 1 -- 172.21.15.190:0/2826110675 wait complete. 2023-12-07T00:13:49.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153fac3700 1 Processor -- start 2023-12-07T00:13:49.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153fac3700 1 -- start start 2023-12-07T00:13:49.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153fac3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f153809a0d0 0x7f15380cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153fac3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1538162100 0x7f15380b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153fac3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f15380b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153fac3700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15380affb0 con 0x7f153809a0d0 2023-12-07T00:13:49.540 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153fac3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15381e8320 con 0x7f1538162100 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153fac3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15380b6de0 con 0x7f15381624e0 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153e060700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f15380b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153d05e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1538162100 0x7f15380b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153e060700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f15380b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34604/0 (socket says 172.21.15.190:34604) 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153d05e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1538162100 0x7f15380b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58412/0 (socket says 172.21.15.190:58412) 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.537+0000 7f153e060700 1 -- 172.21.15.190:0/3502518336 learned_addr learned my addr 172.21.15.190:0/3502518336 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153d85f700 1 --2- 172.21.15.190:0/3502518336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f153809a0d0 0x7f15380cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153e060700 1 -- 172.21.15.190:0/3502518336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1538162100 msgr2=0x7f15380b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153e060700 1 --2- 172.21.15.190:0/3502518336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1538162100 0x7f15380b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153e060700 1 -- 172.21.15.190:0/3502518336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f153809a0d0 msgr2=0x7f15380cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153e060700 1 --2- 172.21.15.190:0/3502518336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f153809a0d0 0x7f15380cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153e060700 1 -- 172.21.15.190:0/3502518336 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1528009550 con 0x7f15381624e0 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153e060700 1 --2- 172.21.15.190:0/3502518336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f15380b68a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f153000efc0 tx=0x7f153000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:49.541 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f152e7fc700 1 -- 172.21.15.190:0/3502518336 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530009ea0 con 0x7f15381624e0 2023-12-07T00:13:49.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f152e7fc700 1 -- 172.21.15.190:0/3502518336 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153000f040 con 0x7f15381624e0 2023-12-07T00:13:49.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15380cb920 con 0x7f15381624e0 2023-12-07T00:13:49.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f152e7fc700 1 -- 172.21.15.190:0/3502518336 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153000ced0 con 0x7f15381624e0 2023-12-07T00:13:49.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15381e7cd0 con 0x7f15381624e0 2023-12-07T00:13:49.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f152e7fc700 1 -- 172.21.15.190:0/3502518336 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1530014780 con 0x7f15381624e0 2023-12-07T00:13:49.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.538+0000 7f152e7fc700 1 -- 172.21.15.190:0/3502518336 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f153001d9e0 con 0x7f15381624e0 2023-12-07T00:13:49.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.539+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15381e84d0 con 0x7f15381624e0 2023-12-07T00:13:49.542 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.541+0000 7f152e7fc700 1 -- 172.21.15.190:0/3502518336 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f153003bce0 con 0x7f15381624e0 2023-12-07T00:13:49.637 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.638+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2834c04f-b470-4390-86dc-fdef4bc770b9", "id": 0} v 0) v1 -- 0x7f15380685f0 con 0x7f15381624e0 2023-12-07T00:13:49.640 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.641+0000 7f152e7fc700 1 -- 172.21.15.190:0/3502518336 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2834c04f-b470-4390-86dc-fdef4bc770b9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f153002a070 con 0x7f15381624e0 2023-12-07T00:13:49.640 INFO:teuthology.orchestra.run.smithi190.stdout:0 2023-12-07T00:13:49.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 msgr2=0x7f15380b68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.641 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 --2- 172.21.15.190:0/3502518336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f15380b68a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f153000efc0 tx=0x7f153000c3a0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.642 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 shutdown_connections 2023-12-07T00:13:49.642 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 --2- 172.21.15.190:0/3502518336 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15381624e0 0x7f15380b68a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.642 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 --2- 172.21.15.190:0/3502518336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f153809a0d0 0x7f15380cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.642 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 --2- 172.21.15.190:0/3502518336 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1538162100 0x7f15380b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.642 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 >> 172.21.15.190:0/3502518336 conn(0x7f15380b34e0 msgr2=0x7f1538073c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:49.642 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 shutdown_connections 2023-12-07T00:13:49.642 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.642+0000 7f153fac3700 1 -- 172.21.15.190:0/3502518336 wait complete. 2023-12-07T00:13:49.653 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new e8840552-e7fa-4771-993b-0cba6b6043ee 1 2023-12-07T00:13:49.774 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.775+0000 7fb42e50d700 1 Processor -- start 2023-12-07T00:13:49.774 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.775+0000 7fb42e50d700 1 -- start start 2023-12-07T00:13:49.781 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.775+0000 7fb42e50d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb42806b680 0x7fb4280cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.782 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.775+0000 7fb42e50d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161c70 0x7fb4281620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.782 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.775+0000 7fb42e50d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4280cb0f0 con 0x7fb428161360 2023-12-07T00:13:49.782 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.775+0000 7fb42e50d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb428161740 con 0x7fb42806b680 2023-12-07T00:13:49.782 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.775+0000 7fb42e50d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280cb340 con 0x7fb428161c70 2023-12-07T00:13:49.783 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb42caaa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161c70 0x7fb4281620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.783 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb427fff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb428161360 0x7fb42806af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53116/0 (socket says 172.21.15.190:53116) 2023-12-07T00:13:49.784 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb427fff700 1 -- 172.21.15.190:0/80902476 learned_addr learned my addr 172.21.15.190:0/80902476 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-12-07T00:13:49.784 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb4277fe700 1 --2- 172.21.15.190:0/80902476 >> v2:172.21.15.179:3300/0 conn(0x7fb42806b680 0x7fb4280cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.784 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb426ffd700 1 -- 172.21.15.190:0/80902476 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018685250 0 0) 0x7fb4280cb0f0 con 0x7fb428161360 2023-12-07T00:13:49.785 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb426ffd700 1 -- 172.21.15.190:0/80902476 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4100035b0 con 0x7fb428161360 2023-12-07T00:13:49.785 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb42caaa700 1 -- 172.21.15.190:0/80902476 >> v2:172.21.15.179:3300/0 conn(0x7fb42806b680 msgr2=0x7fb4280cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:49.785 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb42caaa700 1 --2- 172.21.15.190:0/80902476 >> v2:172.21.15.179:3300/0 conn(0x7fb42806b680 0x7fb4280cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.785 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb42caaa700 1 -- 172.21.15.190:0/80902476 >> v1:172.21.15.190:6789/0 conn(0x7fb428161360 legacy=0x7fb42806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.786 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb42caaa700 1 -- 172.21.15.190:0/80902476 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280cb620 con 0x7fb428161c70 2023-12-07T00:13:49.786 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb42caaa700 1 --2- 172.21.15.190:0/80902476 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161c70 0x7fb4281620e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb420009d90 tx=0x7fb42000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914ee6a7e0d90528 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:49.786 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb426ffd700 1 -- 172.21.15.190:0/80902476 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42000e070 con 0x7fb428161c70 2023-12-07T00:13:49.786 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb426ffd700 1 -- 172.21.15.190:0/80902476 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42000bb20 con 0x7fb428161c70 2023-12-07T00:13:49.786 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.776+0000 7fb426ffd700 1 -- 172.21.15.190:0/80902476 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420012430 con 0x7fb428161c70 2023-12-07T00:13:49.786 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.777+0000 7fb42e50d700 1 -- 172.21.15.190:0/80902476 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161c70 msgr2=0x7fb4281620e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.786 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.777+0000 7fb42e50d700 1 --2- 172.21.15.190:0/80902476 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161c70 0x7fb4281620e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb420009d90 tx=0x7fb42000b330 comp rx=0 tx=0).stop 2023-12-07T00:13:49.787 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.777+0000 7fb42e50d700 1 -- 172.21.15.190:0/80902476 shutdown_connections 2023-12-07T00:13:49.787 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.777+0000 7fb42e50d700 1 --2- 172.21.15.190:0/80902476 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161c70 0x7fb4281620e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.787 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.777+0000 7fb42e50d700 1 --2- 172.21.15.190:0/80902476 >> v2:172.21.15.179:3300/0 conn(0x7fb42806b680 0x7fb4280cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.787 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.777+0000 7fb42e50d700 1 -- 172.21.15.190:0/80902476 >> 172.21.15.190:0/80902476 conn(0x7fb428099a40 msgr2=0x7fb428099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:49.787 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.777+0000 7fb42e50d700 1 -- 172.21.15.190:0/80902476 shutdown_connections 2023-12-07T00:13:49.787 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.777+0000 7fb42e50d700 1 -- 172.21.15.190:0/80902476 wait complete. 2023-12-07T00:13:49.787 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.778+0000 7fb42e50d700 1 Processor -- start 2023-12-07T00:13:49.788 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.778+0000 7fb42e50d700 1 -- start start 2023-12-07T00:13:49.788 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb42e50d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42806b680 0x7fb4281487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.788 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb42e50d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161360 0x7fb4280b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.788 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb42e50d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb428161c70 0x7fb4281f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:49.788 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb42e50d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280b3e30 con 0x7fb428161c70 2023-12-07T00:13:49.788 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb42e50d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280b5830 con 0x7fb42806b680 2023-12-07T00:13:49.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb42e50d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4280b5b10 con 0x7fb428161360 2023-12-07T00:13:49.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb4277fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161360 0x7fb4280b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb427fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42806b680 0x7fb4281487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb4277fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161360 0x7fb4280b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34614/0 (socket says 172.21.15.190:34614) 2023-12-07T00:13:49.789 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb4277fe700 1 -- 172.21.15.190:0/1529760490 learned_addr learned my addr 172.21.15.190:0/1529760490 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:49.790 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb42caaa700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb428161c70 0x7fb4281f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:49.790 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb4277fe700 1 -- 172.21.15.190:0/1529760490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42806b680 msgr2=0x7fb4281487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.790 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb4277fe700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42806b680 0x7fb4281487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.790 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb4277fe700 1 -- 172.21.15.190:0/1529760490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb428161c70 msgr2=0x7fb4281f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.791 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb4277fe700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb428161c70 0x7fb4281f2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.791 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb4277fe700 1 -- 172.21.15.190:0/1529760490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420009a70 con 0x7fb428161360 2023-12-07T00:13:49.791 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.779+0000 7fb427fff700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42806b680 0x7fb4281487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:13:49.791 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.780+0000 7fb4277fe700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161360 0x7fb4280b38f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00e870 tx=0x7fb41c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:49.791 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.780+0000 7fb424ff9700 1 -- 172.21.15.190:0/1529760490 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c009590 con 0x7fb428161360 2023-12-07T00:13:49.792 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.780+0000 7fb424ff9700 1 -- 172.21.15.190:0/1529760490 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c013680 con 0x7fb428161360 2023-12-07T00:13:49.792 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.780+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4280b5df0 con 0x7fb428161360 2023-12-07T00:13:49.792 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.780+0000 7fb424ff9700 1 -- 172.21.15.190:0/1529760490 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0139f0 con 0x7fb428161360 2023-12-07T00:13:49.792 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.780+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4280b5450 con 0x7fb428161360 2023-12-07T00:13:49.792 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.780+0000 7fb424ff9700 1 -- 172.21.15.190:0/1529760490 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb41c005a20 con 0x7fb428161360 2023-12-07T00:13:49.792 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.780+0000 7fb424ff9700 1 -- 172.21.15.190:0/1529760490 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb41c01c800 con 0x7fb428161360 2023-12-07T00:13:49.792 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.781+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4280b6440 con 0x7fb428161360 2023-12-07T00:13:49.793 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:49.782+0000 7f8a70862200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-07T00:13:49.793 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.785+0000 7fb424ff9700 1 -- 172.21.15.190:0/1529760490 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb41c021060 con 0x7fb428161360 2023-12-07T00:13:49.806 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:49.807+0000 7f087d362200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-07T00:13:49.868 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.869+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e8840552-e7fa-4771-993b-0cba6b6043ee", "id": 1} v 0) v1 -- 0x7fb4280d0880 con 0x7fb428161360 2023-12-07T00:13:49.878 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.879+0000 7fb424ff9700 1 -- 172.21.15.190:0/1529760490 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8840552-e7fa-4771-993b-0cba6b6043ee", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb41c017070 con 0x7fb428161360 2023-12-07T00:13:49.878 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-12-07T00:13:49.879 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161360 msgr2=0x7fb4280b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:49.879 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161360 0x7fb4280b38f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00e870 tx=0x7fb41c00eb80 comp rx=0 tx=0).stop 2023-12-07T00:13:49.879 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 shutdown_connections 2023-12-07T00:13:49.880 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb428161c70 0x7fb4281f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.880 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb42806b680 0x7fb4281487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.880 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 --2- 172.21.15.190:0/1529760490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb428161360 0x7fb4280b38f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:49.880 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 >> 172.21.15.190:0/1529760490 conn(0x7fb428099a40 msgr2=0x7fb4280ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:49.880 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 shutdown_connections 2023-12-07T00:13:49.880 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:49.880+0000 7fb42e50d700 1 -- 172.21.15.190:0/1529760490 wait complete. 2023-12-07T00:13:49.892 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new ca62303e-4e16-4119-a725-41a38a5402a7 2 2023-12-07T00:13:49.899 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:49.900+0000 7f8a70862200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-07T00:13:49.928 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:49.929+0000 7f087d362200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-07T00:13:49.992 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:49.993+0000 7f8a70862200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-07T00:13:50.013 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.014+0000 7f4a74665700 1 Processor -- start 2023-12-07T00:13:50.013 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.014+0000 7f4a74665700 1 -- start start 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a74665700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a6c15bba0 0x7f4a6c15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a74665700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c0ccee0 0x7f4a6c15fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a74665700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4a6c1602f0 0x7f4a6c0cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a74665700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c0b03e0 con 0x7f4a6c15bba0 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a74665700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a6c15f640 con 0x7f4a6c1602f0 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a74665700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c15c8c0 con 0x7f4a6c0ccee0 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c0ccee0 0x7f4a6c15fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c0ccee0 0x7f4a6c15fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34620/0 (socket says 172.21.15.190:34620) 2023-12-07T00:13:50.019 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 -- 172.21.15.190:0/1433474184 learned_addr learned my addr 172.21.15.190:0/1433474184 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a72c02700 1 --2- 172.21.15.190:0/1433474184 >> v2:172.21.15.190:3300/0 conn(0x7f4a6c1602f0 0x7f4a6c0cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a72401700 1 --2- 172.21.15.190:0/1433474184 >> v2:172.21.15.179:3300/0 conn(0x7f4a6c15bba0 0x7f4a6c15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 -- 172.21.15.190:0/1433474184 >> v2:172.21.15.190:3300/0 conn(0x7f4a6c1602f0 msgr2=0x7f4a6c0cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 --2- 172.21.15.190:0/1433474184 >> v2:172.21.15.190:3300/0 conn(0x7f4a6c1602f0 0x7f4a6c0cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 -- 172.21.15.190:0/1433474184 >> v2:172.21.15.179:3300/0 conn(0x7f4a6c15bba0 msgr2=0x7f4a6c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 --2- 172.21.15.190:0/1433474184 >> v2:172.21.15.179:3300/0 conn(0x7f4a6c15bba0 0x7f4a6c15bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 -- 172.21.15.190:0/1433474184 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c15cba0 con 0x7f4a6c0ccee0 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a72401700 1 --2- 172.21.15.190:0/1433474184 >> v2:172.21.15.179:3300/0 conn(0x7f4a6c15bba0 0x7f4a6c15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a71c00700 1 --2- 172.21.15.190:0/1433474184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c0ccee0 0x7f4a6c15fdb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c072610 tx=0x7f4a68009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40391e0f4ae5a5cf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.016+0000 7f4a713ff700 1 -- 172.21.15.190:0/1433474184 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800b870 con 0x7f4a6c0ccee0 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a713ff700 1 -- 172.21.15.190:0/1433474184 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6800b9d0 con 0x7f4a6c0ccee0 2023-12-07T00:13:50.020 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a713ff700 1 -- 172.21.15.190:0/1433474184 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6800bd60 con 0x7f4a6c0ccee0 2023-12-07T00:13:50.021 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f087d362200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-07T00:13:50.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 -- 172.21.15.190:0/1433474184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c0ccee0 msgr2=0x7f4a6c15fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.023 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 --2- 172.21.15.190:0/1433474184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c0ccee0 0x7f4a6c15fdb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c072610 tx=0x7f4a68009bd0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 -- 172.21.15.190:0/1433474184 shutdown_connections 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 --2- 172.21.15.190:0/1433474184 >> v2:172.21.15.190:3300/0 conn(0x7f4a6c1602f0 0x7f4a6c0cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 --2- 172.21.15.190:0/1433474184 >> v2:172.21.15.179:3300/0 conn(0x7f4a6c15bba0 0x7f4a6c15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 --2- 172.21.15.190:0/1433474184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c0ccee0 0x7f4a6c15fdb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 -- 172.21.15.190:0/1433474184 >> 172.21.15.190:0/1433474184 conn(0x7f4a6c099a40 msgr2=0x7f4a6c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 -- 172.21.15.190:0/1433474184 shutdown_connections 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.017+0000 7f4a74665700 1 -- 172.21.15.190:0/1433474184 wait complete. 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.019+0000 7f4a74665700 1 Processor -- start 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.019+0000 7f4a74665700 1 -- start start 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a74665700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a6c0ccee0 0x7f4a6c0c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a74665700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c15bba0 0x7f4a6c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a74665700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6c1556f0 0x7f4a6c155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a74665700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c1560b0 con 0x7f4a6c1556f0 2023-12-07T00:13:50.024 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a74665700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0ae110 con 0x7f4a6c0ccee0 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a74665700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6c0c51a0 con 0x7f4a6c15bba0 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c15bba0 0x7f4a6c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c15bba0 0x7f4a6c150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34626/0 (socket says 172.21.15.190:34626) 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a72401700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a6c0ccee0 0x7f4a6c0c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 -- 172.21.15.190:0/174177760 learned_addr learned my addr 172.21.15.190:0/174177760 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a72c02700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6c1556f0 0x7f4a6c155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 -- 172.21.15.190:0/174177760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a6c0ccee0 msgr2=0x7f4a6c0c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a6c0ccee0 0x7f4a6c0c4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 -- 172.21.15.190:0/174177760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6c1556f0 msgr2=0x7f4a6c155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6c1556f0 0x7f4a6c155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 -- 172.21.15.190:0/174177760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68009550 con 0x7f4a6c15bba0 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a72401700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a6c0ccee0 0x7f4a6c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.020+0000 7f4a71c00700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c15bba0 0x7f4a6c150d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000c00 tx=0x7f4a68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:50.025 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.021+0000 7f4a62ffd700 1 -- 172.21.15.190:0/174177760 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68004540 con 0x7f4a6c15bba0 2023-12-07T00:13:50.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.021+0000 7f4a62ffd700 1 -- 172.21.15.190:0/174177760 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a680036a0 con 0x7f4a6c15bba0 2023-12-07T00:13:50.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.021+0000 7f4a62ffd700 1 -- 172.21.15.190:0/174177760 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68003a50 con 0x7f4a6c15bba0 2023-12-07T00:13:50.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.021+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6c1512c0 con 0x7f4a6c15bba0 2023-12-07T00:13:50.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.021+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6c0ae360 con 0x7f4a6c15bba0 2023-12-07T00:13:50.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.021+0000 7f4a62ffd700 1 -- 172.21.15.190:0/174177760 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4a68021070 con 0x7f4a6c15bba0 2023-12-07T00:13:50.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.021+0000 7f4a62ffd700 1 -- 172.21.15.190:0/174177760 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4a68024bf0 con 0x7f4a6c15bba0 2023-12-07T00:13:50.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.022+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6c0685f0 con 0x7f4a6c15bba0 2023-12-07T00:13:50.026 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.024+0000 7f4a62ffd700 1 -- 172.21.15.190:0/174177760 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4a68029020 con 0x7f4a6c15bba0 2023-12-07T00:13:50.073 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:50.074+0000 7f8a70862200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-07T00:13:50.099 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:50.101+0000 7f087d362200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-07T00:13:50.108 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.109+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ca62303e-4e16-4119-a725-41a38a5402a7", "id": 2} v 0) v1 -- 0x7f4a6c0b6a20 con 0x7f4a6c15bba0 2023-12-07T00:13:50.114 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.115+0000 7f4a62ffd700 1 -- 172.21.15.190:0/174177760 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca62303e-4e16-4119-a725-41a38a5402a7", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4a68015020 con 0x7f4a6c15bba0 2023-12-07T00:13:50.114 INFO:teuthology.orchestra.run.smithi190.stdout:2 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c15bba0 msgr2=0x7f4a6c150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c15bba0 0x7f4a6c150d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a68000c00 tx=0x7f4a68004750 comp rx=0 tx=0).stop 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 shutdown_connections 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a6c1556f0 0x7f4a6c155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a6c0ccee0 0x7f4a6c0c4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 --2- 172.21.15.190:0/174177760 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a6c15bba0 0x7f4a6c150d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 >> 172.21.15.190:0/174177760 conn(0x7f4a6c099a40 msgr2=0x7f4a6c0b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 shutdown_connections 2023-12-07T00:13:50.115 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.116+0000 7f4a74665700 1 -- 172.21.15.190:0/174177760 wait complete. 2023-12-07T00:13:50.127 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 1cad41e6-04eb-4be7-b099-363dbb6c835a 3 2023-12-07T00:13:50.289 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.290+0000 7f85e3296700 1 Processor -- start 2023-12-07T00:13:50.289 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.290+0000 7f85e3296700 1 -- start start 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e3296700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e3296700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f85dc0cc590 0x7f85dc0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e3296700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f85dc0d0730 0x7f85dc099b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e3296700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc0cd740 con 0x7f85dc0cc590 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e3296700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc15c150 con 0x7f85dc0d0730 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e3296700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0ccac0 con 0x7f85dc15bd70 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1833700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f85dc0d0730 0x7f85dc099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34630/0 (socket says 172.21.15.190:34630) 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1833700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f85dc0d0730 0x7f85dc099b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58444/0 (socket says 172.21.15.190:58444) 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 -- 172.21.15.190:0/261774314 learned_addr learned my addr 172.21.15.190:0/261774314 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e0831700 1 --2- 172.21.15.190:0/261774314 >> v2:172.21.15.179:3300/0 conn(0x7f85dc0cc590 0x7f85dc0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 -- 172.21.15.190:0/261774314 >> v2:172.21.15.190:3300/0 conn(0x7f85dc0d0730 msgr2=0x7f85dc099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:50.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 --2- 172.21.15.190:0/261774314 >> v2:172.21.15.190:3300/0 conn(0x7f85dc0d0730 0x7f85dc099b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 -- 172.21.15.190:0/261774314 >> v2:172.21.15.179:3300/0 conn(0x7f85dc0cc590 msgr2=0x7f85dc0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 --2- 172.21.15.190:0/261774314 >> v2:172.21.15.179:3300/0 conn(0x7f85dc0cc590 0x7f85dc0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 -- 172.21.15.190:0/261774314 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0ccda0 con 0x7f85dc15bd70 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e0831700 1 --2- 172.21.15.190:0/261774314 >> v2:172.21.15.179:3300/0 conn(0x7f85dc0cc590 0x7f85dc0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.292+0000 7f85e1032700 1 --2- 172.21.15.190:0/261774314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0cdb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f85dc073080 tx=0x7f85d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5fc6d7e270c19d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85d3fff700 1 -- 172.21.15.190:0/261774314 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8011830 con 0x7f85dc15bd70 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85d3fff700 1 -- 172.21.15.190:0/261774314 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d8011990 con 0x7f85dc15bd70 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85d3fff700 1 -- 172.21.15.190:0/261774314 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d8011d20 con 0x7f85dc15bd70 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85e3296700 1 -- 172.21.15.190:0/261774314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 msgr2=0x7f85dc0cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85e3296700 1 --2- 172.21.15.190:0/261774314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0cdb60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f85dc073080 tx=0x7f85d8009c00 comp rx=0 tx=0).stop 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85e3296700 1 -- 172.21.15.190:0/261774314 shutdown_connections 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85e3296700 1 --2- 172.21.15.190:0/261774314 >> v2:172.21.15.190:3300/0 conn(0x7f85dc0d0730 0x7f85dc099b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85e3296700 1 --2- 172.21.15.190:0/261774314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0cdb60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.295 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.293+0000 7f85e3296700 1 --2- 172.21.15.190:0/261774314 >> v2:172.21.15.179:3300/0 conn(0x7f85dc0cc590 0x7f85dc0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.295 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.294+0000 7f85e3296700 1 -- 172.21.15.190:0/261774314 >> 172.21.15.190:0/261774314 conn(0x7f85dc0b34e0 msgr2=0x7f85dc0b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:50.295 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.294+0000 7f85e3296700 1 -- 172.21.15.190:0/261774314 shutdown_connections 2023-12-07T00:13:50.295 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.294+0000 7f85e3296700 1 -- 172.21.15.190:0/261774314 wait complete. 2023-12-07T00:13:50.297 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.295+0000 7f85e3296700 1 Processor -- start 2023-12-07T00:13:50.297 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.296+0000 7f85e3296700 1 -- start start 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e3296700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85dc0cc590 0x7f85dc150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e3296700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85dc0d0730 0x7f85dc150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e3296700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e3296700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0b5b80 con 0x7f85dc0cc590 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e3296700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0b4fb0 con 0x7f85dc0d0730 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e3296700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0b5250 con 0x7f85dc15bd70 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e0831700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85dc0d0730 0x7f85dc150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e1833700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e0831700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85dc0d0730 0x7f85dc150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58448/0 (socket says 172.21.15.190:58448) 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e0831700 1 -- 172.21.15.190:0/775549021 learned_addr learned my addr 172.21.15.190:0/775549021 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e1032700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85dc0cc590 0x7f85dc150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.298 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e1833700 1 -- 172.21.15.190:0/775549021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85dc0d0730 msgr2=0x7f85dc150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e1833700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85dc0d0730 0x7f85dc150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e1833700 1 -- 172.21.15.190:0/775549021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85dc0cc590 msgr2=0x7f85dc150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e1833700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85dc0cc590 0x7f85dc150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e1833700 1 -- 172.21.15.190:0/775549021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8009550 con 0x7f85dc15bd70 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e0831700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85dc0d0730 0x7f85dc150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85e1833700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0b7140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85d400efc0 tx=0x7f85d400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.297+0000 7f85d1ffb700 1 -- 172.21.15.190:0/775549021 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d400cc90 con 0x7f85dc15bd70 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.298+0000 7f85d1ffb700 1 -- 172.21.15.190:0/775549021 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d400f040 con 0x7f85dc15bd70 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.298+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc0b5530 con 0x7f85dc15bd70 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.298+0000 7f85d1ffb700 1 -- 172.21.15.190:0/775549021 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d40146c0 con 0x7f85dc15bd70 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.298+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc150ad0 con 0x7f85dc15bd70 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.298+0000 7f85d1ffb700 1 -- 172.21.15.190:0/775549021 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f85d4014b20 con 0x7f85dc15bd70 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.298+0000 7f85d1ffb700 1 -- 172.21.15.190:0/775549021 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f85d401dde0 con 0x7f85dc15bd70 2023-12-07T00:13:50.299 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.299+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc0b5cf0 con 0x7f85dc15bd70 2023-12-07T00:13:50.300 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.301+0000 7f85d1ffb700 1 -- 172.21.15.190:0/775549021 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f85d403bce0 con 0x7f85dc15bd70 2023-12-07T00:13:50.384 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.385+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1cad41e6-04eb-4be7-b099-363dbb6c835a", "id": 3} v 0) v1 -- 0x7f85dc0685f0 con 0x7f85dc15bd70 2023-12-07T00:13:50.387 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.388+0000 7f85d1ffb700 1 -- 172.21.15.190:0/775549021 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1cad41e6-04eb-4be7-b099-363dbb6c835a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f85d402a070 con 0x7f85dc15bd70 2023-12-07T00:13:50.387 INFO:teuthology.orchestra.run.smithi190.stdout:3 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 msgr2=0x7f85dc0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0b7140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f85d400efc0 tx=0x7f85d400c3a0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 shutdown_connections 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f85dc15bd70 0x7f85dc0b7140 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f85dc0cc590 0x7f85dc150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 --2- 172.21.15.190:0/775549021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f85dc0d0730 0x7f85dc150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 >> 172.21.15.190:0/775549021 conn(0x7f85dc0b34e0 msgr2=0x7f85dc0cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 shutdown_connections 2023-12-07T00:13:50.389 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.389+0000 7f85e3296700 1 -- 172.21.15.190:0/775549021 wait complete. 2023-12-07T00:13:50.400 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 429a7f47-3ec1-4f96-a63f-859c03d5ba05 4 2023-12-07T00:13:50.516 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:50.516+0000 7f8a70862200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-07T00:13:50.519 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.521+0000 7f0ac7eea700 1 Processor -- start 2023-12-07T00:13:50.520 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.521+0000 7f0ac7eea700 1 -- start start 2023-12-07T00:13:50.522 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac7eea700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0ac00ce770 0x7f0ac0070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac7eea700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0ac00d0ed0 0x7f0ac00adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac7eea700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac006f960 con 0x7f0ac015ab70 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac7eea700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac015af50 con 0x7f0ac00d0ed0 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac7eea700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac006fc40 con 0x7f0ac00ce770 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac5485700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0ac00ce770 0x7f0ac0070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac5485700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0ac00ce770 0x7f0ac0070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58454/0 (socket says 172.21.15.190:58454) 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac5485700 1 -- 172.21.15.190:0/3223762083 learned_addr learned my addr 172.21.15.190:0/3223762083 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac6487700 1 --2- 172.21.15.190:0/3223762083 >> v2:172.21.15.179:3300/0 conn(0x7f0ac00d0ed0 0x7f0ac00adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.523 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac5485700 1 -- 172.21.15.190:0/3223762083 >> v2:172.21.15.179:3300/0 conn(0x7f0ac00d0ed0 msgr2=0x7f0ac00adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac5485700 1 --2- 172.21.15.190:0/3223762083 >> v2:172.21.15.179:3300/0 conn(0x7f0ac00d0ed0 0x7f0ac00adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac5485700 1 -- 172.21.15.190:0/3223762083 >> v1:172.21.15.179:6789/0 conn(0x7f0ac015ab70 legacy=0x7f0ac00d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac5485700 1 -- 172.21.15.190:0/3223762083 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00cf110 con 0x7f0ac00ce770 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac5485700 1 --2- 172.21.15.190:0/3223762083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac00ce770 0x7f0ac0070880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0070830 tx=0x7f0abc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d810edef1ebbf8f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac4c84700 1 -- 172.21.15.190:0/3223762083 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc011830 con 0x7f0ac00ce770 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac4c84700 1 -- 172.21.15.190:0/3223762083 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc011990 con 0x7f0ac00ce770 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.522+0000 7f0ac4c84700 1 -- 172.21.15.190:0/3223762083 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc011d20 con 0x7f0ac00ce770 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.523+0000 7f0ac7eea700 1 -- 172.21.15.190:0/3223762083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac00ce770 msgr2=0x7f0ac0070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.523+0000 7f0ac7eea700 1 --2- 172.21.15.190:0/3223762083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac00ce770 0x7f0ac0070880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0070830 tx=0x7f0abc009bd0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.524 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.523+0000 7f0ac7eea700 1 -- 172.21.15.190:0/3223762083 shutdown_connections 2023-12-07T00:13:50.525 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.523+0000 7f0ac7eea700 1 --2- 172.21.15.190:0/3223762083 >> v2:172.21.15.179:3300/0 conn(0x7f0ac00d0ed0 0x7f0ac00adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.525 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.523+0000 7f0ac7eea700 1 --2- 172.21.15.190:0/3223762083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac00ce770 0x7f0ac0070880 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.525 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.523+0000 7f0ac7eea700 1 -- 172.21.15.190:0/3223762083 >> 172.21.15.190:0/3223762083 conn(0x7f0ac0099a40 msgr2=0x7f0ac0099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:50.525 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.523+0000 7f0ac7eea700 1 -- 172.21.15.190:0/3223762083 shutdown_connections 2023-12-07T00:13:50.525 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.523+0000 7f0ac7eea700 1 -- 172.21.15.190:0/3223762083 wait complete. 2023-12-07T00:13:50.527 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.525+0000 7f0ac7eea700 1 Processor -- start 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.525+0000 7f0ac7eea700 1 -- start start 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac7eea700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ac00ce770 0x7f0ac00b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac7eea700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac00d0ed0 0x7f0ac00b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac7eea700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac015ab70 0x7f0ac014ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac7eea700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b4d10 con 0x7f0ac00d0ed0 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac7eea700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b3e30 con 0x7f0ac015ab70 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac7eea700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b4100 con 0x7f0ac00ce770 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac015ab70 0x7f0ac014ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac5c86700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ac00ce770 0x7f0ac00b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac015ab70 0x7f0ac014ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58462/0 (socket says 172.21.15.190:58462) 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 -- 172.21.15.190:0/2801692028 learned_addr learned my addr 172.21.15.190:0/2801692028 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:50.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac5485700 1 --2- 172.21.15.190:0/2801692028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac00d0ed0 0x7f0ac00b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 -- 172.21.15.190:0/2801692028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ac00ce770 msgr2=0x7f0ac00b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 --2- 172.21.15.190:0/2801692028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ac00ce770 0x7f0ac00b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 -- 172.21.15.190:0/2801692028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac00d0ed0 msgr2=0x7f0ac00b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 --2- 172.21.15.190:0/2801692028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac00d0ed0 0x7f0ac00b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 -- 172.21.15.190:0/2801692028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc009550 con 0x7f0ac015ab70 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac6487700 1 --2- 172.21.15.190:0/2801692028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac015ab70 0x7f0ac014ee90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800efc0 tx=0x7f0ab800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ab67fc700 1 -- 172.21.15.190:0/2801692028 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800dca0 con 0x7f0ac015ab70 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ab67fc700 1 -- 172.21.15.190:0/2801692028 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800de20 con 0x7f0ac015ab70 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ab67fc700 1 -- 172.21.15.190:0/2801692028 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8011690 con 0x7f0ac015ab70 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac00b43e0 con 0x7f0ac015ab70 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.526+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac00b49a0 con 0x7f0ac015ab70 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.527+0000 7f0ab67fc700 1 -- 172.21.15.190:0/2801692028 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0ab80117f0 con 0x7f0ac015ab70 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.527+0000 7f0ab67fc700 1 -- 172.21.15.190:0/2801692028 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0ab80108c0 con 0x7f0ac015ab70 2023-12-07T00:13:50.529 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.527+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac00b4e80 con 0x7f0ac015ab70 2023-12-07T00:13:50.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.529+0000 7f0ab67fc700 1 -- 172.21.15.190:0/2801692028 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0ab801f020 con 0x7f0ac015ab70 2023-12-07T00:13:50.591 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:50.593+0000 7f087d362200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-07T00:13:50.613 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.614+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "429a7f47-3ec1-4f96-a63f-859c03d5ba05", "id": 4} v 0) v1 -- 0x7f0ac00685f0 con 0x7f0ac015ab70 2023-12-07T00:13:50.619 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.620+0000 7f0ab67fc700 1 -- 172.21.15.190:0/2801692028 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "429a7f47-3ec1-4f96-a63f-859c03d5ba05", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ab8011c30 con 0x7f0ac015ab70 2023-12-07T00:13:50.620 INFO:teuthology.orchestra.run.smithi190.stdout:4 2023-12-07T00:13:50.620 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac015ab70 msgr2=0x7f0ac014ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.620 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 --2- 172.21.15.190:0/2801692028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac015ab70 0x7f0ac014ee90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ab800efc0 tx=0x7f0ab800d3b0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.620 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 shutdown_connections 2023-12-07T00:13:50.620 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 --2- 172.21.15.190:0/2801692028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0ac015ab70 0x7f0ac014ee90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.621 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 --2- 172.21.15.190:0/2801692028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ac00ce770 0x7f0ac00b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.621 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 --2- 172.21.15.190:0/2801692028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0ac00d0ed0 0x7f0ac00b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.621 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 >> 172.21.15.190:0/2801692028 conn(0x7f0ac0099a40 msgr2=0x7f0ac00afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:50.621 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 shutdown_connections 2023-12-07T00:13:50.621 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.621+0000 7f0ac7eea700 1 -- 172.21.15.190:0/2801692028 wait complete. 2023-12-07T00:13:50.632 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5 5 2023-12-07T00:13:50.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.755+0000 7f37989f7700 1 Processor -- start 2023-12-07T00:13:50.754 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.755+0000 7f37989f7700 1 -- start start 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f37989f7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379406b980 0x7f379406bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f37989f7700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f37940c6ac0 0x7f37940cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f37989f7700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37940c6630 con 0x7f37940b3e00 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f37989f7700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379406c2a0 con 0x7f37940c6ac0 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f37989f7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37940d0a00 con 0x7f379406b980 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f3791d9b700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f37940b3e00 0x7f37940d01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:53166/0 (socket says 172.21.15.190:53166) 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f379259c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379406b980 0x7f379406bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f3791d9b700 1 -- 172.21.15.190:0/3114339821 learned_addr learned my addr 172.21.15.190:0/3114339821 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f3792d9d700 1 --2- 172.21.15.190:0/3114339821 >> v2:172.21.15.179:3300/0 conn(0x7f37940c6ac0 0x7f37940cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f379159a700 1 -- 172.21.15.190:0/3114339821 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2068972772 0 0) 0x7f37940c6630 con 0x7f37940b3e00 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f379159a700 1 -- 172.21.15.190:0/3114339821 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f377c0035b0 con 0x7f37940b3e00 2023-12-07T00:13:50.756 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f379259c700 1 -- 172.21.15.190:0/3114339821 >> v2:172.21.15.179:3300/0 conn(0x7f37940c6ac0 msgr2=0x7f37940cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:50.757 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f379259c700 1 --2- 172.21.15.190:0/3114339821 >> v2:172.21.15.179:3300/0 conn(0x7f37940c6ac0 0x7f37940cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.757 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f379259c700 1 -- 172.21.15.190:0/3114339821 >> v1:172.21.15.190:6789/0 conn(0x7f37940b3e00 legacy=0x7f37940d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.757 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f379259c700 1 -- 172.21.15.190:0/3114339821 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940c5fe0 con 0x7f379406b980 2023-12-07T00:13:50.757 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.756+0000 7f379259c700 1 --2- 172.21.15.190:0/3114339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379406b980 0x7f379406bd60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3784009840 tx=0x7f3784009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4162dd75fde8afc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:50.757 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.757+0000 7f379159a700 1 -- 172.21.15.190:0/3114339821 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784011830 con 0x7f379406b980 2023-12-07T00:13:50.757 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.757+0000 7f379159a700 1 -- 172.21.15.190:0/3114339821 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784011990 con 0x7f379406b980 2023-12-07T00:13:50.757 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.757+0000 7f379159a700 1 -- 172.21.15.190:0/3114339821 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784011d20 con 0x7f379406b980 2023-12-07T00:13:50.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.757+0000 7f37989f7700 1 -- 172.21.15.190:0/3114339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379406b980 msgr2=0x7f379406bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.757+0000 7f37989f7700 1 --2- 172.21.15.190:0/3114339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379406b980 0x7f379406bd60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3784009840 tx=0x7f3784009b50 comp rx=0 tx=0).stop 2023-12-07T00:13:50.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.758+0000 7f37989f7700 1 -- 172.21.15.190:0/3114339821 shutdown_connections 2023-12-07T00:13:50.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.758+0000 7f37989f7700 1 --2- 172.21.15.190:0/3114339821 >> v2:172.21.15.179:3300/0 conn(0x7f37940c6ac0 0x7f37940cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.758+0000 7f37989f7700 1 --2- 172.21.15.190:0/3114339821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f379406b980 0x7f379406bd60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.758+0000 7f37989f7700 1 -- 172.21.15.190:0/3114339821 >> 172.21.15.190:0/3114339821 conn(0x7f37940b3270 msgr2=0x7f37940b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:50.758 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.758+0000 7f37989f7700 1 -- 172.21.15.190:0/3114339821 shutdown_connections 2023-12-07T00:13:50.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.758+0000 7f37989f7700 1 -- 172.21.15.190:0/3114339821 wait complete. 2023-12-07T00:13:50.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.760+0000 7f37989f7700 1 Processor -- start 2023-12-07T00:13:50.759 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.760+0000 7f37989f7700 1 -- start start 2023-12-07T00:13:50.761 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f37989f7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379406b980 0x7f379406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f37989f7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37940b3e00 0x7f3794151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f37989f7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940c6ac0 0x7f37940cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f37989f7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379406e350 con 0x7f379406b980 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f37989f7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940b23a0 con 0x7f37940c6ac0 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f37989f7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379406e5a0 con 0x7f37940b3e00 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3791d9b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37940b3e00 0x7f3794151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3791d9b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37940b3e00 0x7f3794151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34662/0 (socket says 172.21.15.190:34662) 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3791d9b700 1 -- 172.21.15.190:0/3397941597 learned_addr learned my addr 172.21.15.190:0/3397941597 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3792d9d700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940c6ac0 0x7f37940cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f379259c700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379406b980 0x7f379406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3791d9b700 1 -- 172.21.15.190:0/3397941597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940c6ac0 msgr2=0x7f37940cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3791d9b700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940c6ac0 0x7f37940cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.762 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3791d9b700 1 -- 172.21.15.190:0/3397941597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379406b980 msgr2=0x7f379406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3791d9b700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379406b980 0x7f379406f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.761+0000 7f3791d9b700 1 -- 172.21.15.190:0/3397941597 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840094a0 con 0x7f37940b3e00 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.762+0000 7f3791d9b700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37940b3e00 0x7f3794151cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3788001eb0 tx=0x7f378800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.762+0000 7f3782ffd700 1 -- 172.21.15.190:0/3397941597 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788005d70 con 0x7f37940b3e00 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.762+0000 7f3782ffd700 1 -- 172.21.15.190:0/3397941597 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880070d0 con 0x7f37940b3e00 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.762+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379415c100 con 0x7f37940b3e00 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.762+0000 7f3782ffd700 1 -- 172.21.15.190:0/3397941597 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788007460 con 0x7f37940b3e00 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.762+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379406eb60 con 0x7f37940b3e00 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.763+0000 7f3782ffd700 1 -- 172.21.15.190:0/3397941597 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f378801c440 con 0x7f37940b3e00 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.763+0000 7f3782ffd700 1 -- 172.21.15.190:0/3397941597 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3788012980 con 0x7f37940b3e00 2023-12-07T00:13:50.763 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.763+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37940685f0 con 0x7f37940b3e00 2023-12-07T00:13:50.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.765+0000 7f3782ffd700 1 -- 172.21.15.190:0/3397941597 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3788017070 con 0x7f37940b3e00 2023-12-07T00:13:50.848 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.849+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5", "id": 5} v 0) v1 -- 0x7f379406b0a0 con 0x7f37940b3e00 2023-12-07T00:13:50.853 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.854+0000 7f3782ffd700 1 -- 172.21.15.190:0/3397941597 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3788012400 con 0x7f37940b3e00 2023-12-07T00:13:50.853 INFO:teuthology.orchestra.run.smithi190.stdout:5 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37940b3e00 msgr2=0x7f3794151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37940b3e00 0x7f3794151cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3788001eb0 tx=0x7f378800c7b0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 shutdown_connections 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f37940c6ac0 0x7f37940cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f379406b980 0x7f379406f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 --2- 172.21.15.190:0/3397941597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37940b3e00 0x7f3794151cc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 >> 172.21.15.190:0/3397941597 conn(0x7f37940b3270 msgr2=0x7f37940cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 shutdown_connections 2023-12-07T00:13:50.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:50.855+0000 7f37989f7700 1 -- 172.21.15.190:0/3397941597 wait complete. 2023-12-07T00:13:50.866 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 517aa14a-9773-4a04-8b84-d3ae1029b693 6 2023-12-07T00:13:51.008 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.009+0000 7fad89ec0700 1 Processor -- start 2023-12-07T00:13:51.008 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.009+0000 7fad89ec0700 1 -- start start 2023-12-07T00:13:51.010 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.010+0000 7fad89ec0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84158470 0x7fad840b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.010 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.010+0000 7fad89ec0700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fad84071920 0x7fad84071da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.010 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.010+0000 7fad89ec0700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8406e820 con 0x7fad84161940 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.010+0000 7fad89ec0700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad840722e0 con 0x7fad84071920 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.010+0000 7fad89ec0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad841628e0 con 0x7fad84158470 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.010+0000 7fad837fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84158470 0x7fad840b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.010+0000 7fad837fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84158470 0x7fad840b29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34666/0 (socket says 172.21.15.190:34666) 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.010+0000 7fad837fe700 1 -- 172.21.15.190:0/1330366803 learned_addr learned my addr 172.21.15.190:0/1330366803 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.011+0000 7fad837fe700 1 -- 172.21.15.190:0/1330366803 >> v2:172.21.15.179:3300/0 conn(0x7fad84071920 msgr2=0x7fad84071da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.011+0000 7fad837fe700 1 --2- 172.21.15.190:0/1330366803 >> v2:172.21.15.179:3300/0 conn(0x7fad84071920 0x7fad84071da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.011+0000 7fad837fe700 1 -- 172.21.15.190:0/1330366803 >> v1:172.21.15.179:6789/0 conn(0x7fad84161940 legacy=0x7fad84161dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.011+0000 7fad837fe700 1 -- 172.21.15.190:0/1330366803 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8406f0a0 con 0x7fad84158470 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.011+0000 7fad837fe700 1 --2- 172.21.15.190:0/1330366803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84158470 0x7fad840b29b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009e50 tx=0x7fad7c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c6ae9376c54fb8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.011+0000 7fad827fc700 1 -- 172.21.15.190:0/1330366803 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c00e070 con 0x7fad84158470 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.011+0000 7fad827fc700 1 -- 172.21.15.190:0/1330366803 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c00b9c0 con 0x7fad84158470 2023-12-07T00:13:51.011 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.011+0000 7fad827fc700 1 -- 172.21.15.190:0/1330366803 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c00bd70 con 0x7fad84158470 2023-12-07T00:13:51.012 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.012+0000 7fad89ec0700 1 -- 172.21.15.190:0/1330366803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84158470 msgr2=0x7fad840b29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.012 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.012+0000 7fad89ec0700 1 --2- 172.21.15.190:0/1330366803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84158470 0x7fad840b29b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fad7c009e50 tx=0x7fad7c00b330 comp rx=0 tx=0).stop 2023-12-07T00:13:51.012 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.012+0000 7fad89ec0700 1 -- 172.21.15.190:0/1330366803 shutdown_connections 2023-12-07T00:13:51.012 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.012+0000 7fad89ec0700 1 --2- 172.21.15.190:0/1330366803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84158470 0x7fad840b29b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.012 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.012+0000 7fad89ec0700 1 --2- 172.21.15.190:0/1330366803 >> v2:172.21.15.179:3300/0 conn(0x7fad84071920 0x7fad84071da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.012 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.012+0000 7fad89ec0700 1 -- 172.21.15.190:0/1330366803 >> 172.21.15.190:0/1330366803 conn(0x7fad8406b5a0 msgr2=0x7fad840b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:51.012 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.012+0000 7fad89ec0700 1 -- 172.21.15.190:0/1330366803 shutdown_connections 2023-12-07T00:13:51.013 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.012+0000 7fad89ec0700 1 -- 172.21.15.190:0/1330366803 wait complete. 2023-12-07T00:13:51.013 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.014+0000 7fad89ec0700 1 Processor -- start 2023-12-07T00:13:51.013 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.014+0000 7fad89ec0700 1 -- start start 2023-12-07T00:13:51.015 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.015+0000 7fad89ec0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad84071920 0x7fad84147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.015 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.015+0000 7fad89ec0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84161940 0x7fad841eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.015 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.015+0000 7fad89ec0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad841f7350 0x7fad841f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.015 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.015+0000 7fad89ec0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad841f7d20 con 0x7fad84071920 2023-12-07T00:13:51.015 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.015+0000 7fad89ec0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad841e90f0 con 0x7fad841f7350 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.015+0000 7fad89ec0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad841e93d0 con 0x7fad84161940 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad82ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84161940 0x7fad841eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad82ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84161940 0x7fad841eb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:34672/0 (socket says 172.21.15.190:34672) 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad83fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad841f7350 0x7fad841f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad84071920 0x7fad84147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad84071920 0x7fad84147430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.190:58758/0 (socket says 172.21.15.190:58758) 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad83fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad841f7350 0x7fad841f77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58486/0 (socket says 172.21.15.190:58486) 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 -- 172.21.15.190:0/134831869 learned_addr learned my addr 172.21.15.190:0/134831869 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 -- 172.21.15.190:0/134831869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84161940 msgr2=0x7fad841eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 --2- 172.21.15.190:0/134831869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84161940 0x7fad841eb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 -- 172.21.15.190:0/134831869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad841f7350 msgr2=0x7fad841f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 --2- 172.21.15.190:0/134831869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad841f7350 0x7fad841f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 -- 172.21.15.190:0/134831869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c009b30 con 0x7fad84071920 2023-12-07T00:13:51.016 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad837fe700 1 --2- 172.21.15.190:0/134831869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad84071920 0x7fad84147430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fad7c000f80 tx=0x7fad7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:51.017 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad6bfff700 1 -- 172.21.15.190:0/134831869 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c0048c0 con 0x7fad84071920 2023-12-07T00:13:51.017 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad6bfff700 1 -- 172.21.15.190:0/134831869 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7c0092e0 con 0x7fad84071920 2023-12-07T00:13:51.017 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad841e96b0 con 0x7fad84071920 2023-12-07T00:13:51.017 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad6bfff700 1 -- 172.21.15.190:0/134831869 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7c01c680 con 0x7fad84071920 2023-12-07T00:13:51.017 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.016+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad841e9c70 con 0x7fad84071920 2023-12-07T00:13:51.017 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.018+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad84067ee0 con 0x7fad84071920 2023-12-07T00:13:51.017 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.018+0000 7fad6bfff700 1 -- 172.21.15.190:0/134831869 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fad7c01cae0 con 0x7fad84071920 2023-12-07T00:13:51.018 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.018+0000 7fad6bfff700 1 -- 172.21.15.190:0/134831869 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fad7c0123f0 con 0x7fad84071920 2023-12-07T00:13:51.018 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.020+0000 7fad6bfff700 1 -- 172.21.15.190:0/134831869 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fad7c020070 con 0x7fad84071920 2023-12-07T00:13:51.126 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.127+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "517aa14a-9773-4a04-8b84-d3ae1029b693", "id": 6} v 0) v1 -- 0x7fad840b2460 con 0x7fad84071920 2023-12-07T00:13:51.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.129+0000 7fad6bfff700 1 -- 172.21.15.190:0/134831869 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "517aa14a-9773-4a04-8b84-d3ae1029b693", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fad7c0320b0 con 0x7fad84071920 2023-12-07T00:13:51.128 INFO:teuthology.orchestra.run.smithi190.stdout:6 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad84071920 msgr2=0x7fad84147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 --2- 172.21.15.190:0/134831869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad84071920 0x7fad84147430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fad7c000f80 tx=0x7fad7c004ad0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 shutdown_connections 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 --2- 172.21.15.190:0/134831869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad841f7350 0x7fad841f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 --2- 172.21.15.190:0/134831869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad84071920 0x7fad84147430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 --2- 172.21.15.190:0/134831869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad84161940 0x7fad841eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 >> 172.21.15.190:0/134831869 conn(0x7fad8406b5a0 msgr2=0x7fad840cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 shutdown_connections 2023-12-07T00:13:51.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.130+0000 7fad89ec0700 1 -- 172.21.15.190:0/134831869 wait complete. 2023-12-07T00:13:51.141 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e 7 2023-12-07T00:13:51.153 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:51.154+0000 7f8a70862200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-07T00:13:51.220 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:51.221+0000 7f8a70862200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-07T00:13:51.265 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:51.266+0000 7f087d362200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-07T00:13:51.267 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.266+0000 7f8a5acf0700 1 Processor -- start 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.266+0000 7f8a5acf0700 1 -- start start 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a5acf0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8a5415de50 0x7f8a540cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a5acf0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5406b680 0x7f8a540cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a5acf0700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a540cc550 con 0x7f8a540ccc90 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a5acf0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a540cd1c0 con 0x7f8a5415de50 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a5acf0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540cd4a0 con 0x7f8a5406b680 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a58a8c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8a5415de50 0x7f8a540cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a58a8c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8a5415de50 0x7f8a540cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58488/0 (socket says 172.21.15.190:58488) 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a58a8c700 1 -- 172.21.15.190:0/1108770500 learned_addr learned my addr 172.21.15.190:0/1108770500 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a5928d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5406b680 0x7f8a540cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a58a8c700 1 -- 172.21.15.190:0/1108770500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5406b680 msgr2=0x7f8a540cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a58a8c700 1 --2- 172.21.15.190:0/1108770500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5406b680 0x7f8a540cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a58a8c700 1 -- 172.21.15.190:0/1108770500 >> v1:172.21.15.179:6789/0 conn(0x7f8a540ccc90 legacy=0x7f8a5406af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.268 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.267+0000 7f8a58a8c700 1 -- 172.21.15.190:0/1108770500 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540cd780 con 0x7f8a5415de50 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a58a8c700 1 --2- 172.21.15.190:0/1108770500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a540cc010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a480098f0 tx=0x7f8a48009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cced65e837c88fc1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a537fe700 1 -- 172.21.15.190:0/1108770500 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48011830 con 0x7f8a5415de50 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a537fe700 1 -- 172.21.15.190:0/1108770500 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a48011990 con 0x7f8a5415de50 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a537fe700 1 -- 172.21.15.190:0/1108770500 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a48011d20 con 0x7f8a5415de50 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a5acf0700 1 -- 172.21.15.190:0/1108770500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 msgr2=0x7f8a540cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a5acf0700 1 --2- 172.21.15.190:0/1108770500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a540cc010 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a480098f0 tx=0x7f8a48009c00 comp rx=0 tx=0).stop 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a5acf0700 1 -- 172.21.15.190:0/1108770500 shutdown_connections 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a5acf0700 1 --2- 172.21.15.190:0/1108770500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a5406b680 0x7f8a540cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a5acf0700 1 --2- 172.21.15.190:0/1108770500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a540cc010 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a5acf0700 1 -- 172.21.15.190:0/1108770500 >> 172.21.15.190:0/1108770500 conn(0x7f8a54099a40 msgr2=0x7f8a54099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a5acf0700 1 -- 172.21.15.190:0/1108770500 shutdown_connections 2023-12-07T00:13:51.269 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.268+0000 7f8a5acf0700 1 -- 172.21.15.190:0/1108770500 wait complete. 2023-12-07T00:13:51.270 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.270+0000 7f8a5acf0700 1 Processor -- start 2023-12-07T00:13:51.270 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.270+0000 7f8a5acf0700 1 -- start start 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5acf0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5406b680 0x7f8a540c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5acf0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a540ccc90 0x7f8a540c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5acf0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a5415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5acf0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540c7550 con 0x7f8a5406b680 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5acf0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5415ae20 con 0x7f8a5415de50 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5acf0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540c4c40 con 0x7f8a540ccc90 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a5415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a53fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a540ccc90 0x7f8a540c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.272 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a5415a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58498/0 (socket says 172.21.15.190:58498) 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 -- 172.21.15.190:0/3325066313 learned_addr learned my addr 172.21.15.190:0/3325066313 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a58a8c700 1 --2- 172.21.15.190:0/3325066313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5406b680 0x7f8a540c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 -- 172.21.15.190:0/3325066313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a540ccc90 msgr2=0x7f8a540c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 --2- 172.21.15.190:0/3325066313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a540ccc90 0x7f8a540c7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 -- 172.21.15.190:0/3325066313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5406b680 msgr2=0x7f8a540c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 --2- 172.21.15.190:0/3325066313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5406b680 0x7f8a540c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 -- 172.21.15.190:0/3325066313 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a48009550 con 0x7f8a5415de50 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5928d700 1 --2- 172.21.15.190:0/3325066313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a5415a8e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00efc0 tx=0x7f8a4c00c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a517fa700 1 -- 172.21.15.190:0/3325066313 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c00cad0 con 0x7f8a5415de50 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a517fa700 1 -- 172.21.15.190:0/3325066313 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c00f040 con 0x7f8a5415de50 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a540b38f0 con 0x7f8a5415de50 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.272+0000 7f8a517fa700 1 -- 172.21.15.190:0/3325066313 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c00ce70 con 0x7f8a5415de50 2023-12-07T00:13:51.273 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.273+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a540b3eb0 con 0x7f8a5415de50 2023-12-07T00:13:51.274 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.274+0000 7f8a517fa700 1 -- 172.21.15.190:0/3325066313 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8a4c014780 con 0x7f8a5415de50 2023-12-07T00:13:51.274 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.274+0000 7f8a517fa700 1 -- 172.21.15.190:0/3325066313 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f8a4c0133e0 con 0x7f8a5415de50 2023-12-07T00:13:51.274 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.274+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a540685f0 con 0x7f8a5415de50 2023-12-07T00:13:51.274 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.276+0000 7f8a517fa700 1 -- 172.21.15.190:0/3325066313 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8a4c03bce0 con 0x7f8a5415de50 2023-12-07T00:13:51.338 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:51.339+0000 7f087d362200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-07T00:13:51.360 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.361+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e", "id": 7} v 0) v1 -- 0x7f8a540b6a20 con 0x7f8a5415de50 2023-12-07T00:13:51.370 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.371+0000 7f8a517fa700 1 -- 172.21.15.190:0/3325066313 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8a4c02a070 con 0x7f8a5415de50 2023-12-07T00:13:51.370 INFO:teuthology.orchestra.run.smithi190.stdout:7 2023-12-07T00:13:51.371 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 msgr2=0x7f8a5415a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.372 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 --2- 172.21.15.190:0/3325066313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a5415a8e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c00efc0 tx=0x7f8a4c00c0c0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.372 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 shutdown_connections 2023-12-07T00:13:51.372 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 --2- 172.21.15.190:0/3325066313 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a5415de50 0x7f8a5415a8e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.372 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 --2- 172.21.15.190:0/3325066313 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a5406b680 0x7f8a540c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.372 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 --2- 172.21.15.190:0/3325066313 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a540ccc90 0x7f8a540c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.372 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 >> 172.21.15.190:0/3325066313 conn(0x7f8a54099a40 msgr2=0x7f8a5415c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:51.372 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 shutdown_connections 2023-12-07T00:13:51.372 INFO:teuthology.orchestra.run.smithi190.stderr:2023-12-07T00:13:51.372+0000 7f8a5acf0700 1 -- 172.21.15.190:0/3325066313 wait complete. 2023-12-07T00:13:51.383 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-07T00:13:51.383 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-07T00:13:51.387 INFO:tasks.ceph.osd.0:Started 2023-12-07T00:13:51.387 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-07T00:13:51.387 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-07T00:13:51.388 INFO:tasks.ceph.osd.1:Started 2023-12-07T00:13:51.389 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-07T00:13:51.389 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-07T00:13:51.390 INFO:tasks.ceph.osd.2:Started 2023-12-07T00:13:51.390 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-07T00:13:51.391 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-07T00:13:51.392 INFO:tasks.ceph.osd.3:Started 2023-12-07T00:13:51.393 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-07T00:13:51.393 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-07T00:13:51.394 INFO:tasks.ceph.osd.4:Started 2023-12-07T00:13:51.395 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-07T00:13:51.395 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-07T00:13:51.396 INFO:tasks.ceph.osd.5:Started 2023-12-07T00:13:51.397 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-07T00:13:51.397 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-07T00:13:51.400 INFO:tasks.ceph.osd.6:Started 2023-12-07T00:13:51.400 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-07T00:13:51.400 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-07T00:13:51.402 INFO:tasks.ceph.osd.7:Started 2023-12-07T00:13:51.403 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:13:51.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.560+0000 7f4f1d7a0700 1 Processor -- start 2023-12-07T00:13:51.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.560+0000 7f4f1d7a0700 1 -- start start 2023-12-07T00:13:51.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f1d7a0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f180b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f1d7a0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4f180b2aa0 0x7f4f180cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f1d7a0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1815b8d0 con 0x7f4f18158560 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f1d7a0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180b2f30 con 0x7f4f180b2aa0 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f1d7a0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1815bbb0 con 0x7f4f180b4470 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f177fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4f180b2aa0 0x7f4f180cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f167fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f180b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f16ffd700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f4f18158560 0x7f4f1815b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:51776/0 (socket says 172.21.15.179:51776) 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f16ffd700 1 -- 172.21.15.179:0/4269956878 learned_addr learned my addr 172.21.15.179:0/4269956878 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f167fc700 1 -- 172.21.15.179:0/4269956878 >> v2:172.21.15.190:3300/0 conn(0x7f4f180b2aa0 msgr2=0x7f4f180cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f167fc700 1 --2- 172.21.15.179:0/4269956878 >> v2:172.21.15.190:3300/0 conn(0x7f4f180b2aa0 0x7f4f180cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f167fc700 1 -- 172.21.15.179:0/4269956878 >> v1:172.21.15.190:6789/0 conn(0x7f4f18158560 legacy=0x7f4f1815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f167fc700 1 -- 172.21.15.179:0/4269956878 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1815be90 con 0x7f4f180b4470 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f15ffb700 1 -- 172.21.15.179:0/4269956878 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835863112 0 0) 0x7f4f1815b8d0 con 0x7f4f18158560 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.561+0000 7f4f177fe700 1 --2- 172.21.15.179:0/4269956878 >> v2:172.21.15.190:3300/0 conn(0x7f4f180b2aa0 0x7f4f180cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:13:51.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f167fc700 1 --2- 172.21.15.179:0/4269956878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f180b2560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009820 tx=0x7f4f0c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6ebc2b5e4cc2305 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f15ffb700 1 -- 172.21.15.179:0/4269956878 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c005e30 con 0x7f4f180b4470 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f15ffb700 1 -- 172.21.15.179:0/4269956878 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0c006030 con 0x7f4f180b4470 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f15ffb700 1 -- 172.21.15.179:0/4269956878 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0063c0 con 0x7f4f180b4470 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/4269956878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 msgr2=0x7f4f180b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f1d7a0700 1 --2- 172.21.15.179:0/4269956878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f180b2560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009820 tx=0x7f4f0c009b30 comp rx=0 tx=0).stop 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/4269956878 shutdown_connections 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f1d7a0700 1 --2- 172.21.15.179:0/4269956878 >> v2:172.21.15.190:3300/0 conn(0x7f4f180b2aa0 0x7f4f180cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f1d7a0700 1 --2- 172.21.15.179:0/4269956878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f180b2560 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/4269956878 >> 172.21.15.179:0/4269956878 conn(0x7f4f18072970 msgr2=0x7f4f18072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/4269956878 shutdown_connections 2023-12-07T00:13:51.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.562+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/4269956878 wait complete. 2023-12-07T00:13:51.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.564+0000 7f4f1d7a0700 1 Processor -- start 2023-12-07T00:13:51.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.564+0000 7f4f1d7a0700 1 -- start start 2023-12-07T00:13:51.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.564+0000 7f4f1d7a0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f180b2aa0 0x7f4f18141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.564+0000 7f4f1d7a0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f18153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.564+0000 7f4f1d7a0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f18158560 0x7f4f181f3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.564+0000 7f4f1d7a0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181537d0 con 0x7f4f18158560 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.564+0000 7f4f1d7a0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181f29f0 con 0x7f4f180b2aa0 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.564+0000 7f4f1d7a0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1813bb40 con 0x7f4f180b4470 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f180b2aa0 0x7f4f18141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f167fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f18153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f180b2aa0 0x7f4f18141f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:40454/0 (socket says 172.21.15.179:40454) 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f177fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f18158560 0x7f4f181f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 -- 172.21.15.179:0/3302114523 learned_addr learned my addr 172.21.15.179:0/3302114523 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f167fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f18153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:38618/0 (socket says 172.21.15.179:38618) 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 -- 172.21.15.179:0/3302114523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 msgr2=0x7f4f18153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 --2- 172.21.15.179:0/3302114523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f18153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 -- 172.21.15.179:0/3302114523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f18158560 msgr2=0x7f4f181f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 --2- 172.21.15.179:0/3302114523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f18158560 0x7f4f181f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 -- 172.21.15.179:0/3302114523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10009a70 con 0x7f4f180b2aa0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f167fc700 1 --2- 172.21.15.179:0/3302114523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f18153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f16ffd700 1 --2- 172.21.15.179:0/3302114523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f180b2aa0 0x7f4f18141f10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c550 tx=0x7f4f0800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4eff7fe700 1 -- 172.21.15.179:0/3302114523 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08004c80 con 0x7f4f180b2aa0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4eff7fe700 1 -- 172.21.15.179:0/3302114523 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08004e00 con 0x7f4f180b2aa0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c009430 con 0x7f4f180b2aa0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4eff7fe700 1 -- 172.21.15.179:0/3302114523 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08007310 con 0x7f4f180b2aa0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f181f3960 con 0x7f4f180b2aa0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4eff7fe700 1 -- 172.21.15.179:0/3302114523 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4f0801d3f0 con 0x7f4f180b2aa0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.565+0000 7f4eff7fe700 1 -- 172.21.15.179:0/3302114523 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4f08013a90 con 0x7f4f180b2aa0 2023-12-07T00:13:51.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.566+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1804f290 con 0x7f4f180b2aa0 2023-12-07T00:13:51.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.568+0000 7f4eff7fe700 1 -- 172.21.15.179:0/3302114523 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4f08013ca0 con 0x7f4f180b2aa0 2023-12-07T00:13:51.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.638+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f180685f0 con 0x7f4f180b2aa0 2023-12-07T00:13:51.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.639+0000 7f4eff7fe700 1 -- 172.21.15.179:0/3302114523 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4f080133c0 con 0x7f4f180b2aa0 2023-12-07T00:13:51.638 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:13:51.638 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":10,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:13:51.362700+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:13:51.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f180b2aa0 msgr2=0x7f4f18141f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:51.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 --2- 172.21.15.179:0/3302114523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f180b2aa0 0x7f4f18141f10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4f0800c550 tx=0x7f4f0800c860 comp rx=0 tx=0).stop 2023-12-07T00:13:51.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 shutdown_connections 2023-12-07T00:13:51.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 --2- 172.21.15.179:0/3302114523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4f18158560 0x7f4f181f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 --2- 172.21.15.179:0/3302114523 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f180b2aa0 0x7f4f18141f10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 --2- 172.21.15.179:0/3302114523 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f180b4470 0x7f4f18153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:51.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 >> 172.21.15.179:0/3302114523 conn(0x7f4f18072970 msgr2=0x7f4f18157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:51.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 shutdown_connections 2023-12-07T00:13:51.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:13:51.640+0000 7f4f1d7a0700 1 -- 172.21.15.179:0/3302114523 wait complete. 2023-12-07T00:13:51.651 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-07T00:13:51.652 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-07T00:13:51.968 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:51.969+0000 7f8a70862200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-07T00:13:52.005 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T00:13:52.006+0000 7ff60158e640 -1 Falling back to public interface 2023-12-07T00:13:52.009 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T00:13:52.010+0000 7fe9d8da5640 -1 Falling back to public interface 2023-12-07T00:13:52.009 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T00:13:52.010+0000 7fc4bff4a640 -1 Falling back to public interface 2023-12-07T00:13:52.010 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T00:13:52.011+0000 7fe9d0163700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-12-07T00:13:52.011 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T00:13:52.012+0000 7fc7dea29640 -1 Falling back to public interface 2023-12-07T00:13:52.011 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T00:13:52.013+0000 7fd303411640 -1 Falling back to public interface 2023-12-07T00:13:52.015 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T00:13:52.016+0000 7f918ae55640 -1 Falling back to public interface 2023-12-07T00:13:52.021 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T00:13:52.022+0000 7ff4b8dfe640 -1 Falling back to public interface 2023-12-07T00:13:52.028 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T00:13:52.029+0000 7f4e029ab640 -1 Falling back to public interface 2023-12-07T00:13:52.053 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:52.054+0000 7f8a70862200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-07T00:13:52.083 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:52.084+0000 7f087d362200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-07T00:13:52.160 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:52.161+0000 7f087d362200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-07T00:13:52.194 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:52.195+0000 7f8a70862200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-07T00:13:52.301 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:52.302+0000 7f087d362200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-07T00:13:52.433 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:52.434+0000 7f8a70862200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-07T00:13:52.462 DEBUG:teuthology.orchestra.run.smithi179:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T00:13:52.535 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:52.536+0000 7f087d362200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-07T00:13:52.579 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.580+0000 7f24ee667700 1 Processor -- start 2023-12-07T00:13:52.579 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.580+0000 7f24ee667700 1 -- start start 2023-12-07T00:13:52.581 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24ee667700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f24e80d1310 0x7f24e806af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:52.581 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24ee667700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e806e980 con 0x7f24e80cdb40 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24ee667700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e806ec60 con 0x7f24e80cca80 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24ee667700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e806ef40 con 0x7f24e80d1310 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e77fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f24e80cdb40 0x7f24e815d600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45112/0 (socket says 172.21.15.179:45112) 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e77fe700 1 -- 172.21.15.179:0/1705632236 learned_addr learned my addr 172.21.15.179:0/1705632236 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e7fff700 1 --2- 172.21.15.179:0/1705632236 >> v2:172.21.15.190:3300/0 conn(0x7f24e80d1310 0x7f24e806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e6ffd700 1 -- 172.21.15.179:0/1705632236 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367391615 0 0) 0x7f24e806e980 con 0x7f24e80cdb40 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e6ffd700 1 -- 172.21.15.179:0/1705632236 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24d00035b0 con 0x7f24e80cdb40 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e6ffd700 1 -- 172.21.15.179:0/1705632236 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633773059 0 0) 0x7f24e806ec60 con 0x7f24e80cca80 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e6ffd700 1 -- 172.21.15.179:0/1705632236 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24e806e980 con 0x7f24e80cca80 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e7fff700 1 -- 172.21.15.179:0/1705632236 >> v1:172.21.15.190:6789/0 conn(0x7f24e80cca80 legacy=0x7f24e815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e7fff700 1 -- 172.21.15.179:0/1705632236 >> v1:172.21.15.179:6789/0 conn(0x7f24e80cdb40 legacy=0x7f24e815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e7fff700 1 -- 172.21.15.179:0/1705632236 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e806f220 con 0x7f24e80d1310 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.581+0000 7f24e7fff700 1 --2- 172.21.15.179:0/1705632236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80d1310 0x7f24e806af70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009840 tx=0x7f24d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63ddc59b5a63615 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:52.582 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24e6ffd700 1 -- 172.21.15.179:0/1705632236 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8011830 con 0x7f24e80d1310 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24e6ffd700 1 -- 172.21.15.179:0/1705632236 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d8011990 con 0x7f24e80d1310 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24e6ffd700 1 -- 172.21.15.179:0/1705632236 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8011d20 con 0x7f24e80d1310 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24ee667700 1 -- 172.21.15.179:0/1705632236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80d1310 msgr2=0x7f24e806af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24ee667700 1 --2- 172.21.15.179:0/1705632236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80d1310 0x7f24e806af70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f24d8009840 tx=0x7f24d8009b50 comp rx=0 tx=0).stop 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24ee667700 1 -- 172.21.15.179:0/1705632236 shutdown_connections 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24ee667700 1 --2- 172.21.15.179:0/1705632236 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80d1310 0x7f24e806af70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24ee667700 1 -- 172.21.15.179:0/1705632236 >> 172.21.15.179:0/1705632236 conn(0x7f24e8099a40 msgr2=0x7f24e8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24ee667700 1 -- 172.21.15.179:0/1705632236 shutdown_connections 2023-12-07T00:13:52.583 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.582+0000 7f24ee667700 1 -- 172.21.15.179:0/1705632236 wait complete. 2023-12-07T00:13:52.585 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.584+0000 7f24ee667700 1 Processor -- start 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.584+0000 7f24ee667700 1 -- start start 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.584+0000 7f24ee667700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80cca80 0x7f24e809ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24ee667700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e80cdb40 0x7f24e81d2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24ee667700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e80d1310 0x7f24e81d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24ee667700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e81f40f0 con 0x7f24e80d1310 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24ee667700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e809e160 con 0x7f24e80cca80 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24ee667700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e81f37c0 con 0x7f24e80cdb40 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80cca80 0x7f24e809ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24ecc04700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e80d1310 0x7f24e81d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80cca80 0x7f24e809ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:40466/0 (socket says 172.21.15.179:40466) 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e7fff700 1 -- 172.21.15.179:0/1493323671 learned_addr learned my addr 172.21.15.179:0/1493323671 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e77fe700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e80cdb40 0x7f24e81d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e77fe700 1 -- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80cca80 msgr2=0x7f24e809ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:52.586 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e77fe700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80cca80 0x7f24e809ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e77fe700 1 -- 172.21.15.179:0/1493323671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e80d1310 msgr2=0x7f24e81d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e77fe700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e80d1310 0x7f24e81d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e77fe700 1 -- 172.21.15.179:0/1493323671 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d80094a0 con 0x7f24e80cdb40 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e7fff700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80cca80 0x7f24e809ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e77fe700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e80cdb40 0x7f24e81d2660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00c490 tx=0x7f24dc00c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e4ff9700 1 -- 172.21.15.179:0/1493323671 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc005d70 con 0x7f24e80cdb40 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e4ff9700 1 -- 172.21.15.179:0/1493323671 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc0070d0 con 0x7f24e80cdb40 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24e4ff9700 1 -- 172.21.15.179:0/1493323671 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc007440 con 0x7f24e80cdb40 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e81f3aa0 con 0x7f24e80cdb40 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.585+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e809b0b0 con 0x7f24e80cdb40 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.586+0000 7f24e4ff9700 1 -- 172.21.15.179:0/1493323671 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f24dc012400 con 0x7f24e80cdb40 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.586+0000 7f24e4ff9700 1 -- 172.21.15.179:0/1493323671 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f24dc012d80 con 0x7f24e80cdb40 2023-12-07T00:13:52.587 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.587+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e809b240 con 0x7f24e80cdb40 2023-12-07T00:13:52.588 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.589+0000 7f24e4ff9700 1 -- 172.21.15.179:0/1493323671 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f24dc020060 con 0x7f24e80cdb40 2023-12-07T00:13:52.659 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:52.660+0000 7f8a70862200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-07T00:13:52.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.670+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24e8075140 con 0x7f24e80cdb40 2023-12-07T00:13:52.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.671+0000 7f24e4ff9700 1 -- 172.21.15.179:0/1493323671 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f24dc017070 con 0x7f24e80cdb40 2023-12-07T00:13:52.670 INFO:teuthology.misc.health.smithi179.stdout: 2023-12-07T00:13:52.670 INFO:teuthology.misc.health.smithi179.stdout:{"epoch":10,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:13:51.362700+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e80cdb40 msgr2=0x7f24e81d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e80cdb40 0x7f24e81d2660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00c490 tx=0x7f24dc00c7a0 comp rx=0 tx=0).stop 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 shutdown_connections 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f24e80d1310 0x7f24e81d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f24e80cca80 0x7f24e809ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 --2- 172.21.15.179:0/1493323671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f24e80cdb40 0x7f24e81d2660 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 >> 172.21.15.179:0/1493323671 conn(0x7f24e8099a40 msgr2=0x7f24e81e50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 shutdown_connections 2023-12-07T00:13:52.673 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:52.672+0000 7f24ee667700 1 -- 172.21.15.179:0/1493323671 wait complete. 2023-12-07T00:13:52.682 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-07T00:13:52.750 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:52.751+0000 7f087d362200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-07T00:13:52.792 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:52.793+0000 7f8a70862200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-07T00:13:52.885 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:52.886+0000 7f087d362200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-07T00:13:53.013 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:53.014+0000 7f8a70862200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-07T00:13:53.101 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:53.102+0000 7f087d362200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-07T00:13:53.169 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:53.170+0000 7f8a70862200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-07T00:13:53.258 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:53.259+0000 7f087d362200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-07T00:13:53.282 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:53.283+0000 7f8a70862200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-07T00:13:53.373 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:53.374+0000 7f087d362200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-07T00:13:53.608 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:53.609+0000 7f8a70862200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-07T00:13:53.698 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:53.699+0000 7f087d362200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-07T00:13:53.709 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:53.710+0000 7f8a70862200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-07T00:13:53.796 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:53.797+0000 7f087d362200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-07T00:13:53.894 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:53.895+0000 7f8a70862200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-07T00:13:53.983 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:53.984+0000 7f087d362200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-07T00:13:54.487 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:54.488+0000 7f8a70862200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-07T00:13:54.588 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-12-07T00:13:54.590+0000 7f087d362200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-07T00:13:55.512 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:55.513+0000 7f8a287b7700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-07T00:13:55.513 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T00:13:55.514+0000 7f8a287b7700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-07T00:13:55.534 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T00:13:55.536+0000 7fc7dea29640 -1 osd.7 0 log_to_monitors true 2023-12-07T00:13:55.559 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T00:13:55.560+0000 7fe9d8da5640 -1 osd.4 0 log_to_monitors true 2023-12-07T00:13:55.566 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T00:13:55.567+0000 7ff60158e640 -1 osd.1 0 log_to_monitors true 2023-12-07T00:13:55.580 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T00:13:55.581+0000 7f4e029ab640 -1 osd.3 0 log_to_monitors true 2023-12-07T00:13:55.582 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T00:13:55.583+0000 7fd303411640 -1 osd.2 0 log_to_monitors true 2023-12-07T00:13:55.583 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T00:13:55.585+0000 7ff4b8dfe640 -1 osd.5 0 log_to_monitors true 2023-12-07T00:13:55.591 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T00:13:55.592+0000 7f918ae55640 -1 osd.0 0 log_to_monitors true 2023-12-07T00:13:55.597 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T00:13:55.598+0000 7fc4bff4a640 -1 osd.6 0 log_to_monitors true 2023-12-07T00:13:59.490 DEBUG:teuthology.orchestra.run.smithi179:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T00:13:59.502 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T00:13:59.503+0000 7fc4b4302700 -1 osd.6 0 waiting for initial osdmap 2023-12-07T00:13:59.514 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T00:13:59.515+0000 7ff4ad1b6700 -1 osd.5 0 waiting for initial osdmap 2023-12-07T00:13:59.522 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T00:13:59.522+0000 7fc4abee1700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T00:13:59.526 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T00:13:59.527+0000 7ff5f5946700 -1 osd.1 0 waiting for initial osdmap 2023-12-07T00:13:59.527 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T00:13:59.528+0000 7f4df6d63700 -1 osd.3 0 waiting for initial osdmap 2023-12-07T00:13:59.529 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T00:13:59.531+0000 7ff4a4d95700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T00:13:59.534 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T00:13:59.536+0000 7ff5ed525700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T00:13:59.535 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T00:13:59.536+0000 7fe9cd15d700 -1 osd.4 0 waiting for initial osdmap 2023-12-07T00:13:59.538 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T00:13:59.539+0000 7fc7d2de1700 -1 osd.7 0 waiting for initial osdmap 2023-12-07T00:13:59.545 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T00:13:59.546+0000 7fe9c4d3c700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T00:13:59.548 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T00:13:59.549+0000 7f917f20d700 -1 osd.0 0 waiting for initial osdmap 2023-12-07T00:13:59.549 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T00:13:59.551+0000 7fc7ca9c0700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T00:13:59.555 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T00:13:59.555+0000 7f4dee942700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T00:13:59.565 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T00:13:59.566+0000 7f9176dec700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T00:13:59.666 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.667+0000 7fc270cd5700 1 Processor -- start 2023-12-07T00:13:59.666 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.667+0000 7fc270cd5700 1 -- start start 2023-12-07T00:13:59.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc270cd5700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc26c0d1570 0x7fc26c0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:59.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc270cd5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c06fac0 0x7fc26c06af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:59.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc270cd5700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc26c0afb80 0x7fc26c06b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:59.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc270cd5700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c0cf3e0 con 0x7fc26c0d1570 2023-12-07T00:13:59.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc270cd5700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26c0cdd00 con 0x7fc26c0afb80 2023-12-07T00:13:59.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc270cd5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c0cd050 con 0x7fc26c06fac0 2023-12-07T00:13:59.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26a59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc26c0d1570 0x7fc26c0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:59.669 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26a59c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc26c0d1570 0x7fc26c0ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38316/0 (socket says 172.21.15.179:38316) 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26a59c700 1 -- 172.21.15.179:0/1123557311 learned_addr learned my addr 172.21.15.179:0/1123557311 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc269d9b700 1 --2- 172.21.15.179:0/1123557311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c06fac0 0x7fc26c06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26ad9d700 1 --2- 172.21.15.179:0/1123557311 >> v2:172.21.15.190:3300/0 conn(0x7fc26c0afb80 0x7fc26c06b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26a59c700 1 -- 172.21.15.179:0/1123557311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c06fac0 msgr2=0x7fc26c06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26a59c700 1 --2- 172.21.15.179:0/1123557311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c06fac0 0x7fc26c06af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26a59c700 1 -- 172.21.15.179:0/1123557311 >> v2:172.21.15.190:3300/0 conn(0x7fc26c0afb80 msgr2=0x7fc26c06b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26a59c700 1 --2- 172.21.15.179:0/1123557311 >> v2:172.21.15.190:3300/0 conn(0x7fc26c0afb80 0x7fc26c06b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.668+0000 7fc26a59c700 1 -- 172.21.15.179:0/1123557311 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c06ea20 con 0x7fc26c0d1570 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc26a59c700 1 --2- 172.21.15.179:0/1123557311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0d1570 0x7fc26c0ccb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0b0410 tx=0x7fc25c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7272ce2b54b198b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc26959a700 1 -- 172.21.15.179:0/1123557311 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c011830 con 0x7fc26c0d1570 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc26959a700 1 -- 172.21.15.179:0/1123557311 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c011990 con 0x7fc26c0d1570 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc26959a700 1 -- 172.21.15.179:0/1123557311 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c011d20 con 0x7fc26c0d1570 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 -- 172.21.15.179:0/1123557311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0d1570 msgr2=0x7fc26c0ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:59.670 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 --2- 172.21.15.179:0/1123557311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0d1570 0x7fc26c0ccb10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0b0410 tx=0x7fc25c009c00 comp rx=0 tx=0).stop 2023-12-07T00:13:59.671 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 -- 172.21.15.179:0/1123557311 shutdown_connections 2023-12-07T00:13:59.671 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 --2- 172.21.15.179:0/1123557311 >> v2:172.21.15.190:3300/0 conn(0x7fc26c0afb80 0x7fc26c06b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.671 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 --2- 172.21.15.179:0/1123557311 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0d1570 0x7fc26c0ccb10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.671 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 --2- 172.21.15.179:0/1123557311 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c06fac0 0x7fc26c06af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.671 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 -- 172.21.15.179:0/1123557311 >> 172.21.15.179:0/1123557311 conn(0x7fc26c099a40 msgr2=0x7fc26c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:59.671 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 -- 172.21.15.179:0/1123557311 shutdown_connections 2023-12-07T00:13:59.671 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.669+0000 7fc270cd5700 1 -- 172.21.15.179:0/1123557311 wait complete. 2023-12-07T00:13:59.674 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.671+0000 7fc270cd5700 1 Processor -- start 2023-12-07T00:13:59.674 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.671+0000 7fc270cd5700 1 -- start start 2023-12-07T00:13:59.674 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.671+0000 7fc270cd5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc26c06fac0 0x7fc26c0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:59.674 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc270cd5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0afb80 0x7fc26c1f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:59.674 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc270cd5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c0d1570 0x7fc26c157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc270cd5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c1f8190 con 0x7fc26c0afb80 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc270cd5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c157df0 con 0x7fc26c06fac0 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc270cd5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26c1f7bd0 con 0x7fc26c0d1570 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0afb80 0x7fc26c1f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0afb80 0x7fc26c1f7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38324/0 (socket says 172.21.15.179:38324) 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 -- 172.21.15.179:0/3588620424 learned_addr learned my addr 172.21.15.179:0/3588620424 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc26a59c700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc26c06fac0 0x7fc26c0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc26ad9d700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c0d1570 0x7fc26c157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 -- 172.21.15.179:0/3588620424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c0d1570 msgr2=0x7fc26c157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c0d1570 0x7fc26c157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 -- 172.21.15.179:0/3588620424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc26c06fac0 msgr2=0x7fc26c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc26c06fac0 0x7fc26c0c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 -- 172.21.15.179:0/3588620424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25c009550 con 0x7fc26c0afb80 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc269d9b700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0afb80 0x7fc26c1f7260 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc26000e900 tx=0x7fc26000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:59.675 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc25affd700 1 -- 172.21.15.179:0/3588620424 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000ee50 con 0x7fc26c0afb80 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc25affd700 1 -- 172.21.15.179:0/3588620424 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26000c850 con 0x7fc26c0afb80 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26c1f7eb0 con 0x7fc26c0afb80 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc25affd700 1 -- 172.21.15.179:0/3588620424 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26000cbe0 con 0x7fc26c0afb80 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.672+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26c0c4880 con 0x7fc26c0afb80 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.673+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc26c0c4a10 con 0x7fc26c0afb80 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.674+0000 7fc25affd700 1 -- 172.21.15.179:0/3588620424 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fc26000cd40 con 0x7fc26c0afb80 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.674+0000 7fc25affd700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc24c06ae40 0x7fc24c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.674+0000 7fc25affd700 1 -- 172.21.15.179:0/3588620424 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fc260088340 con 0x7fc26c0afb80 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.674+0000 7fc26a59c700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc24c06ae40 0x7fc24c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:13:59.676 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.675+0000 7fc26a59c700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc24c06ae40 0x7fc24c06d300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc25c014040 tx=0x7fc25c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:13:59.679 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.680+0000 7fc25affd700 1 -- 172.21.15.179:0/3588620424 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc260054270 con 0x7fc26c0afb80 2023-12-07T00:13:59.881 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T00:13:59.882+0000 7fd2f77c9700 -1 osd.2 0 waiting for initial osdmap 2023-12-07T00:13:59.902 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T00:13:59.903+0000 7fd2ef3a8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-07T00:13:59.912 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.913+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc26c075140 con 0x7fc26c0afb80 2023-12-07T00:13:59.912 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.913+0000 7fc25affd700 1 -- 172.21.15.179:0/3588620424 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc260057890 con 0x7fc26c0afb80 2023-12-07T00:13:59.912 INFO:teuthology.misc.health.smithi179.stdout: 2023-12-07T00:13:59.913 INFO:teuthology.misc.health.smithi179.stdout:{"epoch":12,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:13:57.509689+0000","last_up_change":"0.000000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc24c06ae40 msgr2=0x7fc24c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc24c06ae40 0x7fc24c06d300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc25c014040 tx=0x7fc25c008030 comp rx=0 tx=0).stop 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0afb80 msgr2=0x7fc26c1f7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0afb80 0x7fc26c1f7260 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc26000e900 tx=0x7fc26000ec10 comp rx=0 tx=0).stop 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 shutdown_connections 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc24c06ae40 0x7fc24c06d300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc26c0d1570 0x7fc26c157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc26c06fac0 0x7fc26c0c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 --2- 172.21.15.179:0/3588620424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc26c0afb80 0x7fc26c1f7260 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:13:59.915 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 >> 172.21.15.179:0/3588620424 conn(0x7fc26c099a40 msgr2=0x7fc26c160e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:13:59.916 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 shutdown_connections 2023-12-07T00:13:59.916 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:13:59.915+0000 7fc270cd5700 1 -- 172.21.15.179:0/3588620424 wait complete. 2023-12-07T00:13:59.926 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-07T00:14:06.734 DEBUG:teuthology.orchestra.run.smithi179:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:06.853 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.854+0000 7f8b587c9700 1 Processor -- start 2023-12-07T00:14:06.854 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.854+0000 7f8b587c9700 1 -- start start 2023-12-07T00:14:06.856 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b587c9700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b500d1310 0x7f8b5006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:06.856 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b587c9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cca80 0x7f8b5006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:06.856 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b587c9700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5006e980 con 0x7f8b500cdb40 2023-12-07T00:14:06.856 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b587c9700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5006ec60 con 0x7f8b500d1310 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b587c9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5006ef40 con 0x7f8b500cca80 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b56565700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b500d1310 0x7f8b5006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b56565700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8b500d1310 0x7f8b5006af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38552/0 (socket says 172.21.15.179:38552) 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b56565700 1 -- 172.21.15.179:0/1865597098 learned_addr learned my addr 172.21.15.179:0/1865597098 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.855+0000 7f8b56d66700 1 --2- 172.21.15.179:0/1865597098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cca80 0x7f8b5006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b56565700 1 -- 172.21.15.179:0/1865597098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cca80 msgr2=0x7f8b5006b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b56565700 1 --2- 172.21.15.179:0/1865597098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cca80 0x7f8b5006b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b56565700 1 -- 172.21.15.179:0/1865597098 >> v1:172.21.15.190:6789/0 conn(0x7f8b500cdb40 legacy=0x7f8b5015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b56565700 1 -- 172.21.15.179:0/1865597098 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5006f220 con 0x7f8b500d1310 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b56565700 1 --2- 172.21.15.179:0/1865597098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b5006af70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8b400098f0 tx=0x7f8b40009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a70c1f157d807ad server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b55563700 1 -- 172.21.15.179:0/1865597098 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000b8a0 con 0x7f8b500d1310 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b55563700 1 -- 172.21.15.179:0/1865597098 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4000ba00 con 0x7f8b500d1310 2023-12-07T00:14:06.857 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b55563700 1 -- 172.21.15.179:0/1865597098 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000bd90 con 0x7f8b500d1310 2023-12-07T00:14:06.858 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b587c9700 1 -- 172.21.15.179:0/1865597098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 msgr2=0x7f8b5006af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:06.858 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b587c9700 1 --2- 172.21.15.179:0/1865597098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b5006af70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8b400098f0 tx=0x7f8b40009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:06.858 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b587c9700 1 -- 172.21.15.179:0/1865597098 shutdown_connections 2023-12-07T00:14:06.858 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b587c9700 1 --2- 172.21.15.179:0/1865597098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cca80 0x7f8b5006b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:06.858 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b587c9700 1 --2- 172.21.15.179:0/1865597098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b5006af70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:06.858 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.856+0000 7f8b587c9700 1 -- 172.21.15.179:0/1865597098 >> 172.21.15.179:0/1865597098 conn(0x7f8b50099a40 msgr2=0x7f8b50099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:06.858 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.857+0000 7f8b587c9700 1 -- 172.21.15.179:0/1865597098 shutdown_connections 2023-12-07T00:14:06.858 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.857+0000 7f8b587c9700 1 -- 172.21.15.179:0/1865597098 wait complete. 2023-12-07T00:14:06.861 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.858+0000 7f8b587c9700 1 Processor -- start 2023-12-07T00:14:06.861 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.858+0000 7f8b587c9700 1 -- start start 2023-12-07T00:14:06.861 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.858+0000 7f8b587c9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b500cca80 0x7f8b50162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:06.861 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.858+0000 7f8b587c9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cdb40 0x7f8b50155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.858+0000 7f8b587c9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b500b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.858+0000 7f8b587c9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5009d4e0 con 0x7f8b500d1310 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.858+0000 7f8b587c9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5009e060 con 0x7f8b500cca80 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.858+0000 7f8b587c9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50160730 con 0x7f8b500cdb40 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b500b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b500b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38562/0 (socket says 172.21.15.179:38562) 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 -- 172.21.15.179:0/2220737264 learned_addr learned my addr 172.21.15.179:0/2220737264 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56565700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b500cca80 0x7f8b50162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b55d64700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cdb40 0x7f8b50155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:06.862 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 -- 172.21.15.179:0/2220737264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cdb40 msgr2=0x7f8b50155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:06.863 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cdb40 0x7f8b50155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:06.863 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 -- 172.21.15.179:0/2220737264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b500cca80 msgr2=0x7f8b50162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:06.863 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b500cca80 0x7f8b50162190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:06.863 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 -- 172.21.15.179:0/2220737264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40009550 con 0x7f8b500d1310 2023-12-07T00:14:06.863 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b56d66700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b500b2560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8b48007e70 tx=0x7f8b4800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:06.863 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b46ffd700 1 -- 172.21.15.179:0/2220737264 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800ed30 con 0x7f8b500d1310 2023-12-07T00:14:06.863 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b46ffd700 1 -- 172.21.15.179:0/2220737264 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800eeb0 con 0x7f8b500d1310 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5009d730 con 0x7f8b500d1310 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b46ffd700 1 -- 172.21.15.179:0/2220737264 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48014640 con 0x7f8b500d1310 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.859+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5009dcf0 con 0x7f8b500d1310 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.860+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5009e1f0 con 0x7f8b500d1310 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.860+0000 7f8b46ffd700 1 -- 172.21.15.179:0/2220737264 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b480147a0 con 0x7f8b500d1310 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.861+0000 7f8b46ffd700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b3406aed0 0x7f8b3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.861+0000 7f8b46ffd700 1 -- 172.21.15.179:0/2220737264 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8b480898e0 con 0x7f8b500d1310 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.861+0000 7f8b56565700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b3406aed0 0x7f8b3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:06.864 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.861+0000 7f8b56565700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b3406aed0 0x7f8b3406d390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b40014040 tx=0x7f8b40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:06.865 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:06.866+0000 7f8b46ffd700 1 -- 172.21.15.179:0/2220737264 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b48054ce0 con 0x7f8b500d1310 2023-12-07T00:14:07.054 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.054+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b50075140 con 0x7f8b500d1310 2023-12-07T00:14:07.054 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.055+0000 7f8b46ffd700 1 -- 172.21.15.179:0/2220737264 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f8b48058300 con 0x7f8b500d1310 2023-12-07T00:14:07.055 INFO:teuthology.misc.health.smithi179.stdout: 2023-12-07T00:14:07.055 INFO:teuthology.misc.health.smithi179.stdout:{"epoch":18,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:05.602914+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:07.057 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b3406aed0 msgr2=0x7f8b3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.057 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b3406aed0 0x7f8b3406d390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b40014040 tx=0x7f8b40008030 comp rx=0 tx=0).stop 2023-12-07T00:14:07.057 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 msgr2=0x7f8b500b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.057 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b500b2560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8b48007e70 tx=0x7f8b4800e3c0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.057 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 shutdown_connections 2023-12-07T00:14:07.058 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b3406aed0 0x7f8b3406d390 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.058 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8b500d1310 0x7f8b500b2560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.058 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b500cca80 0x7f8b50162190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.058 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 --2- 172.21.15.179:0/2220737264 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b500cdb40 0x7f8b50155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.058 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 >> 172.21.15.179:0/2220737264 conn(0x7f8b50099a40 msgr2=0x7f8b500ad780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:07.058 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 shutdown_connections 2023-12-07T00:14:07.058 INFO:teuthology.misc.health.smithi179.stderr:2023-12-07T00:14:07.057+0000 7f8b587c9700 1 -- 172.21.15.179:0/2220737264 wait complete. 2023-12-07T00:14:07.068 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-07T00:14:07.068 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-07T00:14:07.068 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-07T00:14:07.068 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-07T00:14:07.070 INFO:tasks.ceph.mds.a:Started 2023-12-07T00:14:07.070 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-07T00:14:07.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-07T00:14:07.072 INFO:tasks.ceph.mds.c:Started 2023-12-07T00:14:07.073 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-07T00:14:07.073 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-07T00:14:07.075 INFO:tasks.ceph.mds.b:Started 2023-12-07T00:14:07.076 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-07T00:14:07.076 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-07T00:14:07.078 INFO:tasks.ceph.mds.d:Started 2023-12-07T00:14:07.078 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-07T00:14:07.078 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:07.150 INFO:tasks.ceph.mds.c.smithi179.stdout:starting mds.c at 2023-12-07T00:14:07.150 INFO:tasks.ceph.mds.a.smithi179.stdout:starting mds.a at 2023-12-07T00:14:07.165 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-12-07T00:14:07.166 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-12-07T00:14:07.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.207+0000 7face6881700 1 Processor -- start 2023-12-07T00:14:07.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.207+0000 7face6881700 1 -- start start 2023-12-07T00:14:07.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.207+0000 7face6881700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7face00d06b0 0x7face0099c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.207+0000 7face6881700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7face009a140 0x7face00b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.207+0000 7face6881700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face009a550 con 0x7face015bde0 2023-12-07T00:14:07.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.207+0000 7face6881700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face009ab50 con 0x7face00d06b0 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.207+0000 7face6881700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face00cf630 con 0x7face009a140 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.207+0000 7facdf7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7face00d06b0 0x7face0099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdf7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7face00d06b0 0x7face0099c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38594/0 (socket says 172.21.15.179:38594) 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdf7fe700 1 -- 172.21.15.179:0/4030669 learned_addr learned my addr 172.21.15.179:0/4030669 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7face4e1e700 1 --2- 172.21.15.179:0/4030669 >> v2:172.21.15.190:3300/0 conn(0x7face009a140 0x7face00b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdf7fe700 1 -- 172.21.15.179:0/4030669 >> v2:172.21.15.190:3300/0 conn(0x7face009a140 msgr2=0x7face00b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdf7fe700 1 --2- 172.21.15.179:0/4030669 >> v2:172.21.15.190:3300/0 conn(0x7face009a140 0x7face00b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdf7fe700 1 -- 172.21.15.179:0/4030669 >> v1:172.21.15.190:6789/0 conn(0x7face015bde0 legacy=0x7face00cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdf7fe700 1 -- 172.21.15.179:0/4030669 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face00cf8f0 con 0x7face00d06b0 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7face4e1e700 1 --2- 172.21.15.179:0/4030669 >> v2:172.21.15.190:3300/0 conn(0x7face009a140 0x7face00b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdf7fe700 1 --2- 172.21.15.179:0/4030669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face0099c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7face00723f0 tx=0x7facd4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c13d11fa1d991b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdeffd700 1 -- 172.21.15.179:0/4030669 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4004230 con 0x7face00d06b0 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdeffd700 1 -- 172.21.15.179:0/4030669 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd4004390 con 0x7face00d06b0 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.208+0000 7facdeffd700 1 -- 172.21.15.179:0/4030669 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40036a0 con 0x7face00d06b0 2023-12-07T00:14:07.209 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.209+0000 7face6881700 1 -- 172.21.15.179:0/4030669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 msgr2=0x7face0099c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.209+0000 7face6881700 1 --2- 172.21.15.179:0/4030669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face0099c00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7face00723f0 tx=0x7facd4009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.209+0000 7face6881700 1 -- 172.21.15.179:0/4030669 shutdown_connections 2023-12-07T00:14:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.209+0000 7face6881700 1 --2- 172.21.15.179:0/4030669 >> v2:172.21.15.190:3300/0 conn(0x7face009a140 0x7face00b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.209+0000 7face6881700 1 --2- 172.21.15.179:0/4030669 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face0099c00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.209+0000 7face6881700 1 -- 172.21.15.179:0/4030669 >> 172.21.15.179:0/4030669 conn(0x7face00b3550 msgr2=0x7face00b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.209+0000 7face6881700 1 -- 172.21.15.179:0/4030669 shutdown_connections 2023-12-07T00:14:07.210 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.209+0000 7face6881700 1 -- 172.21.15.179:0/4030669 wait complete. 2023-12-07T00:14:07.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.210+0000 7face6881700 1 Processor -- start 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.210+0000 7face6881700 1 -- start start 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face6881700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7face009a140 0x7face015e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face6881700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face006d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face6881700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7face015bde0 0x7face0146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face6881700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face00b76d0 con 0x7face00d06b0 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face6881700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face01f38d0 con 0x7face015bde0 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face6881700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face00b4820 con 0x7face009a140 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face006d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face006d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38600/0 (socket says 172.21.15.179:38600) 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 -- 172.21.15.179:0/4281921186 learned_addr learned my addr 172.21.15.179:0/4281921186 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdffff700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7face009a140 0x7face015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face4e1e700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7face015bde0 0x7face0146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 -- 172.21.15.179:0/4281921186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7face009a140 msgr2=0x7face015e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7face009a140 0x7face015e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 -- 172.21.15.179:0/4281921186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7face015bde0 msgr2=0x7face0146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7face015bde0 0x7face0146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 -- 172.21.15.179:0/4281921186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009550 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdf7fe700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face006d290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7face00732c0 tx=0x7facd4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdcff9700 1 -- 172.21.15.179:0/4281921186 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4003ea0 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdcff9700 1 -- 172.21.15.179:0/4281921186 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd4011630 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face00b4b00 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7facdcff9700 1 -- 172.21.15.179:0/4281921186 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40119e0 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.211+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face006cd70 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.212+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face00b4c90 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.213+0000 7facdcff9700 1 -- 172.21.15.179:0/4281921186 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7facd4011b40 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.213+0000 7facdcff9700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faccc06aed0 0x7faccc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.213+0000 7facdcff9700 1 -- 172.21.15.179:0/4281921186 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7facd408a840 con 0x7face00d06b0 2023-12-07T00:14:07.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.213+0000 7facdffff700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faccc06aed0 0x7faccc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.215 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.214+0000 7facdffff700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faccc06aed0 0x7faccc06d390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7facd0007fd0 tx=0x7facd0007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.218+0000 7facdcff9700 1 -- 172.21.15.179:0/4281921186 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7facd4055d50 con 0x7face00d06b0 2023-12-07T00:14:07.407 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.408+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7face00685f0 con 0x7face00d06b0 2023-12-07T00:14:07.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.409+0000 7facdcff9700 1 -- 172.21.15.179:0/4281921186 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12862 (secure 0 0 0) 0x7facd4059370 con 0x7face00d06b0 2023-12-07T00:14:07.408 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:07.409 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":18,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:05.602914+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faccc06aed0 msgr2=0x7faccc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faccc06aed0 0x7faccc06d390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7facd0007fd0 tx=0x7facd0007ec0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 msgr2=0x7face006d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face006d290 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7face00732c0 tx=0x7facd4004750 comp rx=0 tx=0).stop 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 shutdown_connections 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faccc06aed0 0x7faccc06d390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7face015bde0 0x7face0146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7face009a140 0x7face015e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 --2- 172.21.15.179:0/4281921186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7face00d06b0 0x7face006d290 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 >> 172.21.15.179:0/4281921186 conn(0x7face00b3550 msgr2=0x7face00ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:07.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 shutdown_connections 2023-12-07T00:14:07.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.411+0000 7face6881700 1 -- 172.21.15.179:0/4281921186 wait complete. 2023-12-07T00:14:07.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T00:14:07.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:07.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.547+0000 7f4745f19700 1 Processor -- start 2023-12-07T00:14:07.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.547+0000 7f4745f19700 1 -- start start 2023-12-07T00:14:07.548 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f4745f19700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f47400ce770 0x7f4740070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f4745f19700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f474006f960 con 0x7f47400d0ed0 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f4745f19700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47400cf110 con 0x7f474015ab70 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f4745f19700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474015af50 con 0x7f47400ce770 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473ffff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f47400d0ed0 0x7f47400adb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45512/0 (socket says 172.21.15.179:45512) 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473ffff700 1 -- 172.21.15.179:0/289603680 learned_addr learned my addr 172.21.15.179:0/289603680 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473effd700 1 --2- 172.21.15.179:0/289603680 >> v2:172.21.15.190:3300/0 conn(0x7f47400ce770 0x7f4740070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473e7fc700 1 -- 172.21.15.179:0/289603680 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650341373 0 0) 0x7f474006f960 con 0x7f47400d0ed0 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473e7fc700 1 -- 172.21.15.179:0/289603680 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47240035b0 con 0x7f47400d0ed0 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473effd700 1 -- 172.21.15.179:0/289603680 >> v1:172.21.15.190:6789/0 conn(0x7f474015ab70 legacy=0x7f47400d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473effd700 1 -- 172.21.15.179:0/289603680 >> v1:172.21.15.179:6789/0 conn(0x7f47400d0ed0 legacy=0x7f47400adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473e7fc700 1 -- 172.21.15.179:0/289603680 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1415343173 0 0) 0x7f47240035b0 con 0x7f47400d0ed0 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.548+0000 7f473effd700 1 -- 172.21.15.179:0/289603680 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47400cf3f0 con 0x7f47400ce770 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f473effd700 1 --2- 172.21.15.179:0/289603680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 0x7f4740070880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4730009840 tx=0x7f4730009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73147bf0bf832e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f473e7fc700 1 -- 172.21.15.179:0/289603680 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011830 con 0x7f47400ce770 2023-12-07T00:14:07.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f473e7fc700 1 -- 172.21.15.179:0/289603680 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730011990 con 0x7f47400ce770 2023-12-07T00:14:07.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f473e7fc700 1 -- 172.21.15.179:0/289603680 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011d00 con 0x7f47400ce770 2023-12-07T00:14:07.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f4745f19700 1 -- 172.21.15.179:0/289603680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 msgr2=0x7f4740070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f4745f19700 1 --2- 172.21.15.179:0/289603680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 0x7f4740070880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4730009840 tx=0x7f4730009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:07.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f4745f19700 1 -- 172.21.15.179:0/289603680 shutdown_connections 2023-12-07T00:14:07.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f4745f19700 1 --2- 172.21.15.179:0/289603680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 0x7f4740070880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f4745f19700 1 -- 172.21.15.179:0/289603680 >> 172.21.15.179:0/289603680 conn(0x7f4740099a40 msgr2=0x7f4740099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:07.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f4745f19700 1 -- 172.21.15.179:0/289603680 shutdown_connections 2023-12-07T00:14:07.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.549+0000 7f4745f19700 1 -- 172.21.15.179:0/289603680 wait complete. 2023-12-07T00:14:07.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.550+0000 7f4745f19700 1 Processor -- start 2023-12-07T00:14:07.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f4745f19700 1 -- start start 2023-12-07T00:14:07.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f4745f19700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 0x7f474014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f4745f19700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47400d0ed0 0x7f47400c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f4745f19700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f474015ab70 0x7f47400cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f4745f19700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474006fc40 con 0x7f474015ab70 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f4745f19700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400caf00 con 0x7f47400ce770 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f4745f19700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474014d0f0 con 0x7f47400d0ed0 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f473ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f474015ab70 0x7f47400cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f473ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f474015ab70 0x7f47400cd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38616/0 (socket says 172.21.15.179:38616) 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f473ffff700 1 -- 172.21.15.179:0/241373112 learned_addr learned my addr 172.21.15.179:0/241373112 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f473f7fe700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 0x7f474014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.551+0000 7f473effd700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47400d0ed0 0x7f47400c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f473ffff700 1 -- 172.21.15.179:0/241373112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47400d0ed0 msgr2=0x7f47400c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f473ffff700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47400d0ed0 0x7f47400c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f473ffff700 1 -- 172.21.15.179:0/241373112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 msgr2=0x7f474014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f473ffff700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 0x7f474014cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f473ffff700 1 -- 172.21.15.179:0/241373112 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300094a0 con 0x7f474015ab70 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f473ffff700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f474015ab70 0x7f47400cd510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f473800caf0 tx=0x7f473800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f4737fff700 1 -- 172.21.15.179:0/241373112 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473800a9e0 con 0x7f474015ab70 2023-12-07T00:14:07.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f4737fff700 1 -- 172.21.15.179:0/241373112 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473800ab40 con 0x7f474015ab70 2023-12-07T00:14:07.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47400c9fd0 con 0x7f474015ab70 2023-12-07T00:14:07.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f4737fff700 1 -- 172.21.15.179:0/241373112 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738012400 con 0x7f474015ab70 2023-12-07T00:14:07.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.552+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47400ca560 con 0x7f474015ab70 2023-12-07T00:14:07.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.553+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f474015e350 con 0x7f474015ab70 2023-12-07T00:14:07.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.554+0000 7f4737fff700 1 -- 172.21.15.179:0/241373112 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4738012560 con 0x7f474015ab70 2023-12-07T00:14:07.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.554+0000 7f4737fff700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f472806aed0 0x7f472806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.554+0000 7f4737fff700 1 -- 172.21.15.179:0/241373112 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f47380895d0 con 0x7f474015ab70 2023-12-07T00:14:07.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.554+0000 7f473f7fe700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f472806aed0 0x7f472806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.554+0000 7f473f7fe700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f472806aed0 0x7f472806d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f472c007fd0 tx=0x7f472c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.559+0000 7f4737fff700 1 -- 172.21.15.179:0/241373112 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47380548c0 con 0x7f474015ab70 2023-12-07T00:14:07.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.748+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47400685f0 con 0x7f474015ab70 2023-12-07T00:14:07.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.748+0000 7f4737fff700 1 -- 172.21.15.179:0/241373112 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4738057ee0 con 0x7f474015ab70 2023-12-07T00:14:07.748 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:07.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f472806aed0 msgr2=0x7f472806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f472806aed0 0x7f472806d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f472c007fd0 tx=0x7f472c009040 comp rx=0 tx=0).stop 2023-12-07T00:14:07.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f474015ab70 msgr2=0x7f47400cd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f474015ab70 0x7f47400cd510 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f473800caf0 tx=0x7f473800ce00 comp rx=0 tx=0).stop 2023-12-07T00:14:07.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 shutdown_connections 2023-12-07T00:14:07.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f472806aed0 0x7f472806d390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f474015ab70 0x7f47400cd510 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f47400ce770 0x7f474014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 --2- 172.21.15.179:0/241373112 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f47400d0ed0 0x7f47400c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 >> 172.21.15.179:0/241373112 conn(0x7f4740099a40 msgr2=0x7f47400b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:07.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 shutdown_connections 2023-12-07T00:14:07.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.751+0000 7f4745f19700 1 -- 172.21.15.179:0/241373112 wait complete. 2023-12-07T00:14:07.762 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:14:07.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.882+0000 7fa6c43bc700 1 Processor -- start 2023-12-07T00:14:07.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.882+0000 7fa6c43bc700 1 -- start start 2023-12-07T00:14:07.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.883+0000 7fa6c43bc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa6bc0b4470 0x7fa6bc0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.883+0000 7fa6c43bc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.883+0000 7fa6c43bc700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6bc15b8d0 con 0x7fa6bc158560 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.883+0000 7fa6c43bc700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6bc0b2f10 con 0x7fa6bc0b4470 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.883+0000 7fa6c43bc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc15bbb0 con 0x7fa6bc0b2aa0 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c2959700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c1957700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa6bc0b4470 0x7fa6bc0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c1957700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa6bc0b4470 0x7fa6bc0b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:40874/0 (socket says 172.21.15.179:40874) 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c1957700 1 -- 172.21.15.179:0/1002298414 learned_addr learned my addr 172.21.15.179:0/1002298414 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c2959700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc0cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39036/0 (socket says 172.21.15.179:39036) 2023-12-07T00:14:07.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c2158700 1 --1- 172.21.15.179:0/1002298414 >> v1:172.21.15.190:6789/0 conn(0x7fa6bc158560 0x7fa6bc15b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:52200/0 (socket says 172.21.15.179:52200) 2023-12-07T00:14:07.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c2959700 1 -- 172.21.15.179:0/1002298414 >> v2:172.21.15.190:3300/0 conn(0x7fa6bc0b4470 msgr2=0x7fa6bc0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:07.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c2959700 1 --2- 172.21.15.179:0/1002298414 >> v2:172.21.15.190:3300/0 conn(0x7fa6bc0b4470 0x7fa6bc0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c2959700 1 -- 172.21.15.179:0/1002298414 >> v1:172.21.15.190:6789/0 conn(0x7fa6bc158560 legacy=0x7fa6bc15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c2959700 1 -- 172.21.15.179:0/1002298414 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6bc15be90 con 0x7fa6bc0b2aa0 2023-12-07T00:14:07.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c1957700 1 --2- 172.21.15.179:0/1002298414 >> v2:172.21.15.190:3300/0 conn(0x7fa6bc0b4470 0x7fa6bc0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c2959700 1 --2- 172.21.15.179:0/1002298414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc0cf3e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009d90 tx=0x7fa6b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=105c3094e7829c81 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c1156700 1 -- 172.21.15.179:0/1002298414 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b400e070 con 0x7fa6bc0b2aa0 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c1156700 1 -- 172.21.15.179:0/1002298414 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b400bb20 con 0x7fa6bc0b2aa0 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.884+0000 7fa6c1156700 1 -- 172.21.15.179:0/1002298414 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4012430 con 0x7fa6bc0b2aa0 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.885+0000 7fa6c43bc700 1 -- 172.21.15.179:0/1002298414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 msgr2=0x7fa6bc0cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.885+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/1002298414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc0cf3e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4009d90 tx=0x7fa6b400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.885+0000 7fa6c43bc700 1 -- 172.21.15.179:0/1002298414 shutdown_connections 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.885+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/1002298414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc0cf3e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.885+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/1002298414 >> v2:172.21.15.190:3300/0 conn(0x7fa6bc0b4470 0x7fa6bc0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.885+0000 7fa6c43bc700 1 -- 172.21.15.179:0/1002298414 >> 172.21.15.179:0/1002298414 conn(0x7fa6bc072970 msgr2=0x7fa6bc072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.885+0000 7fa6c43bc700 1 -- 172.21.15.179:0/1002298414 shutdown_connections 2023-12-07T00:14:07.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.885+0000 7fa6c43bc700 1 -- 172.21.15.179:0/1002298414 wait complete. 2023-12-07T00:14:07.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.886+0000 7fa6c43bc700 1 Processor -- start 2023-12-07T00:14:07.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.886+0000 7fa6c43bc700 1 -- start start 2023-12-07T00:14:07.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c43bc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc13b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c43bc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6bc0b4470 0x7fa6bc13b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c43bc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6bc158560 0x7fa6bc13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c43bc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc14da70 con 0x7fa6bc158560 2023-12-07T00:14:07.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c43bc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc14d420 con 0x7fa6bc0b4470 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c43bc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6bc150080 con 0x7fa6bc0b2aa0 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2959700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6bc158560 0x7fa6bc13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2959700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6bc158560 0x7fa6bc13e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38630/0 (socket says 172.21.15.179:38630) 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2959700 1 -- 172.21.15.179:0/2357658121 learned_addr learned my addr 172.21.15.179:0/2357658121 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2158700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc13b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c1957700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6bc0b4470 0x7fa6bc13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2959700 1 -- 172.21.15.179:0/2357658121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 msgr2=0x7fa6bc13b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2959700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc13b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2959700 1 -- 172.21.15.179:0/2357658121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6bc0b4470 msgr2=0x7fa6bc13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2959700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6bc0b4470 0x7fa6bc13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.887+0000 7fa6c2959700 1 -- 172.21.15.179:0/2357658121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6b800b7a0 con 0x7fa6bc158560 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.888+0000 7fa6c2959700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6bc158560 0x7fa6bc13e320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc15bcf0 tx=0x7fa6b4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.888+0000 7fa6aeffd700 1 -- 172.21.15.179:0/2357658121 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4012430 con 0x7fa6bc158560 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.888+0000 7fa6aeffd700 1 -- 172.21.15.179:0/2357658121 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6b4020070 con 0x7fa6bc158560 2023-12-07T00:14:07.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.888+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b4009a70 con 0x7fa6bc158560 2023-12-07T00:14:07.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.888+0000 7fa6aeffd700 1 -- 172.21.15.179:0/2357658121 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4003ea0 con 0x7fa6bc158560 2023-12-07T00:14:07.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.888+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6bc14fd70 con 0x7fa6bc158560 2023-12-07T00:14:07.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.889+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6bc04f290 con 0x7fa6bc158560 2023-12-07T00:14:07.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.889+0000 7fa6aeffd700 1 -- 172.21.15.179:0/2357658121 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa6b4004040 con 0x7fa6bc158560 2023-12-07T00:14:07.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.890+0000 7fa6aeffd700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa6a006aed0 0x7fa6a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:07.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.890+0000 7fa6aeffd700 1 -- 172.21.15.179:0/2357658121 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa6b4022070 con 0x7fa6bc158560 2023-12-07T00:14:07.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.890+0000 7fa6c2158700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa6a006aed0 0x7fa6a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:07.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.890+0000 7fa6c2158700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa6a006aed0 0x7fa6a006d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0000f60 tx=0x7fa6b0007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:07.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:07.894+0000 7fa6aeffd700 1 -- 172.21.15.179:0/2357658121 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6b4056690 con 0x7fa6bc158560 2023-12-07T00:14:08.125 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.126+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6bc0685f0 con 0x7fa6bc158560 2023-12-07T00:14:08.126 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.127+0000 7fa6aeffd700 1 -- 172.21.15.179:0/2357658121 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fa6b4059cb0 con 0x7fa6bc158560 2023-12-07T00:14:08.126 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:08.126 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-07T00:14:08.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa6a006aed0 msgr2=0x7fa6a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:08.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa6a006aed0 0x7fa6a006d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa6b0000f60 tx=0x7fa6b0007ed0 comp rx=0 tx=0).stop 2023-12-07T00:14:08.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6bc158560 msgr2=0x7fa6bc13e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:08.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6bc158560 0x7fa6bc13e320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc15bcf0 tx=0x7fa6b4004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:08.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 shutdown_connections 2023-12-07T00:14:08.128 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa6a006aed0 0x7fa6a006d390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:08.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa6bc158560 0x7fa6bc13e320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:08.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6bc0b2aa0 0x7fa6bc13b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:08.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 --2- 172.21.15.179:0/2357658121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6bc0b4470 0x7fa6bc13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:08.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 >> 172.21.15.179:0/2357658121 conn(0x7fa6bc072970 msgr2=0x7fa6bc0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:08.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 shutdown_connections 2023-12-07T00:14:08.129 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:08.129+0000 7fa6c43bc700 1 -- 172.21.15.179:0/2357658121 wait complete. 2023-12-07T00:14:08.129 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 2 2023-12-07T00:14:10.141 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:14:10.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.274+0000 7f68d45e2700 1 Processor -- start 2023-12-07T00:14:10.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.274+0000 7f68d45e2700 1 -- start start 2023-12-07T00:14:10.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d45e2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f68cc155ff0 0x7f68cc160250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d45e2700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc06f890 con 0x7f68cc0cdd50 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d45e2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc15fdc0 con 0x7f68cc15c7a0 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d45e2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc15cd30 con 0x7f68cc155ff0 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d1b7d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f68cc0cdd50 0x7f68cc15c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45538/0 (socket says 172.21.15.179:45538) 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d1b7d700 1 -- 172.21.15.179:0/2100523802 learned_addr learned my addr 172.21.15.179:0/2100523802 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d237e700 1 --2- 172.21.15.179:0/2100523802 >> v2:172.21.15.190:3300/0 conn(0x7f68cc155ff0 0x7f68cc160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507007488 0 0) 0x7f68cc06f890 con 0x7f68cc0cdd50 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.275+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b80035b0 con 0x7f68cc0cdd50 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 81149098 0 0) 0x7f68b80035b0 con 0x7f68cc0cdd50 2023-12-07T00:14:10.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 >> v2:172.21.15.190:3300/0 conn(0x7f68cc155ff0 msgr2=0x7f68cc160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:10.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 --2- 172.21.15.179:0/2100523802 >> v2:172.21.15.190:3300/0 conn(0x7f68cc155ff0 0x7f68cc160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 >> v1:172.21.15.190:6789/0 conn(0x7f68cc15c7a0 legacy=0x7f68cc0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc15d010 con 0x7f68cc0cdd50 2023-12-07T00:14:10.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f68c80017f0 con 0x7f68cc0cdd50 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 >> v1:172.21.15.179:6789/0 conn(0x7f68cc0cdd50 legacy=0x7f68cc15c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b8003a00 0x7f68b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68b8004850 0x7f68b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8005210 0x7f68b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc15cd30 con 0x7f68b8003a00 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b800c1b0 con 0x7f68b8004850 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b800c370 con 0x7f68b8005210 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d237e700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b8003a00 0x7f68b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d1b7d700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68b8004850 0x7f68b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d2b7f700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8005210 0x7f68b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d237e700 1 -- 172.21.15.179:0/2100523802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8005210 msgr2=0x7f68b800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:10.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d237e700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8005210 0x7f68b800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d237e700 1 -- 172.21.15.179:0/2100523802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68b8004850 msgr2=0x7f68b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d237e700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68b8004850 0x7f68b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d237e700 1 -- 172.21.15.179:0/2100523802 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80035b0 con 0x7f68b8003a00 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d2b7f700 1 -- 172.21.15.179:0/2100523802 reap_dead start 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d237e700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b8003a00 0x7f68b8003e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009b60 tx=0x7f68b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58da783f7adbf93 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00e6c0 con 0x7f68b8003a00 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc00e820 con 0x7f68b8003a00 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.276+0000 7f68d137c700 1 -- 172.21.15.179:0/2100523802 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00eb90 con 0x7f68b8003a00 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.277+0000 7f68d45e2700 1 -- 172.21.15.179:0/2100523802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b8003a00 msgr2=0x7f68b8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.277+0000 7f68d45e2700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b8003a00 0x7f68b8003e20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009b60 tx=0x7f68b8005880 comp rx=0 tx=0).stop 2023-12-07T00:14:10.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.277+0000 7f68d45e2700 1 -- 172.21.15.179:0/2100523802 shutdown_connections 2023-12-07T00:14:10.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.277+0000 7f68d45e2700 1 --2- 172.21.15.179:0/2100523802 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68b8003a00 0x7f68b8003e20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.277+0000 7f68d45e2700 1 -- 172.21.15.179:0/2100523802 >> 172.21.15.179:0/2100523802 conn(0x7f68cc072970 msgr2=0x7f68cc072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:10.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.277+0000 7f68d45e2700 1 -- 172.21.15.179:0/2100523802 shutdown_connections 2023-12-07T00:14:10.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.277+0000 7f68d45e2700 1 -- 172.21.15.179:0/2100523802 wait complete. 2023-12-07T00:14:10.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.278+0000 7f68d45e2700 1 Processor -- start 2023-12-07T00:14:10.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.278+0000 7f68d45e2700 1 -- start start 2023-12-07T00:14:10.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d45e2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8003a00 0x7f68cc151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d45e2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68cc14f5f0 0x7f68cc156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d45e2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68cc1527e0 0x7f68cc152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d45e2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc159d50 con 0x7f68cc14f5f0 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d45e2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1577e0 con 0x7f68cc1527e0 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d45e2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc1531a0 con 0x7f68b8003a00 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d1b7d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68cc14f5f0 0x7f68cc156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d1b7d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68cc14f5f0 0x7f68cc156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38648/0 (socket says 172.21.15.179:38648) 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d1b7d700 1 -- 172.21.15.179:0/929733422 learned_addr learned my addr 172.21.15.179:0/929733422 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d237e700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8003a00 0x7f68cc151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.279+0000 7f68d2b7f700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68cc1527e0 0x7f68cc152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68d1b7d700 1 -- 172.21.15.179:0/929733422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8003a00 msgr2=0x7f68cc151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68d1b7d700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8003a00 0x7f68cc151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68d1b7d700 1 -- 172.21.15.179:0/929733422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68cc1527e0 msgr2=0x7f68cc152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68d1b7d700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68cc1527e0 0x7f68cc152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68d1b7d700 1 -- 172.21.15.179:0/929733422 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc1599d0 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68d1b7d700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68cc14f5f0 0x7f68cc156730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007fd0 tx=0x7f68c800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68c2ffd700 1 -- 172.21.15.179:0/929733422 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c80070d0 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68c2ffd700 1 -- 172.21.15.179:0/929733422 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c8007230 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc156c70 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68c2ffd700 1 -- 172.21.15.179:0/929733422 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c80075c0 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.280+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc157220 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.281+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc04f290 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.281+0000 7f68c2ffd700 1 -- 172.21.15.179:0/929733422 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68c8005830 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.282+0000 7f68c2ffd700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f68b006aed0 0x7f68b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.282+0000 7f68d237e700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f68b006aed0 0x7f68b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.282+0000 7f68c2ffd700 1 -- 172.21.15.179:0/929733422 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68c8089160 con 0x7f68cc14f5f0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.282+0000 7f68d237e700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f68b006aed0 0x7f68b006d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0090b0 tx=0x7f68bc01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:10.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.286+0000 7f68c2ffd700 1 -- 172.21.15.179:0/929733422 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68c80545f0 con 0x7f68cc14f5f0 2023-12-07T00:14:10.518 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.519+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68cc159e90 con 0x7f68cc14f5f0 2023-12-07T00:14:10.518 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.519+0000 7f68c2ffd700 1 -- 172.21.15.179:0/929733422 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7f68cc159e90 con 0x7f68cc14f5f0 2023-12-07T00:14:10.519 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:10.519 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-07T00:14:10.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f68b006aed0 msgr2=0x7f68b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f68b006aed0 0x7f68b006d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0090b0 tx=0x7f68bc01f040 comp rx=0 tx=0).stop 2023-12-07T00:14:10.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68cc14f5f0 msgr2=0x7f68cc156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68cc14f5f0 0x7f68cc156730 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f68c8007fd0 tx=0x7f68c800fda0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 shutdown_connections 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f68b006aed0 0x7f68b006d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f68cc1527e0 0x7f68cc152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f68b8003a00 0x7f68cc151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 --2- 172.21.15.179:0/929733422 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68cc14f5f0 0x7f68cc156730 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 >> 172.21.15.179:0/929733422 conn(0x7f68cc072970 msgr2=0x7f68cc0cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 shutdown_connections 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.522+0000 7f68d45e2700 1 -- 172.21.15.179:0/929733422 wait complete. 2023-12-07T00:14:10.522 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 3 2023-12-07T00:14:10.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:10.654 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.655+0000 7f037e18e700 1 Processor -- start 2023-12-07T00:14:10.654 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.655+0000 7f037e18e700 1 -- start start 2023-12-07T00:14:10.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f037e18e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0378158560 0x7f03780b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f037e18e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f037815b010 0x7f03780b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f037e18e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780b2ef0 con 0x7f03780b2aa0 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f037e18e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037815b8d0 con 0x7f0378158560 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f037e18e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037815bbb0 con 0x7f037815b010 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03777fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0378158560 0x7f03780b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03777fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0378158560 0x7f03780b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38654/0 (socket says 172.21.15.179:38654) 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03777fe700 1 -- 172.21.15.179:0/3008216533 learned_addr learned my addr 172.21.15.179:0/3008216533 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f0376ffd700 1 --2- 172.21.15.179:0/3008216533 >> v2:172.21.15.190:3300/0 conn(0x7f037815b010 0x7f03780b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03777fe700 1 -- 172.21.15.179:0/3008216533 >> v2:172.21.15.190:3300/0 conn(0x7f037815b010 msgr2=0x7f03780b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03777fe700 1 --2- 172.21.15.179:0/3008216533 >> v2:172.21.15.190:3300/0 conn(0x7f037815b010 0x7f03780b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03777fe700 1 -- 172.21.15.179:0/3008216533 >> v1:172.21.15.190:6789/0 conn(0x7f03780b2aa0 legacy=0x7f037806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03777fe700 1 -- 172.21.15.179:0/3008216533 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037815be90 con 0x7f0378158560 2023-12-07T00:14:10.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03777fe700 1 --2- 172.21.15.179:0/3008216533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0378158560 0x7f03780b4470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f03780b49b0 tx=0x7f0368009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9541fd8fe9d66045 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03767fc700 1 -- 172.21.15.179:0/3008216533 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036800b870 con 0x7f0378158560 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03767fc700 1 -- 172.21.15.179:0/3008216533 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036800b9d0 con 0x7f0378158560 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.656+0000 7f03767fc700 1 -- 172.21.15.179:0/3008216533 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036800bd60 con 0x7f0378158560 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.657+0000 7f037e18e700 1 -- 172.21.15.179:0/3008216533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0378158560 msgr2=0x7f03780b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.657+0000 7f037e18e700 1 --2- 172.21.15.179:0/3008216533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0378158560 0x7f03780b4470 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f03780b49b0 tx=0x7f0368009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.657+0000 7f037e18e700 1 -- 172.21.15.179:0/3008216533 shutdown_connections 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.657+0000 7f037e18e700 1 --2- 172.21.15.179:0/3008216533 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0378158560 0x7f03780b4470 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.657+0000 7f037e18e700 1 --2- 172.21.15.179:0/3008216533 >> v2:172.21.15.190:3300/0 conn(0x7f037815b010 0x7f03780b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.657+0000 7f037e18e700 1 -- 172.21.15.179:0/3008216533 >> 172.21.15.179:0/3008216533 conn(0x7f0378072970 msgr2=0x7f0378072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.657+0000 7f037e18e700 1 -- 172.21.15.179:0/3008216533 shutdown_connections 2023-12-07T00:14:10.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.657+0000 7f037e18e700 1 -- 172.21.15.179:0/3008216533 wait complete. 2023-12-07T00:14:10.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.658+0000 7f037e18e700 1 Processor -- start 2023-12-07T00:14:10.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.659+0000 7f037e18e700 1 -- start start 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f037e18e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03780b2aa0 0x7f0378145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f037e18e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0378158560 0x7f037815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f037e18e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037815b010 0x7f037814bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f037e18e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378145660 con 0x7f037815b010 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f037e18e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037814ce40 con 0x7f03780b2aa0 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f037e18e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037814d120 con 0x7f0378158560 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037815b010 0x7f037814bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037815b010 0x7f037814bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38664/0 (socket says 172.21.15.179:38664) 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 -- 172.21.15.179:0/2873831898 learned_addr learned my addr 172.21.15.179:0/2873831898 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f03777fe700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03780b2aa0 0x7f0378145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0376ffd700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0378158560 0x7f037815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 -- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0378158560 msgr2=0x7f037815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0378158560 0x7f037815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 -- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03780b2aa0 msgr2=0x7f0378145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03780b2aa0 0x7f0378145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 -- 172.21.15.179:0/2873831898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0368009550 con 0x7f037815b010 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f03777fe700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03780b2aa0 0x7f0378145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f0377fff700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037815b010 0x7f037814bc20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f037000cb50 tx=0x7f037000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f036ffff700 1 -- 172.21.15.179:0/2873831898 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0370003c00 con 0x7f037815b010 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f036ffff700 1 -- 172.21.15.179:0/2873831898 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370003d60 con 0x7f037815b010 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037814d400 con 0x7f037815b010 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f036ffff700 1 -- 172.21.15.179:0/2873831898 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037000ab70 con 0x7f037815b010 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.660+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037814d9c0 con 0x7f037815b010 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.661+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037814dd30 con 0x7f037815b010 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.662+0000 7f036ffff700 1 -- 172.21.15.179:0/2873831898 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f037000acd0 con 0x7f037815b010 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.662+0000 7f036ffff700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.662+0000 7f036ffff700 1 -- 172.21.15.179:0/2873831898 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0370089140 con 0x7f037815b010 2023-12-07T00:14:10.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.662+0000 7f03777fe700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.662+0000 7f03777fe700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0368000c00 tx=0x7f0368008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:10.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.666+0000 7f036ffff700 1 -- 172.21.15.179:0/2873831898 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0370054540 con 0x7f037815b010 2023-12-07T00:14:10.858 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.859+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f037804f290 con 0x7f037815b010 2023-12-07T00:14:10.858 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.859+0000 7f036ffff700 1 -- 172.21.15.179:0/2873831898 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f0370057b60 con 0x7f037815b010 2023-12-07T00:14:10.859 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:10.859 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":18,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:05.602914+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:10.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 msgr2=0x7f035806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0368000c00 tx=0x7f0368008030 comp rx=0 tx=0).stop 2023-12-07T00:14:10.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037815b010 msgr2=0x7f037814bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037815b010 0x7f037814bc20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f037000cb50 tx=0x7f037000cf10 comp rx=0 tx=0).stop 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 shutdown_connections 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f037815b010 0x7f037814bc20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f03780b2aa0 0x7f0378145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 --2- 172.21.15.179:0/2873831898 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0378158560 0x7f037815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 >> 172.21.15.179:0/2873831898 conn(0x7f0378072970 msgr2=0x7f037806c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 shutdown_connections 2023-12-07T00:14:10.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.862+0000 7f037e18e700 1 -- 172.21.15.179:0/2873831898 wait complete. 2023-12-07T00:14:10.873 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T00:14:10.873 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:10.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.997+0000 7fc42fe02700 1 Processor -- start 2023-12-07T00:14:10.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.997+0000 7fc42fe02700 1 -- start start 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42fe02700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc42815bd70 0x7fc4280cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42fe02700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc428099b90 0x7fc42809a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42fe02700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4280ccac0 con 0x7fc4280cc590 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42fe02700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4280cd740 con 0x7fc428099b90 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42fe02700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42809a580 con 0x7fc42815bd70 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42d39d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc4280cc590 0x7fc4280d01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45572/0 (socket says 172.21.15.179:45572) 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42d39d700 1 -- 172.21.15.179:0/1965770824 learned_addr learned my addr 172.21.15.179:0/1965770824 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42e39f700 1 --2- 172.21.15.179:0/1965770824 >> v2:172.21.15.179:3300/0 conn(0x7fc428099b90 0x7fc42809a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42db9e700 1 --2- 172.21.15.179:0/1965770824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc42815bd70 0x7fc4280cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42cb9c700 1 -- 172.21.15.179:0/1965770824 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354148605 0 0) 0x7fc4280ccac0 con 0x7fc4280cc590 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42cb9c700 1 -- 172.21.15.179:0/1965770824 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4140035b0 con 0x7fc4280cc590 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42e39f700 1 -- 172.21.15.179:0/1965770824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc42815bd70 msgr2=0x7fc4280cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:10.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42e39f700 1 --2- 172.21.15.179:0/1965770824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc42815bd70 0x7fc4280cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42e39f700 1 -- 172.21.15.179:0/1965770824 >> v1:172.21.15.179:6789/0 conn(0x7fc4280cc590 legacy=0x7fc4280d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42e39f700 1 -- 172.21.15.179:0/1965770824 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4280ccda0 con 0x7fc428099b90 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.998+0000 7fc42e39f700 1 --2- 172.21.15.179:0/1965770824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc428099b90 0x7fc42809a040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc420009d90 tx=0x7fc42000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef99bb78ed62e3e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42cb9c700 1 -- 172.21.15.179:0/1965770824 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42000e070 con 0x7fc428099b90 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42cb9c700 1 -- 172.21.15.179:0/1965770824 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42000bb20 con 0x7fc428099b90 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42cb9c700 1 -- 172.21.15.179:0/1965770824 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420012430 con 0x7fc428099b90 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42fe02700 1 -- 172.21.15.179:0/1965770824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc428099b90 msgr2=0x7fc42809a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42fe02700 1 --2- 172.21.15.179:0/1965770824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc428099b90 0x7fc42809a040 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc420009d90 tx=0x7fc42000b330 comp rx=0 tx=0).stop 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42fe02700 1 -- 172.21.15.179:0/1965770824 shutdown_connections 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42fe02700 1 --2- 172.21.15.179:0/1965770824 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc428099b90 0x7fc42809a040 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42fe02700 1 --2- 172.21.15.179:0/1965770824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc42815bd70 0x7fc4280cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42fe02700 1 -- 172.21.15.179:0/1965770824 >> 172.21.15.179:0/1965770824 conn(0x7fc4280b34e0 msgr2=0x7fc4280b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42fe02700 1 -- 172.21.15.179:0/1965770824 shutdown_connections 2023-12-07T00:14:11.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:10.999+0000 7fc42fe02700 1 -- 172.21.15.179:0/1965770824 wait complete. 2023-12-07T00:14:11.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.000+0000 7fc42fe02700 1 Processor -- start 2023-12-07T00:14:11.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.000+0000 7fc42fe02700 1 -- start start 2023-12-07T00:14:11.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42fe02700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc428099b90 0x7fc4280b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42fe02700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4280cc590 0x7fc4280b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42fe02700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc42815bd70 0x7fc4280cf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42fe02700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4280b6e30 con 0x7fc42815bd70 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42fe02700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4280b7110 con 0x7fc4280cc590 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42fe02700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4280b73f0 con 0x7fc428099b90 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42e39f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc42815bd70 0x7fc4280cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42e39f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc42815bd70 0x7fc4280cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38678/0 (socket says 172.21.15.179:38678) 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42e39f700 1 -- 172.21.15.179:0/3928138862 learned_addr learned my addr 172.21.15.179:0/3928138862 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42e39f700 1 -- 172.21.15.179:0/3928138862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc428099b90 msgr2=0x7fc4280b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42e39f700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc428099b90 0x7fc4280b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42e39f700 1 -- 172.21.15.179:0/3928138862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4280cc590 msgr2=0x7fc4280b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42e39f700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4280cc590 0x7fc4280b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.001+0000 7fc42e39f700 1 -- 172.21.15.179:0/3928138862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420009a70 con 0x7fc42815bd70 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.002+0000 7fc42e39f700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc42815bd70 0x7fc4280cf210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc420014040 tx=0x7fc420004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.002+0000 7fc41a7fc700 1 -- 172.21.15.179:0/3928138862 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200129f0 con 0x7fc42815bd70 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.002+0000 7fc41a7fc700 1 -- 172.21.15.179:0/3928138862 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc420020070 con 0x7fc42815bd70 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.002+0000 7fc41a7fc700 1 -- 172.21.15.179:0/3928138862 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420012db0 con 0x7fc42815bd70 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.002+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4280b76d0 con 0x7fc42815bd70 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.002+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4280b6ab0 con 0x7fc42815bd70 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.003+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4280685f0 con 0x7fc42815bd70 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.003+0000 7fc41a7fc700 1 -- 172.21.15.179:0/3928138862 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc420004040 con 0x7fc42815bd70 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.004+0000 7fc41a7fc700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc40c06aed0 0x7fc40c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.004+0000 7fc41a7fc700 1 -- 172.21.15.179:0/3928138862 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc420022070 con 0x7fc42815bd70 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.004+0000 7fc42db9e700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc40c06aed0 0x7fc40c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.005 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.004+0000 7fc42db9e700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc40c06aed0 0x7fc40c06d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc41c006b20 tx=0x7fc41c006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.008+0000 7fc41a7fc700 1 -- 172.21.15.179:0/3928138862 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc4200563c0 con 0x7fc42815bd70 2023-12-07T00:14:11.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.197+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4280d08b0 con 0x7fc42815bd70 2023-12-07T00:14:11.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.198+0000 7fc41a7fc700 1 -- 172.21.15.179:0/3928138862 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc42002c0a0 con 0x7fc42815bd70 2023-12-07T00:14:11.197 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:11.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc40c06aed0 msgr2=0x7fc40c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc40c06aed0 0x7fc40c06d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc41c006b20 tx=0x7fc41c006ab0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc42815bd70 msgr2=0x7fc4280cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc42815bd70 0x7fc4280cf210 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc420014040 tx=0x7fc420004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 shutdown_connections 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc40c06aed0 0x7fc40c06d390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc42815bd70 0x7fc4280cf210 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc428099b90 0x7fc4280b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 --2- 172.21.15.179:0/3928138862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4280cc590 0x7fc4280b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 >> 172.21.15.179:0/3928138862 conn(0x7fc4280b34e0 msgr2=0x7fc428070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 shutdown_connections 2023-12-07T00:14:11.200 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.200+0000 7fc42fe02700 1 -- 172.21.15.179:0/3928138862 wait complete. 2023-12-07T00:14:11.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T00:14:11.331 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.332+0000 7f7f0c8c2700 1 Processor -- start 2023-12-07T00:14:11.331 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.332+0000 7f7f0c8c2700 1 -- start start 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0c8c2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7f080d06b0 0x7f7f08099c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0c8c2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f080b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0c8c2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0809a570 con 0x7f7f0815bde0 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0c8c2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0809ab50 con 0x7f7f080d06b0 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0c8c2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080cf630 con 0x7f7f0809a140 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f06d9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f080b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0659c700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f7f0815bde0 0x7f7f080cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:52262/0 (socket says 172.21.15.179:52262) 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f05d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7f080d06b0 0x7f7f08099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0659c700 1 -- 172.21.15.179:0/3392536290 learned_addr learned my addr 172.21.15.179:0/3392536290 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0559a700 1 -- 172.21.15.179:0/3392536290 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953697037 0 0) 0x7f7f0809a570 con 0x7f7f0815bde0 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f0559a700 1 -- 172.21.15.179:0/3392536290 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ef00035b0 con 0x7f7f0815bde0 2023-12-07T00:14:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f05d9b700 1 -- 172.21.15.179:0/3392536290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 msgr2=0x7f7f080b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f05d9b700 1 --2- 172.21.15.179:0/3392536290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f080b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f05d9b700 1 -- 172.21.15.179:0/3392536290 >> v1:172.21.15.190:6789/0 conn(0x7f7f0815bde0 legacy=0x7f7f080cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f05d9b700 1 -- 172.21.15.179:0/3392536290 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080cf8f0 con 0x7f7f080d06b0 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f06d9d700 1 --2- 172.21.15.179:0/3392536290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f080b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.333+0000 7f7f05d9b700 1 --2- 172.21.15.179:0/3392536290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 0x7f7f08099c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009840 tx=0x7f7efc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4f7320aae50189 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0559a700 1 -- 172.21.15.179:0/3392536290 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc011830 con 0x7f7f080d06b0 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0559a700 1 -- 172.21.15.179:0/3392536290 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc011990 con 0x7f7f080d06b0 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0559a700 1 -- 172.21.15.179:0/3392536290 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc011d20 con 0x7f7f080d06b0 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/3392536290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 msgr2=0x7f7f08099c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/3392536290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 0x7f7f08099c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009840 tx=0x7f7efc009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/3392536290 shutdown_connections 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/3392536290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f080b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/3392536290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 0x7f7f08099c00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/3392536290 >> 172.21.15.179:0/3392536290 conn(0x7f7f080b3550 msgr2=0x7f7f080b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/3392536290 shutdown_connections 2023-12-07T00:14:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.334+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/3392536290 wait complete. 2023-12-07T00:14:11.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.335+0000 7f7f0c8c2700 1 Processor -- start 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f0c8c2700 1 -- start start 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f0c8c2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f0806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f0c8c2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 0x7f7f080af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f0c8c2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0815bde0 0x7f7f0814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f0c8c2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081f44b0 con 0x7f7f0815bde0 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f0c8c2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081f3830 con 0x7f7f080d06b0 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f0c8c2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081f3b10 con 0x7f7f0809a140 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f06d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0815bde0 0x7f7f0814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f06d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0815bde0 0x7f7f0814fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38692/0 (socket says 172.21.15.179:38692) 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f06d9d700 1 -- 172.21.15.179:0/423004275 learned_addr learned my addr 172.21.15.179:0/423004275 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f0659c700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f0806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.336+0000 7f7f05d9b700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 0x7f7f080af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7f06d9d700 1 -- 172.21.15.179:0/423004275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 msgr2=0x7f7f0806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7f06d9d700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f0806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7f06d9d700 1 -- 172.21.15.179:0/423004275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 msgr2=0x7f7f080af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7f06d9d700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 0x7f7f080af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7f06d9d700 1 -- 172.21.15.179:0/423004275 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009a70 con 0x7f7f0815bde0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7f06d9d700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0815bde0 0x7f7f0814fa20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000efc0 tx=0x7f7f0000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7ef6ffd700 1 -- 172.21.15.179:0/423004275 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000ca90 con 0x7f7f0815bde0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7ef6ffd700 1 -- 172.21.15.179:0/423004275 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0000f040 con 0x7f7f0815bde0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc0094a0 con 0x7f7f0815bde0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7ef6ffd700 1 -- 172.21.15.179:0/423004275 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0000ce30 con 0x7f7f0815bde0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.337+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f081f40d0 con 0x7f7f0815bde0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.338+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f080ce280 con 0x7f7f0815bde0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.338+0000 7f7ef6ffd700 1 -- 172.21.15.179:0/423004275 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f00014480 con 0x7f7f0815bde0 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.339+0000 7f7ef6ffd700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7ee806aed0 0x7f7ee806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.339+0000 7f7ef6ffd700 1 -- 172.21.15.179:0/423004275 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f00089900 con 0x7f7f0815bde0 2023-12-07T00:14:11.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.339+0000 7f7f0659c700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7ee806aed0 0x7f7ee806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.339+0000 7f7f0659c700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7ee806aed0 0x7f7ee806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8007fd0 tx=0x7f7ef8007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.343+0000 7f7ef6ffd700 1 -- 172.21.15.179:0/423004275 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f00054d00 con 0x7f7f0815bde0 2023-12-07T00:14:11.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.535+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7f081f45f0 con 0x7f7f0815bde0 2023-12-07T00:14:11.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.536+0000 7f7ef6ffd700 1 -- 172.21.15.179:0/423004275 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7f00018060 con 0x7f7f0815bde0 2023-12-07T00:14:11.535 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:11.536 INFO:teuthology.orchestra.run.smithi179.stdout:[ 2023-12-07T00:14:11.536 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:14:11.536 INFO:teuthology.orchestra.run.smithi179.stdout: "poolnum": 1, 2023-12-07T00:14:11.536 INFO:teuthology.orchestra.run.smithi179.stdout: "poolname": ".mgr" 2023-12-07T00:14:11.536 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:14:11.536 INFO:teuthology.orchestra.run.smithi179.stdout:] 2023-12-07T00:14:11.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7ee806aed0 msgr2=0x7f7ee806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7ee806aed0 0x7f7ee806d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8007fd0 tx=0x7f7ef8007dc0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0815bde0 msgr2=0x7f7f0814fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0815bde0 0x7f7f0814fa20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000efc0 tx=0x7f7f0000c3a0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 shutdown_connections 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7ee806aed0 0x7f7ee806d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f0815bde0 0x7f7f0814fa20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f0809a140 0x7f7f0806d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 --2- 172.21.15.179:0/423004275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f080d06b0 0x7f7f080af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 >> 172.21.15.179:0/423004275 conn(0x7f7f080b3550 msgr2=0x7f7f0806fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 shutdown_connections 2023-12-07T00:14:11.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.538+0000 7f7f0c8c2700 1 -- 172.21.15.179:0/423004275 wait complete. 2023-12-07T00:14:11.549 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-07T00:14:11.550 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-07T00:14:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.676+0000 7feb256b6700 1 Processor -- start 2023-12-07T00:14:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.676+0000 7feb256b6700 1 -- start start 2023-12-07T00:14:11.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.677+0000 7feb256b6700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feb2015dfd0 0x7feb2015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.677+0000 7feb256b6700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2015ec30 con 0x7feb2006b680 2023-12-07T00:14:11.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.677+0000 7feb256b6700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2015ef10 con 0x7feb200cdc60 2023-12-07T00:14:11.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.677+0000 7feb256b6700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb200cd350 con 0x7feb2015dfd0 2023-12-07T00:14:11.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.677+0000 7feb1effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feb2015dfd0 0x7feb2015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.677+0000 7feb1f7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7feb2006b680 0x7feb200cb4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45600/0 (socket says 172.21.15.179:45600) 2023-12-07T00:14:11.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.677+0000 7feb1f7fe700 1 -- 172.21.15.179:0/3770179084 learned_addr learned my addr 172.21.15.179:0/3770179084 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb1effd700 1 -- 172.21.15.179:0/3770179084 >> v1:172.21.15.190:6789/0 conn(0x7feb200cdc60 legacy=0x7feb2006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb1effd700 1 -- 172.21.15.179:0/3770179084 >> v1:172.21.15.179:6789/0 conn(0x7feb2006b680 legacy=0x7feb200cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb1dffb700 1 -- 172.21.15.179:0/3770179084 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913337507 0 0) 0x7feb2015ec30 con 0x7feb2006b680 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb1effd700 1 -- 172.21.15.179:0/3770179084 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2015f1f0 con 0x7feb2015dfd0 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb1effd700 1 --2- 172.21.15.179:0/3770179084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2015dfd0 0x7feb2015e3b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb14009840 tx=0x7feb14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511d09ebce79fc05 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb1dffb700 1 -- 172.21.15.179:0/3770179084 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14004230 con 0x7feb2015dfd0 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb1dffb700 1 -- 172.21.15.179:0/3770179084 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14004390 con 0x7feb2015dfd0 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb1dffb700 1 -- 172.21.15.179:0/3770179084 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb140036a0 con 0x7feb2015dfd0 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb256b6700 1 -- 172.21.15.179:0/3770179084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2015dfd0 msgr2=0x7feb2015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb256b6700 1 --2- 172.21.15.179:0/3770179084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2015dfd0 0x7feb2015e3b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb14009840 tx=0x7feb14009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb256b6700 1 -- 172.21.15.179:0/3770179084 shutdown_connections 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb256b6700 1 --2- 172.21.15.179:0/3770179084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2015dfd0 0x7feb2015e3b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.678+0000 7feb256b6700 1 -- 172.21.15.179:0/3770179084 >> 172.21.15.179:0/3770179084 conn(0x7feb20099a40 msgr2=0x7feb20099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.679+0000 7feb256b6700 1 -- 172.21.15.179:0/3770179084 shutdown_connections 2023-12-07T00:14:11.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.679+0000 7feb256b6700 1 -- 172.21.15.179:0/3770179084 wait complete. 2023-12-07T00:14:11.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.680+0000 7feb256b6700 1 Processor -- start 2023-12-07T00:14:11.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.680+0000 7feb256b6700 1 -- start start 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb256b6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2006b680 0x7feb200c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb256b6700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb200cdc60 0x7feb20154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb256b6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb2015dfd0 0x7feb200c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb256b6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200c7f70 con 0x7feb2006b680 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb256b6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb200b4540 con 0x7feb2015dfd0 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb256b6700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb20155250 con 0x7feb200cdc60 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2006b680 0x7feb200c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2006b680 0x7feb200c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38700/0 (socket says 172.21.15.179:38700) 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 -- 172.21.15.179:0/4268305432 learned_addr learned my addr 172.21.15.179:0/4268305432 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:11.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 -- 172.21.15.179:0/4268305432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb200cdc60 msgr2=0x7feb20154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb200cdc60 0x7feb20154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 -- 172.21.15.179:0/4268305432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb2015dfd0 msgr2=0x7feb200c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb2015dfd0 0x7feb200c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 -- 172.21.15.179:0/4268305432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb140094a0 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb1effd700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2006b680 0x7feb200c7a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb200d1a60 tx=0x7feb140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb077fe700 1 -- 172.21.15.179:0/4268305432 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14011630 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb077fe700 1 -- 172.21.15.179:0/4268305432 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14011790 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb200c85e0 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb077fe700 1 -- 172.21.15.179:0/4268305432 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14011b40 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.681+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb200b4790 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.682+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb200c8b00 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.683+0000 7feb077fe700 1 -- 172.21.15.179:0/4268305432 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb14011ca0 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.683+0000 7feb077fe700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7feb0c06aed0 0x7feb0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.683+0000 7feb077fe700 1 -- 172.21.15.179:0/4268305432 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb1408aba0 con 0x7feb2006b680 2023-12-07T00:14:11.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.683+0000 7feb1e7fc700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7feb0c06aed0 0x7feb0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:11.692 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.683+0000 7feb1e7fc700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7feb0c06aed0 0x7feb0c06d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb201f7840 tx=0x7feb10007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:11.692 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.687+0000 7feb077fe700 1 -- 172.21.15.179:0/4268305432 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb14056030 con 0x7feb2006b680 2023-12-07T00:14:11.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:11.878+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feb200cd570 con 0x7feb2006b680 2023-12-07T00:14:12.408 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:14:12.411 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:14:12.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.609+0000 7feb077fe700 1 -- 172.21.15.179:0/4268305432 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7feb14059650 con 0x7feb2006b680 2023-12-07T00:14:12.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.612+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7feb0c06aed0 msgr2=0x7feb0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:12.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.612+0000 7feb256b6700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7feb0c06aed0 0x7feb0c06d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb201f7840 tx=0x7feb10007a40 comp rx=0 tx=0).stop 2023-12-07T00:14:12.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.612+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2006b680 msgr2=0x7feb200c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:12.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.612+0000 7feb256b6700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2006b680 0x7feb200c7a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb200d1a60 tx=0x7feb140047c0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.613+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 shutdown_connections 2023-12-07T00:14:12.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.613+0000 7feb256b6700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7feb0c06aed0 0x7feb0c06d390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.613+0000 7feb256b6700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb2015dfd0 0x7feb200c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.613+0000 7feb256b6700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb2006b680 0x7feb200c7a30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.613+0000 7feb256b6700 1 --2- 172.21.15.179:0/4268305432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb200cdc60 0x7feb20154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.613+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 >> 172.21.15.179:0/4268305432 conn(0x7feb20099a40 msgr2=0x7feb200ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:12.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.613+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 shutdown_connections 2023-12-07T00:14:12.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.613+0000 7feb256b6700 1 -- 172.21.15.179:0/4268305432 wait complete. 2023-12-07T00:14:12.615 INFO:teuthology.orchestra.run.smithi179.stderr:pool 'cephfs_metadata' created 2023-12-07T00:14:12.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-07T00:14:12.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.761+0000 7fa74a5b0700 1 Processor -- start 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.761+0000 7fa74a5b0700 1 -- start start 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa74a5b0700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa744162100 0x7fa7441624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa74a5b0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440cfcc0 0x7fa744099b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa74a5b0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7440d06a0 con 0x7fa7440d0120 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa74a5b0700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa744162a20 con 0x7fa744162100 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa74a5b0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440d0980 con 0x7fa7440cfcc0 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa743fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa744162100 0x7fa7441624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa743fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa744162100 0x7fa7441624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38708/0 (socket says 172.21.15.179:38708) 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa743fff700 1 -- 172.21.15.179:0/1648591560 learned_addr learned my addr 172.21.15.179:0/1648591560 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa7437fe700 1 --2- 172.21.15.179:0/1648591560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440cfcc0 0x7fa744099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa743fff700 1 -- 172.21.15.179:0/1648591560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440cfcc0 msgr2=0x7fa744099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:12.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa743fff700 1 --2- 172.21.15.179:0/1648591560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440cfcc0 0x7fa744099b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa743fff700 1 -- 172.21.15.179:0/1648591560 >> v1:172.21.15.190:6789/0 conn(0x7fa7440d0120 legacy=0x7fa74415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:12.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa743fff700 1 -- 172.21.15.179:0/1648591560 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440d0c60 con 0x7fa744162100 2023-12-07T00:14:12.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa743fff700 1 --2- 172.21.15.179:0/1648591560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa744162100 0x7fa7441624e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa7340098f0 tx=0x7fa734009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfc0cb1d15b8248 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:12.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa742ffd700 1 -- 172.21.15.179:0/1648591560 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400b8a0 con 0x7fa744162100 2023-12-07T00:14:12.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa742ffd700 1 -- 172.21.15.179:0/1648591560 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400ba00 con 0x7fa744162100 2023-12-07T00:14:12.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.762+0000 7fa742ffd700 1 -- 172.21.15.179:0/1648591560 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400bd90 con 0x7fa744162100 2023-12-07T00:14:12.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.763+0000 7fa74a5b0700 1 -- 172.21.15.179:0/1648591560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa744162100 msgr2=0x7fa7441624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:12.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.763+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/1648591560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa744162100 0x7fa7441624e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa7340098f0 tx=0x7fa734009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:12.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.763+0000 7fa74a5b0700 1 -- 172.21.15.179:0/1648591560 shutdown_connections 2023-12-07T00:14:12.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.763+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/1648591560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa744162100 0x7fa7441624e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.763+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/1648591560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440cfcc0 0x7fa744099b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.763+0000 7fa74a5b0700 1 -- 172.21.15.179:0/1648591560 >> 172.21.15.179:0/1648591560 conn(0x7fa7440b34e0 msgr2=0x7fa7440b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:12.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.763+0000 7fa74a5b0700 1 -- 172.21.15.179:0/1648591560 shutdown_connections 2023-12-07T00:14:12.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.763+0000 7fa74a5b0700 1 -- 172.21.15.179:0/1648591560 wait complete. 2023-12-07T00:14:12.769 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.764+0000 7fa74a5b0700 1 Processor -- start 2023-12-07T00:14:12.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.765+0000 7fa74a5b0700 1 -- start start 2023-12-07T00:14:12.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.765+0000 7fa74a5b0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7440cfcc0 0x7fa7440b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:12.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa74a5b0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440d0120 0x7fa7441e8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:12.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa74a5b0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa744162100 0x7fa7441e88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:12.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa74a5b0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441e90e0 con 0x7fa7440cfcc0 2023-12-07T00:14:12.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa74a5b0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441e93c0 con 0x7fa744162100 2023-12-07T00:14:12.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa74a5b0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441e96a0 con 0x7fa7440d0120 2023-12-07T00:14:12.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7440cfcc0 0x7fa7440b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:12.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7440cfcc0 0x7fa7440b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38710/0 (socket says 172.21.15.179:38710) 2023-12-07T00:14:12.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 -- 172.21.15.179:0/179928734 learned_addr learned my addr 172.21.15.179:0/179928734 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:12.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa748b4d700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa744162100 0x7fa7441e88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:12.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa7437fe700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440d0120 0x7fa7441e8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:12.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 -- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440d0120 msgr2=0x7fa7441e8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:12.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440d0120 0x7fa7441e8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 -- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa744162100 msgr2=0x7fa7441e88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:12.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa744162100 0x7fa7441e88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:12.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 -- 172.21.15.179:0/179928734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009550 con 0x7fa7440cfcc0 2023-12-07T00:14:12.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa748b4d700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa744162100 0x7fa7441e88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:12.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa743fff700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7440cfcc0 0x7fa7440b2610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa734014040 tx=0x7fa734004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:12.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa740ff9700 1 -- 172.21.15.179:0/179928734 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7340036a0 con 0x7fa7440cfcc0 2023-12-07T00:14:12.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa740ff9700 1 -- 172.21.15.179:0/179928734 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73401e070 con 0x7fa7440cfcc0 2023-12-07T00:14:12.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7440b4dc0 con 0x7fa7440cfcc0 2023-12-07T00:14:12.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa740ff9700 1 -- 172.21.15.179:0/179928734 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734003a40 con 0x7fa7440cfcc0 2023-12-07T00:14:12.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.766+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7440b4ab0 con 0x7fa7440cfcc0 2023-12-07T00:14:12.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.767+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7440b4f50 con 0x7fa7440cfcc0 2023-12-07T00:14:12.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.768+0000 7fa740ff9700 1 -- 172.21.15.179:0/179928734 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa734003ba0 con 0x7fa7440cfcc0 2023-12-07T00:14:12.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.768+0000 7fa740ff9700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa73006aed0 0x7fa73006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:12.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.768+0000 7fa740ff9700 1 -- 172.21.15.179:0/179928734 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa734020070 con 0x7fa7440cfcc0 2023-12-07T00:14:12.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.768+0000 7fa7437fe700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa73006aed0 0x7fa73006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:12.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.768+0000 7fa7437fe700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa73006aed0 0x7fa73006d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7440cd570 tx=0x7fa738008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:12.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.773+0000 7fa740ff9700 1 -- 172.21.15.179:0/179928734 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa734055bc0 con 0x7fa7440cfcc0 2023-12-07T00:14:12.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:12.961+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fa7440685f0 con 0x7fa7440cfcc0 2023-12-07T00:14:13.610 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.611+0000 7fa740ff9700 1 -- 172.21.15.179:0/179928734 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7fa7340591e0 con 0x7fa7440cfcc0 2023-12-07T00:14:13.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.616+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa73006aed0 msgr2=0x7fa73006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:13.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.616+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa73006aed0 0x7fa73006d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa7440cd570 tx=0x7fa738008040 comp rx=0 tx=0).stop 2023-12-07T00:14:13.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.616+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7440cfcc0 msgr2=0x7fa7440b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:13.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.616+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7440cfcc0 0x7fa7440b2610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa734014040 tx=0x7fa734004750 comp rx=0 tx=0).stop 2023-12-07T00:14:13.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.617+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 shutdown_connections 2023-12-07T00:14:13.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.617+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa73006aed0 0x7fa73006d390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.617+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa744162100 0x7fa7441e88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.617+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7440cfcc0 0x7fa7440b2610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.617+0000 7fa74a5b0700 1 --2- 172.21.15.179:0/179928734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa7440d0120 0x7fa7441e8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.617+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 >> 172.21.15.179:0/179928734 conn(0x7fa7440b34e0 msgr2=0x7fa744071380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:13.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.617+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 shutdown_connections 2023-12-07T00:14:13.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.618+0000 7fa74a5b0700 1 -- 172.21.15.179:0/179928734 wait complete. 2023-12-07T00:14:13.626 INFO:teuthology.orchestra.run.smithi179.stderr:pool 'cephfs_data' created 2023-12-07T00:14:13.644 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-07T00:14:13.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.772+0000 7f22b449c700 1 Processor -- start 2023-12-07T00:14:13.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.772+0000 7f22b449c700 1 -- start start 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b449c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac15de50 0x7f22ac0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b449c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22ac0ccc90 0x7f22ac06af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b449c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac06b910 con 0x7f22ac06b4b0 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b449c700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0cc550 con 0x7f22ac0ccc90 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b449c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0cd1c0 con 0x7f22ac15de50 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b1a37700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22ac0ccc90 0x7f22ac06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b1a37700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f22ac0ccc90 0x7f22ac06af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38718/0 (socket says 172.21.15.179:38718) 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b1a37700 1 -- 172.21.15.179:0/4256212307 learned_addr learned my addr 172.21.15.179:0/4256212307 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b2238700 1 --2- 172.21.15.179:0/4256212307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac15de50 0x7f22ac0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b1a37700 1 -- 172.21.15.179:0/4256212307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac15de50 msgr2=0x7f22ac0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:13.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b1a37700 1 --2- 172.21.15.179:0/4256212307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac15de50 0x7f22ac0cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b1a37700 1 -- 172.21.15.179:0/4256212307 >> v1:172.21.15.190:6789/0 conn(0x7f22ac06b4b0 legacy=0x7f22ac1619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.773+0000 7f22b1a37700 1 -- 172.21.15.179:0/4256212307 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0cd4a0 con 0x7f22ac0ccc90 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b1a37700 1 --2- 172.21.15.179:0/4256212307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac06af70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22a80098f0 tx=0x7f22a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36db83c6301b0c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b1236700 1 -- 172.21.15.179:0/4256212307 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8004230 con 0x7f22ac0ccc90 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b1236700 1 -- 172.21.15.179:0/4256212307 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8004390 con 0x7f22ac0ccc90 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b1236700 1 -- 172.21.15.179:0/4256212307 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a80036a0 con 0x7f22ac0ccc90 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b449c700 1 -- 172.21.15.179:0/4256212307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 msgr2=0x7f22ac06af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b449c700 1 --2- 172.21.15.179:0/4256212307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac06af70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22a80098f0 tx=0x7f22a8009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b449c700 1 -- 172.21.15.179:0/4256212307 shutdown_connections 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b449c700 1 --2- 172.21.15.179:0/4256212307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac15de50 0x7f22ac0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b449c700 1 --2- 172.21.15.179:0/4256212307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac06af70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b449c700 1 -- 172.21.15.179:0/4256212307 >> 172.21.15.179:0/4256212307 conn(0x7f22ac099a40 msgr2=0x7f22ac099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:13.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b449c700 1 -- 172.21.15.179:0/4256212307 shutdown_connections 2023-12-07T00:14:13.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.774+0000 7f22b449c700 1 -- 172.21.15.179:0/4256212307 wait complete. 2023-12-07T00:14:13.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.776+0000 7f22b449c700 1 Processor -- start 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.776+0000 7f22b449c700 1 -- start start 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.776+0000 7f22b449c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac06b4b0 0x7f22ac0b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.776+0000 7f22b449c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac14ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.776+0000 7f22b449c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22ac15de50 0x7f22ac0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.776+0000 7f22b449c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0b6880 con 0x7f22ac0ccc90 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.776+0000 7f22b449c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c5db0 con 0x7f22ac15de50 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.776+0000 7f22b449c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac14f440 con 0x7f22ac06b4b0 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac14ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac14ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38726/0 (socket says 172.21.15.179:38726) 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 -- 172.21.15.179:0/248656424 learned_addr learned my addr 172.21.15.179:0/248656424 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b2238700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac06b4b0 0x7f22ac0b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b2a39700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22ac15de50 0x7f22ac0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 -- 172.21.15.179:0/248656424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac06b4b0 msgr2=0x7f22ac0b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac06b4b0 0x7f22ac0b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 -- 172.21.15.179:0/248656424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22ac15de50 msgr2=0x7f22ac0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22ac15de50 0x7f22ac0b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 -- 172.21.15.179:0/248656424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8009550 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b1a37700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac14ef00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009130 tx=0x7f22a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22a2ffd700 1 -- 172.21.15.179:0/248656424 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8003aa0 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22a2ffd700 1 -- 172.21.15.179:0/248656424 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a801f070 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22a2ffd700 1 -- 172.21.15.179:0/248656424 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8003e40 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0b65a0 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.777+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac0c5a40 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.778+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac0c5bd0 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.779+0000 7f22a2ffd700 1 -- 172.21.15.179:0/248656424 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f22a8021030 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.779+0000 7f22a2ffd700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f229006af00 0x7f229006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.779+0000 7f22a2ffd700 1 -- 172.21.15.179:0/248656424 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f22a808a9e0 con 0x7f22ac0ccc90 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.779+0000 7f22b2238700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f229006af00 0x7f229006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:13.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.779+0000 7f22b2238700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f229006af00 0x7f229006d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f229c006b20 tx=0x7f229c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:13.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:13.784+0000 7f22a2ffd700 1 -- 172.21.15.179:0/248656424 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22a8055af0 con 0x7f22ac0ccc90 2023-12-07T00:14:14.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.019+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f22ac0c5bd0 con 0x7f22ac0ccc90 2023-12-07T00:14:14.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.633+0000 7f22a2ffd700 1 -- 172.21.15.179:0/248656424 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f22a8059110 con 0x7f22ac0ccc90 2023-12-07T00:14:14.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f229006af00 msgr2=0x7f229006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:14.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f229006af00 0x7f229006d3c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f229c006b20 tx=0x7f229c008040 comp rx=0 tx=0).stop 2023-12-07T00:14:14.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 msgr2=0x7f22ac14ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:14.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac14ef00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009130 tx=0x7f22a8004750 comp rx=0 tx=0).stop 2023-12-07T00:14:14.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 shutdown_connections 2023-12-07T00:14:14.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f229006af00 0x7f229006d3c0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f229c006b20 tx=0x7f229c008040 comp rx=0 tx=0).stop 2023-12-07T00:14:14.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f22ac15de50 0x7f22ac0b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:14.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f22ac06b4b0 0x7f22ac0b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:14.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 --2- 172.21.15.179:0/248656424 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22ac0ccc90 0x7f22ac14ef00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:14.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.640+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 >> 172.21.15.179:0/248656424 conn(0x7f22ac099a40 msgr2=0x7f22ac15c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:14.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.658+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 shutdown_connections 2023-12-07T00:14:14.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.658+0000 7f22b449c700 1 -- 172.21.15.179:0/248656424 wait complete. 2023-12-07T00:14:14.658 INFO:teuthology.orchestra.run.smithi179.stderr:new fs with metadata pool 2 and data pool 3 2023-12-07T00:14:14.672 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-07T00:14:14.673 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-07T00:14:14.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.802+0000 7f0332533700 1 Processor -- start 2023-12-07T00:14:14.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.802+0000 7f0332533700 1 -- start start 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.802+0000 7f0332533700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c06af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.802+0000 7f0332533700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032c15ec30 con 0x7f032c06b4b0 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.802+0000 7f0332533700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032c15ef10 con 0x7f032c15dfd0 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.802+0000 7f0332533700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c06b940 con 0x7f032c0cdc60 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f0330ad0700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f032c06b4b0 0x7f032c0cb4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45652/0 (socket says 172.21.15.179:45652) 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f0330ad0700 1 -- 172.21.15.179:0/2365391645 learned_addr learned my addr 172.21.15.179:0/2365391645 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032b7fe700 1 --2- 172.21.15.179:0/2365391645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032affd700 1 -- 172.21.15.179:0/2365391645 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881531555 0 0) 0x7f032c15ec30 con 0x7f032c06b4b0 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032affd700 1 -- 172.21.15.179:0/2365391645 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03140035b0 con 0x7f032c06b4b0 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032affd700 1 -- 172.21.15.179:0/2365391645 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562023889 0 0) 0x7f032c15ef10 con 0x7f032c15dfd0 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032affd700 1 -- 172.21.15.179:0/2365391645 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f032c15ec30 con 0x7f032c15dfd0 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032b7fe700 1 -- 172.21.15.179:0/2365391645 >> v1:172.21.15.190:6789/0 conn(0x7f032c15dfd0 legacy=0x7f032c15e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:14.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032b7fe700 1 -- 172.21.15.179:0/2365391645 >> v1:172.21.15.179:6789/0 conn(0x7f032c06b4b0 legacy=0x7f032c0cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:14.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032b7fe700 1 -- 172.21.15.179:0/2365391645 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c15f1f0 con 0x7f032c0cdc60 2023-12-07T00:14:14.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032b7fe700 1 --2- 172.21.15.179:0/2365391645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c06af70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0320009870 tx=0x7f0320009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a6525180339b651 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:14.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032affd700 1 -- 172.21.15.179:0/2365391645 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320011830 con 0x7f032c0cdc60 2023-12-07T00:14:14.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032affd700 1 -- 172.21.15.179:0/2365391645 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0320011990 con 0x7f032c0cdc60 2023-12-07T00:14:14.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.803+0000 7f032affd700 1 -- 172.21.15.179:0/2365391645 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320011d00 con 0x7f032c0cdc60 2023-12-07T00:14:14.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.804+0000 7f0332533700 1 -- 172.21.15.179:0/2365391645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 msgr2=0x7f032c06af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:14.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.804+0000 7f0332533700 1 --2- 172.21.15.179:0/2365391645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c06af70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0320009870 tx=0x7f0320009b80 comp rx=0 tx=0).stop 2023-12-07T00:14:14.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.804+0000 7f0332533700 1 -- 172.21.15.179:0/2365391645 shutdown_connections 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.804+0000 7f0332533700 1 --2- 172.21.15.179:0/2365391645 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c06af70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.804+0000 7f0332533700 1 -- 172.21.15.179:0/2365391645 >> 172.21.15.179:0/2365391645 conn(0x7f032c099a40 msgr2=0x7f032c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.804+0000 7f0332533700 1 -- 172.21.15.179:0/2365391645 shutdown_connections 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.804+0000 7f0332533700 1 -- 172.21.15.179:0/2365391645 wait complete. 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.805+0000 7f0332533700 1 Processor -- start 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.805+0000 7f0332533700 1 -- start start 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0332533700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c06b4b0 0x7f032c0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0332533700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c0ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0332533700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c15dfd0 0x7f032c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:14.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0332533700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0ca9e0 con 0x7f032c15dfd0 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0332533700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0c8670 con 0x7f032c06b4b0 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0332533700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0c8950 con 0x7f032c0cdc60 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0330ad0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c15dfd0 0x7f032c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0330ad0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c15dfd0 0x7f032c0c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38756/0 (socket says 172.21.15.179:38756) 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0330ad0700 1 -- 172.21.15.179:0/3534189385 learned_addr learned my addr 172.21.15.179:0/3534189385 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f032b7fe700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c0ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0330ad0700 1 -- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 msgr2=0x7f032c0ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0330ad0700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c0ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f032bfff700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c06b4b0 0x7f032c0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0330ad0700 1 -- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c06b4b0 msgr2=0x7f032c0ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0330ad0700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c06b4b0 0x7f032c0ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f0330ad0700 1 -- 172.21.15.179:0/3534189385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03200094a0 con 0x7f032c15dfd0 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.806+0000 7f032b7fe700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:14.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.807+0000 7f0330ad0700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c15dfd0 0x7f032c0c9710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f032400cbc0 tx=0x7f032400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.807+0000 7f0328ff9700 1 -- 172.21.15.179:0/3534189385 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032400ab50 con 0x7f032c15dfd0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.807+0000 7f0328ff9700 1 -- 172.21.15.179:0/3534189385 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032400acb0 con 0x7f032c15dfd0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.807+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f032c0c8c30 con 0x7f032c15dfd0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.807+0000 7f0328ff9700 1 -- 172.21.15.179:0/3534189385 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324012600 con 0x7f032c15dfd0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.807+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c0c91f0 con 0x7f032c15dfd0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.808+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c0cab20 con 0x7f032c15dfd0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.808+0000 7f0328ff9700 1 -- 172.21.15.179:0/3534189385 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f032401b3b0 con 0x7f032c15dfd0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.808+0000 7f0328ff9700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f031806aed0 0x7f031806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.809+0000 7f0328ff9700 1 -- 172.21.15.179:0/3534189385 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0324089270 con 0x7f032c15dfd0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.809+0000 7f032bfff700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f031806aed0 0x7f031806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:14.813 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.809+0000 7f032bfff700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f031806aed0 0x7f031806d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f031c0015b0 tx=0x7f031c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:14.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:14.813+0000 7f0328ff9700 1 -- 172.21.15.179:0/3534189385 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f032c0cab20 con 0x7f032c15dfd0 2023-12-07T00:14:15.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.013+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f032c0cab20 con 0x7f032c15dfd0 2023-12-07T00:14:15.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.638+0000 7f0328ff9700 1 -- 172.21.15.179:0/3534189385 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f032c0cab20 con 0x7f032c15dfd0 2023-12-07T00:14:15.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.640+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f031806aed0 msgr2=0x7f031806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:15.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.640+0000 7f0332533700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f031806aed0 0x7f031806d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f031c0015b0 tx=0x7f031c009040 comp rx=0 tx=0).stop 2023-12-07T00:14:15.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.640+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c15dfd0 msgr2=0x7f032c0c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:15.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.640+0000 7f0332533700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c15dfd0 0x7f032c0c9710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f032400cbc0 tx=0x7f032400cf80 comp rx=0 tx=0).stop 2023-12-07T00:14:15.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.640+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 shutdown_connections 2023-12-07T00:14:15.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.641+0000 7f0332533700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f031806aed0 0x7f031806d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.641+0000 7f0332533700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f032c15dfd0 0x7f032c0c9710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.641+0000 7f0332533700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f032c06b4b0 0x7f032c0ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.641+0000 7f0332533700 1 --2- 172.21.15.179:0/3534189385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f032c0cdc60 0x7f032c0ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.641+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 >> 172.21.15.179:0/3534189385 conn(0x7f032c099a40 msgr2=0x7f032c0cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:15.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.641+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 shutdown_connections 2023-12-07T00:14:15.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.641+0000 7f0332533700 1 -- 172.21.15.179:0/3534189385 wait complete. 2023-12-07T00:14:15.653 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T00:14:15.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.784+0000 7f017ddaa700 1 Processor -- start 2023-12-07T00:14:15.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.784+0000 7f017ddaa700 1 -- start start 2023-12-07T00:14:15.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f017ddaa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f017815de40 0x7f01780b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:15.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f017ddaa700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01780b2c70 0x7f017815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:15.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f017ddaa700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017815f330 con 0x7f017815e220 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f017ddaa700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01780d1820 con 0x7f01780b2c70 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f017ddaa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017815e720 con 0x7f017815de40 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f0177fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01780b2c70 0x7f017815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f0177fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f01780b2c70 0x7f017815f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38764/0 (socket says 172.21.15.179:38764) 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f0177fff700 1 -- 172.21.15.179:0/549806602 learned_addr learned my addr 172.21.15.179:0/549806602 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f01777fe700 1 --2- 172.21.15.179:0/549806602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f017815de40 0x7f01780b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f0177fff700 1 -- 172.21.15.179:0/549806602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f017815de40 msgr2=0x7f01780b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f0177fff700 1 --2- 172.21.15.179:0/549806602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f017815de40 0x7f01780b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f0177fff700 1 -- 172.21.15.179:0/549806602 >> v1:172.21.15.190:6789/0 conn(0x7f017815e220 legacy=0x7f01780b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.785+0000 7f0177fff700 1 -- 172.21.15.179:0/549806602 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017815ea00 con 0x7f01780b2c70 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f01777fe700 1 --2- 172.21.15.179:0/549806602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f017815de40 0x7f01780b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f0177fff700 1 --2- 172.21.15.179:0/549806602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780b2c70 0x7f017815f870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0170009e50 tx=0x7f017000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90c375edde0fd2d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f01767fc700 1 -- 172.21.15.179:0/549806602 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017000e070 con 0x7f01780b2c70 2023-12-07T00:14:15.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f01767fc700 1 -- 172.21.15.179:0/549806602 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017000b9c0 con 0x7f01780b2c70 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f01767fc700 1 -- 172.21.15.179:0/549806602 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017000bd70 con 0x7f01780b2c70 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f017ddaa700 1 -- 172.21.15.179:0/549806602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780b2c70 msgr2=0x7f017815f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f017ddaa700 1 --2- 172.21.15.179:0/549806602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780b2c70 0x7f017815f870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0170009e50 tx=0x7f017000b330 comp rx=0 tx=0).stop 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f017ddaa700 1 -- 172.21.15.179:0/549806602 shutdown_connections 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f017ddaa700 1 --2- 172.21.15.179:0/549806602 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f01780b2c70 0x7f017815f870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f017ddaa700 1 --2- 172.21.15.179:0/549806602 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f017815de40 0x7f01780b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f017ddaa700 1 -- 172.21.15.179:0/549806602 >> 172.21.15.179:0/549806602 conn(0x7f0178072970 msgr2=0x7f0178072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f017ddaa700 1 -- 172.21.15.179:0/549806602 shutdown_connections 2023-12-07T00:14:15.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.786+0000 7f017ddaa700 1 -- 172.21.15.179:0/549806602 wait complete. 2023-12-07T00:14:15.789 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.788+0000 7f017ddaa700 1 Processor -- start 2023-12-07T00:14:15.791 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.788+0000 7f017ddaa700 1 -- start start 2023-12-07T00:14:15.791 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.788+0000 7f017ddaa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01780b2c70 0x7f01780a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:15.791 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.788+0000 7f017ddaa700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f017815de40 0x7f01781512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:15.791 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.788+0000 7f017ddaa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017815e220 0x7f01780a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:15.791 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.788+0000 7f017ddaa700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780a9a20 con 0x7f017815de40 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.788+0000 7f017ddaa700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780a8da0 con 0x7f017815e220 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.788+0000 7f017ddaa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780a9080 con 0x7f01780b2c70 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f017815de40 0x7f01781512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f017815de40 0x7f01781512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38768/0 (socket says 172.21.15.179:38768) 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 -- 172.21.15.179:0/199959028 learned_addr learned my addr 172.21.15.179:0/199959028 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f01777fe700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01780b2c70 0x7f01780a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0177fff700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017815e220 0x7f01780a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 -- 172.21.15.179:0/199959028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01780b2c70 msgr2=0x7f01780a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01780b2c70 0x7f01780a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 -- 172.21.15.179:0/199959028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017815e220 msgr2=0x7f01780a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017815e220 0x7f01780a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 -- 172.21.15.179:0/199959028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170009b30 con 0x7f017815de40 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f0176ffd700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f017815de40 0x7f01781512a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f016800c4d0 tx=0x7f016800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:15.792 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f015ffff700 1 -- 172.21.15.179:0/199959028 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680052d0 con 0x7f017815de40 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f015ffff700 1 -- 172.21.15.179:0/199959028 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0168005430 con 0x7f017815de40 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01780a9360 con 0x7f017815de40 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f015ffff700 1 -- 172.21.15.179:0/199959028 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680038f0 con 0x7f017815de40 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.789+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01781517e0 con 0x7f017815de40 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.790+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017804f290 con 0x7f017815de40 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.790+0000 7f015ffff700 1 -- 172.21.15.179:0/199959028 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0168003a50 con 0x7f017815de40 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.791+0000 7f015ffff700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f016406aed0 0x7f016406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.791+0000 7f015ffff700 1 -- 172.21.15.179:0/199959028 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f0168088a70 con 0x7f017815de40 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.791+0000 7f01777fe700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f016406aed0 0x7f016406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:15.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.791+0000 7f01777fe700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f016406aed0 0x7f016406d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f016c009930 tx=0x7f016c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:15.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.795+0000 7f015ffff700 1 -- 172.21.15.179:0/199959028 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0168053ad0 con 0x7f017815de40 2023-12-07T00:14:15.984 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:15.985+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f01780a9b60 con 0x7f017815de40 2023-12-07T00:14:17.163 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T00:14:17.163+0000 7f509ce07700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T00:14:17.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.642+0000 7f015ffff700 1 -- 172.21.15.179:0/199959028 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f01780a9b60 con 0x7f017815de40 2023-12-07T00:14:17.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f016406aed0 msgr2=0x7f016406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:17.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f016406aed0 0x7f016406d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f016c009930 tx=0x7f016c008040 comp rx=0 tx=0).stop 2023-12-07T00:14:17.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f017815de40 msgr2=0x7f01781512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:17.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f017815de40 0x7f01781512a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f016800c4d0 tx=0x7f016800c890 comp rx=0 tx=0).stop 2023-12-07T00:14:17.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 shutdown_connections 2023-12-07T00:14:17.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f016406aed0 0x7f016406d390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f017815e220 0x7f01780a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01780b2c70 0x7f01780a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 --2- 172.21.15.179:0/199959028 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f017815de40 0x7f01781512a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.646+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 >> 172.21.15.179:0/199959028 conn(0x7f0178072970 msgr2=0x7f017806c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:17.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.647+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 shutdown_connections 2023-12-07T00:14:17.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.647+0000 7f017ddaa700 1 -- 172.21.15.179:0/199959028 wait complete. 2023-12-07T00:14:17.654 INFO:teuthology.orchestra.run.smithi179.stderr:pool 'cephfs_data_ec' created 2023-12-07T00:14:17.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-07T00:14:17.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.797+0000 7f972838d700 1 Processor -- start 2023-12-07T00:14:17.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.797+0000 7f972838d700 1 -- start start 2023-12-07T00:14:17.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.798+0000 7f972838d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f972015bf20 0x7f97200cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:17.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.798+0000 7f972838d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f972009a310 0x7f97200ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:17.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.798+0000 7f972838d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97200d0070 con 0x7f97200cfaf0 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.798+0000 7f972838d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97200d0350 con 0x7f972015bf20 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.798+0000 7f972838d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97200d0630 con 0x7f972009a310 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.798+0000 7f9726129700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f972015bf20 0x7f97200cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.798+0000 7f9725928700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f97200cfaf0 0x7f9720099c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45676/0 (socket says 172.21.15.179:45676) 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.798+0000 7f9725928700 1 -- 172.21.15.179:0/2078167911 learned_addr learned my addr 172.21.15.179:0/2078167911 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f972692a700 1 --2- 172.21.15.179:0/2078167911 >> v2:172.21.15.190:3300/0 conn(0x7f972009a310 0x7f97200ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9726129700 1 -- 172.21.15.179:0/2078167911 >> v2:172.21.15.190:3300/0 conn(0x7f972009a310 msgr2=0x7f97200ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9726129700 1 --2- 172.21.15.179:0/2078167911 >> v2:172.21.15.190:3300/0 conn(0x7f972009a310 0x7f97200ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9726129700 1 -- 172.21.15.179:0/2078167911 >> v1:172.21.15.179:6789/0 conn(0x7f97200cfaf0 legacy=0x7f9720099c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9726129700 1 -- 172.21.15.179:0/2078167911 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97200cc700 con 0x7f972015bf20 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9725127700 1 -- 172.21.15.179:0/2078167911 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176100799 0 0) 0x7f97200d0070 con 0x7f97200cfaf0 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9726129700 1 --2- 172.21.15.179:0/2078167911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97200cf5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f972015f800 tx=0x7f9710009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dd177dd6eefbe5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9725127700 1 -- 172.21.15.179:0/2078167911 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710011830 con 0x7f972015bf20 2023-12-07T00:14:17.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9725127700 1 -- 172.21.15.179:0/2078167911 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710011990 con 0x7f972015bf20 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f9725127700 1 -- 172.21.15.179:0/2078167911 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710011d20 con 0x7f972015bf20 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f972838d700 1 -- 172.21.15.179:0/2078167911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 msgr2=0x7f97200cf5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.799+0000 7f972838d700 1 --2- 172.21.15.179:0/2078167911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97200cf5b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f972015f800 tx=0x7f9710009b20 comp rx=0 tx=0).stop 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.800+0000 7f972838d700 1 -- 172.21.15.179:0/2078167911 shutdown_connections 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.800+0000 7f972838d700 1 --2- 172.21.15.179:0/2078167911 >> v2:172.21.15.190:3300/0 conn(0x7f972009a310 0x7f97200ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.800+0000 7f972838d700 1 --2- 172.21.15.179:0/2078167911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97200cf5b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.800+0000 7f972838d700 1 -- 172.21.15.179:0/2078167911 >> 172.21.15.179:0/2078167911 conn(0x7f97200b34d0 msgr2=0x7f97200b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.800+0000 7f972838d700 1 -- 172.21.15.179:0/2078167911 shutdown_connections 2023-12-07T00:14:17.803 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.800+0000 7f972838d700 1 -- 172.21.15.179:0/2078167911 wait complete. 2023-12-07T00:14:17.806 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.801+0000 7f972838d700 1 Processor -- start 2023-12-07T00:14:17.806 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.801+0000 7f972838d700 1 -- start start 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.801+0000 7f972838d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f972009a310 0x7f97201545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.801+0000 7f972838d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97200cfaf0 0x7f9720154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972838d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97201f7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972838d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97200b6ee0 con 0x7f972015bf20 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972838d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97200c5690 con 0x7f97200cfaf0 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972838d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97200c5970 con 0x7f972009a310 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97201f7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97201f7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38784/0 (socket says 172.21.15.179:38784) 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 -- 172.21.15.179:0/3125283403 learned_addr learned my addr 172.21.15.179:0/3125283403 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f9726129700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f972009a310 0x7f97201545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f9725928700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97200cfaf0 0x7f9720154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 -- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f972009a310 msgr2=0x7f97201545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f972009a310 0x7f97201545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 -- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97200cfaf0 msgr2=0x7f9720154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:17.807 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97200cfaf0 0x7f9720154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 -- 172.21.15.179:0/3125283403 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100094a0 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f9725928700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97200cfaf0 0x7f9720154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972692a700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97201f7dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9718007de0 tx=0x7f971800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f9716ffd700 1 -- 172.21.15.179:0/3125283403 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f971800ede0 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f9716ffd700 1 -- 172.21.15.179:0/3125283403 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718014420 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97200c5c50 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f9716ffd700 1 -- 172.21.15.179:0/3125283403 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97180147d0 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.802+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97201f84f0 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.803+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97200685f0 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.804+0000 7f9716ffd700 1 -- 172.21.15.179:0/3125283403 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9718014930 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.804+0000 7f9716ffd700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f970406aed0 0x7f970406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.804+0000 7f9726129700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f970406aed0 0x7f970406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.804+0000 7f9716ffd700 1 -- 172.21.15.179:0/3125283403 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f971808a010 con 0x7f972015bf20 2023-12-07T00:14:17.808 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.805+0000 7f9726129700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f970406aed0 0x7f970406d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97100090b0 tx=0x7f971001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:17.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.809+0000 7f9716ffd700 1 -- 172.21.15.179:0/3125283403 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9718054df0 con 0x7f972015bf20 2023-12-07T00:14:17.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:17.999+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f97200c52b0 con 0x7f972015bf20 2023-12-07T00:14:18.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.643+0000 7f9716ffd700 1 -- 172.21.15.179:0/3125283403 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9718058410 con 0x7f972015bf20 2023-12-07T00:14:18.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f970406aed0 msgr2=0x7f970406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:18.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f970406aed0 0x7f970406d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97100090b0 tx=0x7f971001c040 comp rx=0 tx=0).stop 2023-12-07T00:14:18.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 msgr2=0x7f97201f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:18.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97201f7dd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9718007de0 tx=0x7f971800e3c0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 shutdown_connections 2023-12-07T00:14:18.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f970406aed0 0x7f970406d390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f972015bf20 0x7f97201f7dd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f972009a310 0x7f97201545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 --2- 172.21.15.179:0/3125283403 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f97200cfaf0 0x7f9720154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.649+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 >> 172.21.15.179:0/3125283403 conn(0x7f97200b34d0 msgr2=0x7f97200d0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:18.650 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.651+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 shutdown_connections 2023-12-07T00:14:18.654 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.655+0000 7f972838d700 1 -- 172.21.15.179:0/3125283403 wait complete. 2023-12-07T00:14:18.662 INFO:teuthology.orchestra.run.smithi179.stderr:set pool 4 allow_ec_overwrites to true 2023-12-07T00:14:18.681 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-07T00:14:18.806 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.807+0000 7f322db9c700 1 Processor -- start 2023-12-07T00:14:18.806 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.807+0000 7f322db9c700 1 -- start start 2023-12-07T00:14:18.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.807+0000 7f322db9c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f322815ab70 0x7f3228070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:18.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.807+0000 7f322db9c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322806f960 con 0x7f32280ce770 2023-12-07T00:14:18.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.807+0000 7f322db9c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32280cf110 con 0x7f32280d0ed0 2023-12-07T00:14:18.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.807+0000 7f322db9c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322815af50 con 0x7f322815ab70 2023-12-07T00:14:18.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.807+0000 7f3226ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f32280ce770 0x7f32280d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45690/0 (socket says 172.21.15.179:45690) 2023-12-07T00:14:18.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.807+0000 7f3226ffd700 1 -- 172.21.15.179:0/3750461024 learned_addr learned my addr 172.21.15.179:0/3750461024 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:18.814 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32277fe700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f322815ab70 0x7f3228070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776221441 0 0) 0x7f322806f960 con 0x7f32280ce770 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32100035b0 con 0x7f32280ce770 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673209550 0 0) 0x7f32280cf110 con 0x7f32280d0ed0 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f322806f960 con 0x7f32280d0ed0 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1439995659 0 0) 0x7f32100035b0 con 0x7f32280ce770 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f322815ab70 msgr2=0x7f3228070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f322815ab70 0x7f3228070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 >> v1:172.21.15.190:6789/0 conn(0x7f32280d0ed0 legacy=0x7f32280adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32280cf3f0 con 0x7f32280ce770 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f3218001670 con 0x7f32280ce770 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 >> v1:172.21.15.179:6789/0 conn(0x7f32280ce770 legacy=0x7f32280d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210003bc0 0x7f3210003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3210004850 0x7f3210004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3210005210 0x7f321000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:18.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322815af50 con 0x7f3210005210 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321000c140 con 0x7f3210003bc0 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321000c300 con 0x7f3210004850 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32277fe700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f322815ab70 0x7f3228070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f3227fff700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3210005210 0x7f321000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f3226ffd700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3210004850 0x7f3210004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f32277fe700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210003bc0 0x7f3210003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f3227fff700 1 -- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3210004850 msgr2=0x7f3210004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f3227fff700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3210004850 0x7f3210004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f3227fff700 1 -- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210003bc0 msgr2=0x7f3210003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f3227fff700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210003bc0 0x7f3210003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.808+0000 7f3227fff700 1 -- 172.21.15.179:0/3750461024 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100035b0 con 0x7f3210005210 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f3227fff700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3210005210 0x7f321000ba10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f322000c2f0 tx=0x7f3210005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97531e1bc6716edc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220001f20 con 0x7f3210005210 2023-12-07T00:14:18.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322000ce70 con 0x7f3210005210 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f32267fc700 1 -- 172.21.15.179:0/3750461024 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220003c20 con 0x7f3210005210 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f322db9c700 1 -- 172.21.15.179:0/3750461024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3210005210 msgr2=0x7f321000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f322db9c700 1 --2- 172.21.15.179:0/3750461024 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3210005210 0x7f321000ba10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f322000c2f0 tx=0x7f3210005880 comp rx=0 tx=0).stop 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f3227fff700 1 -- 172.21.15.179:0/3750461024 reap_dead start 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f322db9c700 1 -- 172.21.15.179:0/3750461024 shutdown_connections 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f322db9c700 1 -- 172.21.15.179:0/3750461024 >> 172.21.15.179:0/3750461024 conn(0x7f3228099a40 msgr2=0x7f3228099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f322db9c700 1 -- 172.21.15.179:0/3750461024 shutdown_connections 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.809+0000 7f322db9c700 1 -- 172.21.15.179:0/3750461024 wait complete. 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.810+0000 7f322db9c700 1 Processor -- start 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f322db9c700 1 -- start start 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f322db9c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210005210 0x7f322806b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:18.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f322db9c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32280cb9a0 0x7f32280b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f322db9c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32280b56f0 0x7f3228147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f322db9c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322806fc40 con 0x7f32280cb9a0 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f322db9c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322814b960 con 0x7f3210005210 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f322db9c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322814ace0 con 0x7f32280b56f0 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f3226ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32280cb9a0 0x7f32280b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f3226ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32280cb9a0 0x7f32280b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38802/0 (socket says 172.21.15.179:38802) 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.811+0000 7f3226ffd700 1 -- 172.21.15.179:0/2252977974 learned_addr learned my addr 172.21.15.179:0/2252977974 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f3227fff700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32280b56f0 0x7f3228147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f32277fe700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210005210 0x7f322806b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f3226ffd700 1 -- 172.21.15.179:0/2252977974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32280b56f0 msgr2=0x7f3228147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f3226ffd700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32280b56f0 0x7f3228147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f3226ffd700 1 -- 172.21.15.179:0/2252977974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210005210 msgr2=0x7f322806b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f3226ffd700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210005210 0x7f322806b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:18.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f3226ffd700 1 -- 172.21.15.179:0/2252977974 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322814afc0 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f3226ffd700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32280cb9a0 0x7f32280b3a80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3218007340 tx=0x7f3218007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f320ffff700 1 -- 172.21.15.179:0/2252977974 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32180010d0 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f320ffff700 1 -- 172.21.15.179:0/2252977974 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321800f660 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322814b2a0 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f320ffff700 1 -- 172.21.15.179:0/2252977974 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800fa10 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.812+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322806b750 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.813+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322806b910 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.814+0000 7f320ffff700 1 -- 172.21.15.179:0/2252977974 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f321800fb70 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.814+0000 7f320ffff700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f321406aed0 0x7f321406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.814+0000 7f32277fe700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f321406aed0 0x7f321406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.814+0000 7f320ffff700 1 -- 172.21.15.179:0/2252977974 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f3218089740 con 0x7f32280cb9a0 2023-12-07T00:14:18.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.814+0000 7f32277fe700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f321406aed0 0x7f321406d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32280b69f0 tx=0x7f321c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:18.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:18.819+0000 7f320ffff700 1 -- 172.21.15.179:0/2252977974 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3218054520 con 0x7f32280cb9a0 2023-12-07T00:14:19.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.055+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f32280685f0 con 0x7f32280cb9a0 2023-12-07T00:14:19.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.684+0000 7f320ffff700 1 -- 172.21.15.179:0/2252977974 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f3218057b40 con 0x7f32280cb9a0 2023-12-07T00:14:19.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f321406aed0 msgr2=0x7f321406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:19.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f321406aed0 0x7f321406d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f32280b69f0 tx=0x7f321c008040 comp rx=0 tx=0).stop 2023-12-07T00:14:19.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32280cb9a0 msgr2=0x7f32280b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:19.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32280cb9a0 0x7f32280b3a80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3218007340 tx=0x7f3218007650 comp rx=0 tx=0).stop 2023-12-07T00:14:19.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 shutdown_connections 2023-12-07T00:14:19.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f321406aed0 0x7f321406d390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f32280b56f0 0x7f3228147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3210005210 0x7f322806b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 --2- 172.21.15.179:0/2252977974 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f32280cb9a0 0x7f32280b3a80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 >> 172.21.15.179:0/2252977974 conn(0x7f3228099a40 msgr2=0x7f32280c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:19.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 shutdown_connections 2023-12-07T00:14:19.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.687+0000 7f322db9c700 1 -- 172.21.15.179:0/2252977974 wait complete. 2023-12-07T00:14:19.687 INFO:teuthology.orchestra.run.smithi179.stderr:added data pool 4 to fsmap 2023-12-07T00:14:19.700 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:14:19.822 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.822+0000 7f58bcfa4700 1 Processor -- start 2023-12-07T00:14:19.822 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.822+0000 7f58bcfa4700 1 -- start start 2023-12-07T00:14:19.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.823+0000 7f58bcfa4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58b806d9d0 0x7f58b8099c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:19.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.823+0000 7f58bcfa4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b809a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:19.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.823+0000 7f58bcfa4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b80cd920 con 0x7f58b80d0490 2023-12-07T00:14:19.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.823+0000 7f58bcfa4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b80ccd10 con 0x7f58b806d9d0 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.823+0000 7f58bcfa4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80ccff0 con 0x7f58b80cddb0 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b659c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f58b806d9d0 0x7f58b8099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b6d9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f58b80d0490 0x7f58b80d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45714/0 (socket says 172.21.15.179:45714) 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b6d9d700 1 -- 172.21.15.179:0/173867275 learned_addr learned my addr 172.21.15.179:0/173867275 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b5d9b700 1 --2- 172.21.15.179:0/173867275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b809a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b659c700 1 -- 172.21.15.179:0/173867275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 msgr2=0x7f58b809a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b659c700 1 --2- 172.21.15.179:0/173867275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b809a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b659c700 1 -- 172.21.15.179:0/173867275 >> v1:172.21.15.179:6789/0 conn(0x7f58b80d0490 legacy=0x7f58b80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b659c700 1 -- 172.21.15.179:0/173867275 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80cd2d0 con 0x7f58b806d9d0 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b559a700 1 -- 172.21.15.179:0/173867275 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310913408 0 0) 0x7f58b80cd920 con 0x7f58b80d0490 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b5d9b700 1 --2- 172.21.15.179:0/173867275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b809a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b659c700 1 --2- 172.21.15.179:0/173867275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b806d9d0 0x7f58b8099c00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009840 tx=0x7f58ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5899de325c774b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b559a700 1 -- 172.21.15.179:0/173867275 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac011830 con 0x7f58b806d9d0 2023-12-07T00:14:19.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b559a700 1 -- 172.21.15.179:0/173867275 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac011990 con 0x7f58b806d9d0 2023-12-07T00:14:19.826 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.824+0000 7f58b559a700 1 -- 172.21.15.179:0/173867275 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac011d20 con 0x7f58b806d9d0 2023-12-07T00:14:19.826 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.825+0000 7f58bcfa4700 1 -- 172.21.15.179:0/173867275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b806d9d0 msgr2=0x7f58b8099c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:19.826 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.825+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/173867275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b806d9d0 0x7f58b8099c00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009840 tx=0x7f58ac009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:19.826 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.825+0000 7f58bcfa4700 1 -- 172.21.15.179:0/173867275 shutdown_connections 2023-12-07T00:14:19.826 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.825+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/173867275 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b806d9d0 0x7f58b8099c00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.826 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.825+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/173867275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b809a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.826 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.825+0000 7f58bcfa4700 1 -- 172.21.15.179:0/173867275 >> 172.21.15.179:0/173867275 conn(0x7f58b80b3550 msgr2=0x7f58b80b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:19.826 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.825+0000 7f58bcfa4700 1 -- 172.21.15.179:0/173867275 shutdown_connections 2023-12-07T00:14:19.827 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.825+0000 7f58bcfa4700 1 -- 172.21.15.179:0/173867275 wait complete. 2023-12-07T00:14:19.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.826+0000 7f58bcfa4700 1 Processor -- start 2023-12-07T00:14:19.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.827+0000 7f58bcfa4700 1 -- start start 2023-12-07T00:14:19.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.827+0000 7f58bcfa4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b806d9d0 0x7f58b814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.827+0000 7f58bcfa4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b80c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.827+0000 7f58bcfa4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b80d0490 0x7f58b814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.827+0000 7f58bcfa4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b814bbd0 con 0x7f58b80d0490 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.827+0000 7f58bcfa4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80c5730 con 0x7f58b806d9d0 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.827+0000 7f58bcfa4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b80c5a10 con 0x7f58b80cddb0 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b80d0490 0x7f58b814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b80d0490 0x7f58b814bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38818/0 (socket says 172.21.15.179:38818) 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 -- 172.21.15.179:0/1218741714 learned_addr learned my addr 172.21.15.179:0/1218741714 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b659c700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b806d9d0 0x7f58b814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b5d9b700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b80c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 -- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 msgr2=0x7f58b80c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b80c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 -- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b806d9d0 msgr2=0x7f58b814b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b806d9d0 0x7f58b814b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 -- 172.21.15.179:0/1218741714 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0094a0 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b659c700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b806d9d0 0x7f58b814b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b5d9b700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b80c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58b6d9d700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b80d0490 0x7f58b814bee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58b000cba0 tx=0x7f58b000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58a6ffd700 1 -- 172.21.15.179:0/1218741714 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b000ab80 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58a6ffd700 1 -- 172.21.15.179:0/1218741714 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b000ad00 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b80c5cf0 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58a6ffd700 1 -- 172.21.15.179:0/1218741714 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0007310 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.828+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b80c62b0 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.829+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b80c5480 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.830+0000 7f58a6ffd700 1 -- 172.21.15.179:0/1218741714 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f58b0007470 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.830+0000 7f58a6ffd700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f589806aed0 0x7f589806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.830+0000 7f58a6ffd700 1 -- 172.21.15.179:0/1218741714 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f58b00897f0 con 0x7f58b80d0490 2023-12-07T00:14:19.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.830+0000 7f58b659c700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f589806aed0 0x7f589806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:19.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.830+0000 7f58b659c700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f589806aed0 0x7f589806d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0090b0 tx=0x7f58ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:19.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:19.834+0000 7f58a6ffd700 1 -- 172.21.15.179:0/1218741714 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f58b0054520 con 0x7f58b80d0490 2023-12-07T00:14:20.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.071+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58b80685f0 con 0x7f58b80d0490 2023-12-07T00:14:20.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.071+0000 7f58a6ffd700 1 -- 172.21.15.179:0/1218741714 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f58b0018020 con 0x7f58b80d0490 2023-12-07T00:14:20.071 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:20.071 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:19.056655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f589806aed0 msgr2=0x7f589806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f589806aed0 0x7f589806d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f58ac0090b0 tx=0x7f58ac008030 comp rx=0 tx=0).stop 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b80d0490 msgr2=0x7f58b814bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b80d0490 0x7f58b814bee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58b000cba0 tx=0x7f58b000cf60 comp rx=0 tx=0).stop 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 shutdown_connections 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f589806aed0 0x7f589806d390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f58b80d0490 0x7f58b814bee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f58b806d9d0 0x7f58b814b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 --2- 172.21.15.179:0/1218741714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f58b80cddb0 0x7f58b80c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.073+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 >> 172.21.15.179:0/1218741714 conn(0x7f58b80b3550 msgr2=0x7f58b80d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:20.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.074+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 shutdown_connections 2023-12-07T00:14:20.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.074+0000 7f58bcfa4700 1 -- 172.21.15.179:0/1218741714 wait complete. 2023-12-07T00:14:20.074 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 7 2023-12-07T00:14:20.085 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:20.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.205+0000 7f5316384700 1 Processor -- start 2023-12-07T00:14:20.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.205+0000 7f5316384700 1 -- start start 2023-12-07T00:14:20.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.205+0000 7f5316384700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f531015bde0 0x7f53100d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.205+0000 7f5316384700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53100cd020 0x7f53100cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.205+0000 7f5316384700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531009ab50 con 0x7f5310099c00 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.205+0000 7f5316384700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53100cf630 con 0x7f531015bde0 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.205+0000 7f5316384700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53100cf8f0 con 0x7f53100cd020 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.205+0000 7f530ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f531015bde0 0x7f53100d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530ffff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f531015bde0 0x7f53100d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38822/0 (socket says 172.21.15.179:38822) 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530ffff700 1 -- 172.21.15.179:0/4290105309 learned_addr learned my addr 172.21.15.179:0/4290105309 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530f7fe700 1 --2- 172.21.15.179:0/4290105309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53100cd020 0x7f53100cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530ffff700 1 -- 172.21.15.179:0/4290105309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53100cd020 msgr2=0x7f53100cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530ffff700 1 --2- 172.21.15.179:0/4290105309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53100cd020 0x7f53100cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530ffff700 1 -- 172.21.15.179:0/4290105309 >> v1:172.21.15.190:6789/0 conn(0x7f5310099c00 legacy=0x7f531015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530ffff700 1 -- 172.21.15.179:0/4290105309 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53100cfbd0 con 0x7f531015bde0 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530f7fe700 1 --2- 172.21.15.179:0/4290105309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53100cd020 0x7f53100cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530ffff700 1 --2- 172.21.15.179:0/4290105309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100d06b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53000098f0 tx=0x7f5300009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0c30052c1c88d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530effd700 1 -- 172.21.15.179:0/4290105309 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300004230 con 0x7f531015bde0 2023-12-07T00:14:20.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530effd700 1 -- 172.21.15.179:0/4290105309 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5300004390 con 0x7f531015bde0 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.206+0000 7f530effd700 1 -- 172.21.15.179:0/4290105309 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53000036a0 con 0x7f531015bde0 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.207+0000 7f5316384700 1 -- 172.21.15.179:0/4290105309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 msgr2=0x7f53100d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.207+0000 7f5316384700 1 --2- 172.21.15.179:0/4290105309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100d06b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f53000098f0 tx=0x7f5300009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.207+0000 7f5316384700 1 -- 172.21.15.179:0/4290105309 shutdown_connections 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.207+0000 7f5316384700 1 --2- 172.21.15.179:0/4290105309 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100d06b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.207+0000 7f5316384700 1 --2- 172.21.15.179:0/4290105309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53100cd020 0x7f53100cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.207+0000 7f5316384700 1 -- 172.21.15.179:0/4290105309 >> 172.21.15.179:0/4290105309 conn(0x7f53100b3550 msgr2=0x7f53100b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.207+0000 7f5316384700 1 -- 172.21.15.179:0/4290105309 shutdown_connections 2023-12-07T00:14:20.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.207+0000 7f5316384700 1 -- 172.21.15.179:0/4290105309 wait complete. 2023-12-07T00:14:20.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.208+0000 7f5316384700 1 Processor -- start 2023-12-07T00:14:20.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.208+0000 7f5316384700 1 -- start start 2023-12-07T00:14:20.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5316384700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5310099c00 0x7f53101f1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5316384700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53100cd020 0x7f531015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5316384700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5316384700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53100b4c50 con 0x7f531015bde0 2023-12-07T00:14:20.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5316384700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53100b6c90 con 0x7f53100cd020 2023-12-07T00:14:20.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5316384700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53100b5800 con 0x7f5310099c00 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38830/0 (socket says 172.21.15.179:38830) 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 -- 172.21.15.179:0/2031324192 learned_addr learned my addr 172.21.15.179:0/2031324192 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f530f7fe700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53100cd020 0x7f531015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f530ffff700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5310099c00 0x7f53101f1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 -- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5310099c00 msgr2=0x7f53101f1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5310099c00 0x7f53101f1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 -- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53100cd020 msgr2=0x7f531015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53100cd020 0x7f531015c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 -- 172.21.15.179:0/2031324192 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5300009550 con 0x7f531015bde0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f530f7fe700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53100cd020 0x7f531015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5314921700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100c8020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f530800cc10 tx=0x7f530800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f530cff9700 1 -- 172.21.15.179:0/2031324192 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530800abb0 con 0x7f531015bde0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f530cff9700 1 -- 172.21.15.179:0/2031324192 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530800ad10 con 0x7f531015bde0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53100b74f0 con 0x7f531015bde0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.209+0000 7f530cff9700 1 -- 172.21.15.179:0/2031324192 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5308012660 con 0x7f531015bde0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.210+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53100b6f30 con 0x7f531015bde0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.210+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53100685f0 con 0x7f531015bde0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.211+0000 7f530cff9700 1 -- 172.21.15.179:0/2031324192 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53080127c0 con 0x7f531015bde0 2023-12-07T00:14:20.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.211+0000 7f530cff9700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f52fc06aed0 0x7f52fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.211+0000 7f530cff9700 1 -- 172.21.15.179:0/2031324192 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5308089fd0 con 0x7f531015bde0 2023-12-07T00:14:20.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.211+0000 7f530ffff700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f52fc06aed0 0x7f52fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.212+0000 7f530ffff700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f52fc06aed0 0x7f52fc06d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5300000c00 tx=0x7f5300008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.216+0000 7f530cff9700 1 -- 172.21.15.179:0/2031324192 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5308054e20 con 0x7f531015bde0 2023-12-07T00:14:20.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.409+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53100b4460 con 0x7f531015bde0 2023-12-07T00:14:20.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.410+0000 7f530cff9700 1 -- 172.21.15.179:0/2031324192 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18371 (secure 0 0 0) 0x7f5308016020 con 0x7f531015bde0 2023-12-07T00:14:20.409 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:20.410 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":26,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:19.056444+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f52fc06aed0 msgr2=0x7f52fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f52fc06aed0 0x7f52fc06d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5300000c00 tx=0x7f5300008030 comp rx=0 tx=0).stop 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 msgr2=0x7f53100c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100c8020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f530800cc10 tx=0x7f530800a060 comp rx=0 tx=0).stop 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 shutdown_connections 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f52fc06aed0 0x7f52fc06d390 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f531015bde0 0x7f53100c8020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5310099c00 0x7f53101f1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 --2- 172.21.15.179:0/2031324192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53100cd020 0x7f531015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 >> 172.21.15.179:0/2031324192 conn(0x7f53100b3550 msgr2=0x7f53100b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 shutdown_connections 2023-12-07T00:14:20.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.412+0000 7f5316384700 1 -- 172.21.15.179:0/2031324192 wait complete. 2023-12-07T00:14:20.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:20.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.546+0000 7fc2cb5bd700 1 Processor -- start 2023-12-07T00:14:20.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.546+0000 7fc2cb5bd700 1 -- start start 2023-12-07T00:14:20.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2cb5bd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc2c4066ef0 0x7fc2c40b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2cb5bd700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c40673b0 con 0x7fc2c40ad0d0 2023-12-07T00:14:20.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2cb5bd700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c415e440 con 0x7fc2c40d0070 2023-12-07T00:14:20.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2cb5bd700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c40b04a0 con 0x7fc2c4066ef0 2023-12-07T00:14:20.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2c9b5a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc2c40ad0d0 0x7fc2c40ad580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45740/0 (socket says 172.21.15.179:45740) 2023-12-07T00:14:20.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2c9b5a700 1 -- 172.21.15.179:0/2026387379 learned_addr learned my addr 172.21.15.179:0/2026387379 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:20.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2c8b58700 1 --2- 172.21.15.179:0/2026387379 >> v2:172.21.15.190:3300/0 conn(0x7fc2c4066ef0 0x7fc2c40b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289204914 0 0) 0x7fc2c40673b0 con 0x7fc2c40ad0d0 2023-12-07T00:14:20.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b00035b0 con 0x7fc2c40ad0d0 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313157820 0 0) 0x7fc2c415e440 con 0x7fc2c40d0070 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2c40673b0 con 0x7fc2c40d0070 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3236220499 0 0) 0x7fc2b00035b0 con 0x7fc2c40ad0d0 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 >> v2:172.21.15.190:3300/0 conn(0x7fc2c4066ef0 msgr2=0x7fc2c40b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 --2- 172.21.15.179:0/2026387379 >> v2:172.21.15.190:3300/0 conn(0x7fc2c4066ef0 0x7fc2c40b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 >> v1:172.21.15.190:6789/0 conn(0x7fc2c40d0070 legacy=0x7fc2c40d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40afb00 con 0x7fc2c40ad0d0 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fc2bc0019f0 con 0x7fc2c40ad0d0 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 >> v1:172.21.15.179:6789/0 conn(0x7fc2c40ad0d0 legacy=0x7fc2c40ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2b0003b90 0x7fc2b0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2b0004850 0x7fc2b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0005280 0x7fc2b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c40b04a0 con 0x7fc2b0003b90 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b000c1e0 con 0x7fc2b0004850 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b000c3a0 con 0x7fc2b0005280 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2c9359700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2b0003b90 0x7fc2b0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2c8b58700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2b0004850 0x7fc2b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.547+0000 7fc2c9b5a700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0005280 0x7fc2b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2c9359700 1 -- 172.21.15.179:0/2026387379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0005280 msgr2=0x7fc2b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2c9359700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0005280 0x7fc2b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2c9359700 1 -- 172.21.15.179:0/2026387379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2b0004850 msgr2=0x7fc2b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2c9359700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2b0004850 0x7fc2b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2c9359700 1 -- 172.21.15.179:0/2026387379 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b00035b0 con 0x7fc2b0003b90 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2c9b5a700 1 -- 172.21.15.179:0/2026387379 reap_dead start 2023-12-07T00:14:20.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2c9359700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2b0003b90 0x7fc2b0003f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4001940 tx=0x7fc2b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bc665e44da5a01 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4001430 con 0x7fc2b0003b90 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b4001d70 con 0x7fc2b0003b90 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2bbfff700 1 -- 172.21.15.179:0/2026387379 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4005510 con 0x7fc2b0003b90 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2026387379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2b0003b90 msgr2=0x7fc2b0003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2cb5bd700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2b0003b90 0x7fc2b0003f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4001940 tx=0x7fc2b0005880 comp rx=0 tx=0).stop 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2026387379 shutdown_connections 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2cb5bd700 1 --2- 172.21.15.179:0/2026387379 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2b0003b90 0x7fc2b0003f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2026387379 >> 172.21.15.179:0/2026387379 conn(0x7fc2c4072660 msgr2=0x7fc2c40b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.548+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2026387379 shutdown_connections 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.549+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2026387379 wait complete. 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.550+0000 7fc2cb5bd700 1 Processor -- start 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.550+0000 7fc2cb5bd700 1 -- start start 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.550+0000 7fc2cb5bd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0003b90 0x7fc2c4160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.550+0000 7fc2cb5bd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c41563b0 0x7fc2c40c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.550+0000 7fc2cb5bd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c4154430 0x7fc2c41548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.550+0000 7fc2cb5bd700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4154df0 con 0x7fc2c4154430 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.550+0000 7fc2cb5bd700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4156830 con 0x7fc2c41563b0 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.550+0000 7fc2cb5bd700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4156a90 con 0x7fc2b0003b90 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c4154430 0x7fc2c41548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c4154430 0x7fc2c41548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38848/0 (socket says 172.21.15.179:38848) 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 -- 172.21.15.179:0/2436165463 learned_addr learned my addr 172.21.15.179:0/2436165463 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9359700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0003b90 0x7fc2c4160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c8b58700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c41563b0 0x7fc2c40c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 -- 172.21.15.179:0/2436165463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0003b90 msgr2=0x7fc2c4160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0003b90 0x7fc2c4160ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 -- 172.21.15.179:0/2436165463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c41563b0 msgr2=0x7fc2c40c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c41563b0 0x7fc2c40c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 -- 172.21.15.179:0/2436165463 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c4156d70 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2c9b5a700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c4154430 0x7fc2c41548b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40b2e60 tx=0x7fc2bc00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2b9ffb700 1 -- 172.21.15.179:0/2436165463 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00ebf0 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2b9ffb700 1 -- 172.21.15.179:0/2436165463 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc00ed70 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c4157050 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2b9ffb700 1 -- 172.21.15.179:0/2436165463 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc00eee0 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.551+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c40ca040 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.552+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c40ca800 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.552+0000 7fc2b9ffb700 1 -- 172.21.15.179:0/2436165463 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2bc013660 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.553+0000 7fc2b9ffb700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc2a806aed0 0x7fc2a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.553+0000 7fc2b9ffb700 1 -- 172.21.15.179:0/2436165463 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc2bc089e70 con 0x7fc2c4154430 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.553+0000 7fc2c9359700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc2a806aed0 0x7fc2a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.553+0000 7fc2c9359700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc2a806aed0 0x7fc2a806d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4000c00 tx=0x7fc2b400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.558+0000 7fc2b9ffb700 1 -- 172.21.15.179:0/2436165463 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2bc054ba0 con 0x7fc2c4154430 2023-12-07T00:14:20.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.752+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2c40ca2f0 con 0x7fc2c4154430 2023-12-07T00:14:20.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.753+0000 7fc2b9ffb700 1 -- 172.21.15.179:0/2436165463 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fc2c40ca2f0 con 0x7fc2c4154430 2023-12-07T00:14:20.752 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:20.752 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:20.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc2a806aed0 msgr2=0x7fc2a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc2a806aed0 0x7fc2a806d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4000c00 tx=0x7fc2b400a000 comp rx=0 tx=0).stop 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c4154430 msgr2=0x7fc2c41548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c4154430 0x7fc2c41548b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc2c40b2e60 tx=0x7fc2bc00e440 comp rx=0 tx=0).stop 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 shutdown_connections 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc2a806aed0 0x7fc2a806d390 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2c4154430 0x7fc2c41548b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2b0003b90 0x7fc2c4160ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 --2- 172.21.15.179:0/2436165463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2c41563b0 0x7fc2c40c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 >> 172.21.15.179:0/2436165463 conn(0x7fc2c4072660 msgr2=0x7fc2c406ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 shutdown_connections 2023-12-07T00:14:20.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.755+0000 7fc2cb5bd700 1 -- 172.21.15.179:0/2436165463 wait complete. 2023-12-07T00:14:20.780 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:14:20.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.900+0000 7f4a36c8c700 1 Processor -- start 2023-12-07T00:14:20.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.900+0000 7f4a36c8c700 1 -- start start 2023-12-07T00:14:20.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a36c8c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4a3015bf40 0x7f4a300cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a36c8c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a300af250 0x7f4a300af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a36c8c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300b1720 con 0x7f4a30099b20 2023-12-07T00:14:20.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a36c8c700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300afc20 con 0x7f4a300af250 2023-12-07T00:14:20.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a36c8c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300673f0 con 0x7f4a3015bf40 2023-12-07T00:14:20.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a35229700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a300af250 0x7f4a300af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a35229700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a300af250 0x7f4a300af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38858/0 (socket says 172.21.15.179:38858) 2023-12-07T00:14:20.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a35229700 1 -- 172.21.15.179:0/494316781 learned_addr learned my addr 172.21.15.179:0/494316781 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:20.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a35229700 1 -- 172.21.15.179:0/494316781 >> v2:172.21.15.190:3300/0 conn(0x7f4a3015bf40 msgr2=0x7f4a300cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:20.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a34a28700 1 --2- 172.21.15.179:0/494316781 >> v2:172.21.15.190:3300/0 conn(0x7f4a3015bf40 0x7f4a300cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a35229700 1 --2- 172.21.15.179:0/494316781 >> v2:172.21.15.190:3300/0 conn(0x7f4a3015bf40 0x7f4a300cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a35229700 1 -- 172.21.15.179:0/494316781 >> v1:172.21.15.190:6789/0 conn(0x7f4a30099b20 legacy=0x7f4a30066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:20.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a35229700 1 -- 172.21.15.179:0/494316781 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3006c670 con 0x7f4a300af250 2023-12-07T00:14:20.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a35229700 1 --2- 172.21.15.179:0/494316781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a300af6e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a30070a10 tx=0x7f4a2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fe9d76722e7419 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a2f7fe700 1 -- 172.21.15.179:0/494316781 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800e070 con 0x7f4a300af250 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a2f7fe700 1 -- 172.21.15.179:0/494316781 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a28003a20 con 0x7f4a300af250 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.901+0000 7f4a2f7fe700 1 -- 172.21.15.179:0/494316781 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28003dd0 con 0x7f4a300af250 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.902+0000 7f4a36c8c700 1 -- 172.21.15.179:0/494316781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 msgr2=0x7f4a300af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.902+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/494316781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a300af6e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4a30070a10 tx=0x7f4a2800b330 comp rx=0 tx=0).stop 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.902+0000 7f4a36c8c700 1 -- 172.21.15.179:0/494316781 shutdown_connections 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.902+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/494316781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a300af6e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.902+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/494316781 >> v2:172.21.15.190:3300/0 conn(0x7f4a3015bf40 0x7f4a300cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.902+0000 7f4a36c8c700 1 -- 172.21.15.179:0/494316781 >> 172.21.15.179:0/494316781 conn(0x7f4a30072660 msgr2=0x7f4a300b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:20.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.902+0000 7f4a36c8c700 1 -- 172.21.15.179:0/494316781 shutdown_connections 2023-12-07T00:14:20.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.902+0000 7f4a36c8c700 1 -- 172.21.15.179:0/494316781 wait complete. 2023-12-07T00:14:20.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.903+0000 7f4a36c8c700 1 Processor -- start 2023-12-07T00:14:20.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.903+0000 7f4a36c8c700 1 -- start start 2023-12-07T00:14:20.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a36c8c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a30099b20 0x7f4a30154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a36c8c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a3014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a36c8c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a3015bf40 0x7f4a301f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a36c8c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301f5730 con 0x7f4a300af250 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a36c8c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301f5a10 con 0x7f4a30099b20 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a36c8c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3009a380 con 0x7f4a3015bf40 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a3014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a3014dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38862/0 (socket says 172.21.15.179:38862) 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a2ffff700 1 -- 172.21.15.179:0/86510839 learned_addr learned my addr 172.21.15.179:0/86510839 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a2ffff700 1 -- 172.21.15.179:0/86510839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a3015bf40 msgr2=0x7f4a301f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a35229700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a3015bf40 0x7f4a301f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a2ffff700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a3015bf40 0x7f4a301f4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a2ffff700 1 -- 172.21.15.179:0/86510839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a30099b20 msgr2=0x7f4a30154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a34a28700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a30099b20 0x7f4a30154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a2ffff700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a30099b20 0x7f4a30154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.904+0000 7f4a2ffff700 1 -- 172.21.15.179:0/86510839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28009b30 con 0x7f4a300af250 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.905+0000 7f4a2ffff700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a3014dad0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00c4a0 tx=0x7f4a1c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.905+0000 7f4a2d7fa700 1 -- 172.21.15.179:0/86510839 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0054e0 con 0x7f4a300af250 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.905+0000 7f4a2d7fa700 1 -- 172.21.15.179:0/86510839 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1c003680 con 0x7f4a300af250 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.905+0000 7f4a2d7fa700 1 -- 172.21.15.179:0/86510839 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c003a30 con 0x7f4a300af250 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.905+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3009a660 con 0x7f4a300af250 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.905+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3015f270 con 0x7f4a300af250 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.906+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3009a9d0 con 0x7f4a300af250 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.906+0000 7f4a2d7fa700 1 -- 172.21.15.179:0/86510839 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a1c003b90 con 0x7f4a300af250 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.906+0000 7f4a2d7fa700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a1406aed0 0x7f4a1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:20.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.907+0000 7f4a2d7fa700 1 -- 172.21.15.179:0/86510839 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a1c0889c0 con 0x7f4a300af250 2023-12-07T00:14:20.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.907+0000 7f4a34a28700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a1406aed0 0x7f4a1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:20.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.907+0000 7f4a34a28700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a1406aed0 0x7f4a1406d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400b840 tx=0x7f4a24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:20.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:20.911+0000 7f4a2d7fa700 1 -- 172.21.15.179:0/86510839 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a1c053780 con 0x7f4a300af250 2023-12-07T00:14:21.143 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.144+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a3009a1c0 con 0x7f4a300af250 2023-12-07T00:14:21.143 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.144+0000 7f4a2d7fa700 1 -- 172.21.15.179:0/86510839 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f4a1c056da0 con 0x7f4a300af250 2023-12-07T00:14:21.143 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:21.144 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:19.056655+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-07T00:14:21.146 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a1406aed0 msgr2=0x7f4a1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:21.146 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a1406aed0 0x7f4a1406d390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400b840 tx=0x7f4a24008040 comp rx=0 tx=0).stop 2023-12-07T00:14:21.146 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 msgr2=0x7f4a3014dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a3014dad0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00c4a0 tx=0x7f4a1c00c860 comp rx=0 tx=0).stop 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 shutdown_connections 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a1406aed0 0x7f4a1406d390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a3015bf40 0x7f4a301f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a30099b20 0x7f4a30154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 --2- 172.21.15.179:0/86510839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a300af250 0x7f4a3014dad0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 >> 172.21.15.179:0/86510839 conn(0x7f4a30072660 msgr2=0x7f4a300cf610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 shutdown_connections 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.146+0000 7f4a36c8c700 1 -- 172.21.15.179:0/86510839 wait complete. 2023-12-07T00:14:21.147 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 7 2023-12-07T00:14:21.158 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:21.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.280+0000 7f0da1c5a700 1 Processor -- start 2023-12-07T00:14:21.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.280+0000 7f0da1c5a700 1 -- start start 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0da1c5a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0d9c15ddf0 0x7f0d9c1618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0da1c5a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0da1c5a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c15e1d0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0da1c5a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c0d2150 con 0x7f0d9c15ddf0 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0da1c5a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0d13c0 con 0x7f0d9c0b9970 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0d9c15ddf0 0x7f0d9c1618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9bfff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f0d9c0d0f10 0x7f0d9c0b5660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45774/0 (socket says 172.21.15.179:45774) 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9bfff700 1 -- 172.21.15.179:0/3793309620 learned_addr learned my addr 172.21.15.179:0/3793309620 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:21.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9affd700 1 --2- 172.21.15.179:0/3793309620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9b7fe700 1 -- 172.21.15.179:0/3793309620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 msgr2=0x7f0d9c0d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9b7fe700 1 --2- 172.21.15.179:0/3793309620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0d09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9b7fe700 1 -- 172.21.15.179:0/3793309620 >> v1:172.21.15.179:6789/0 conn(0x7f0d9c0d0f10 legacy=0x7f0d9c0b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9b7fe700 1 -- 172.21.15.179:0/3793309620 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c162820 con 0x7f0d9c15ddf0 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9a7fc700 1 -- 172.21.15.179:0/3793309620 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008232566 0 0) 0x7f0d9c15e1d0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.281+0000 7f0d9b7fe700 1 --2- 172.21.15.179:0/3793309620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c15ddf0 0x7f0d9c1618f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009840 tx=0x7f0d90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af42cdb9d8a9d6e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0d9a7fc700 1 -- 172.21.15.179:0/3793309620 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90011830 con 0x7f0d9c15ddf0 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0d9a7fc700 1 -- 172.21.15.179:0/3793309620 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d90011990 con 0x7f0d9c15ddf0 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0d9a7fc700 1 -- 172.21.15.179:0/3793309620 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d90011d20 con 0x7f0d9c15ddf0 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0da1c5a700 1 -- 172.21.15.179:0/3793309620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c15ddf0 msgr2=0x7f0d9c1618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/3793309620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c15ddf0 0x7f0d9c1618f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0d90009840 tx=0x7f0d90009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0da1c5a700 1 -- 172.21.15.179:0/3793309620 shutdown_connections 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/3793309620 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c15ddf0 0x7f0d9c1618f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/3793309620 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0da1c5a700 1 -- 172.21.15.179:0/3793309620 >> 172.21.15.179:0/3793309620 conn(0x7f0d9c06c970 msgr2=0x7f0d9c06cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:21.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0da1c5a700 1 -- 172.21.15.179:0/3793309620 shutdown_connections 2023-12-07T00:14:21.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.282+0000 7f0da1c5a700 1 -- 172.21.15.179:0/3793309620 wait complete. 2023-12-07T00:14:21.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.283+0000 7f0da1c5a700 1 Processor -- start 2023-12-07T00:14:21.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0da1c5a700 1 -- start start 2023-12-07T00:14:21.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0da1c5a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:21.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0da1c5a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c0d0f10 0x7f0d9c1f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:21.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0da1c5a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d9c15ddf0 0x7f0d9c0d2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:21.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0da1c5a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0cc2b0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0da1c5a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0cc590 con 0x7f0d9c15ddf0 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0da1c5a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0cc870 con 0x7f0d9c0b9970 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0d9affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c0d0f10 0x7f0d9c1f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0d9affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c0d0f10 0x7f0d9c1f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38876/0 (socket says 172.21.15.179:38876) 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0d9affd700 1 -- 172.21.15.179:0/1204258321 learned_addr learned my addr 172.21.15.179:0/1204258321 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.284+0000 7f0d9bfff700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d9c15ddf0 0x7f0d9c0d2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d9b7fe700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d9affd700 1 -- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 msgr2=0x7f0d9c0c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d9affd700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d9affd700 1 -- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d9c15ddf0 msgr2=0x7f0d9c0d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d9affd700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d9c15ddf0 0x7f0d9c0d2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d9affd700 1 -- 172.21.15.179:0/1204258321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d900094a0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d9b7fe700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d9affd700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c0d0f10 0x7f0d9c1f4780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00d800 tx=0x7f0d8c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d83fff700 1 -- 172.21.15.179:0/1204258321 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c0125f0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d83fff700 1 -- 172.21.15.179:0/1204258321 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c012750 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c0ccb50 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0d83fff700 1 -- 172.21.15.179:0/1204258321 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c012ae0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.285+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c1f4cc0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.286+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c0cc3f0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.286+0000 7f0d83fff700 1 -- 172.21.15.179:0/1204258321 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d8c012c40 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.287+0000 7f0d83fff700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0d8806aed0 0x7f0d8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.287+0000 7f0d83fff700 1 -- 172.21.15.179:0/1204258321 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d8c0899f0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.287+0000 7f0d9b7fe700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0d8806aed0 0x7f0d8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:21.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.287+0000 7f0d9b7fe700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0d8806aed0 0x7f0d8806d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d900090b0 tx=0x7f0d90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:21.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.291+0000 7f0d83fff700 1 -- 172.21.15.179:0/1204258321 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d9c0cc3f0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.482+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d9c0cc3f0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.483+0000 7f0d83fff700 1 -- 172.21.15.179:0/1204258321 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f0d9c0cc3f0 con 0x7f0d9c0d0f10 2023-12-07T00:14:21.482 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:21.482 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:21.484 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0d8806aed0 msgr2=0x7f0d8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0d8806aed0 0x7f0d8806d390 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0d900090b0 tx=0x7f0d90008030 comp rx=0 tx=0).stop 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c0d0f10 msgr2=0x7f0d9c1f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c0d0f10 0x7f0d9c1f4780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00d800 tx=0x7f0d8c00db10 comp rx=0 tx=0).stop 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 shutdown_connections 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0d8806aed0 0x7f0d8806d390 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d9c15ddf0 0x7f0d9c0d2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d9c0b9970 0x7f0d9c0c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 --2- 172.21.15.179:0/1204258321 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0d9c0d0f10 0x7f0d9c1f4780 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 >> 172.21.15.179:0/1204258321 conn(0x7f0d9c06c970 msgr2=0x7f0d9c06cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 shutdown_connections 2023-12-07T00:14:21.485 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:21.485+0000 7f0da1c5a700 1 -- 172.21.15.179:0/1204258321 wait complete. 2023-12-07T00:14:21.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-07T00:14:14.021089+0000', 'modified': '2023-12-07T00:14:19.056655+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6837/4041424409', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 4041424409}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 4041424409}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-07T00:14:21.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-07T00:14:21.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-07T00:14:22.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.024+0000 7fd0ef23d700 1 Processor -- start 2023-12-07T00:14:22.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.024+0000 7fd0ef23d700 1 -- start start 2023-12-07T00:14:22.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0ef23d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e815dd50 0x7fd0e81624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0ef23d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd0e815e130 0x7fd0e80d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0ef23d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd0e80ce430 0x7fd0e80d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0ef23d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e8162a00 con 0x7fd0e815e130 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0ef23d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80d1dc0 con 0x7fd0e80ce430 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0ef23d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80ce9f0 con 0x7fd0e815dd50 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd0e815e130 0x7fd0e80d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd0e815e130 0x7fd0e80d0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38882/0 (socket says 172.21.15.179:38882) 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 -- 172.21.15.179:0/2487967575 learned_addr learned my addr 172.21.15.179:0/2487967575 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0ed7da700 1 --2- 172.21.15.179:0/2487967575 >> v2:172.21.15.190:3300/0 conn(0x7fd0e80ce430 0x7fd0e80d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/2487967575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e815dd50 0x7fd0e81624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 -- 172.21.15.179:0/2487967575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e815dd50 msgr2=0x7fd0e81624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/2487967575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e815dd50 0x7fd0e81624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 -- 172.21.15.179:0/2487967575 >> v2:172.21.15.190:3300/0 conn(0x7fd0e80ce430 msgr2=0x7fd0e80d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/2487967575 >> v2:172.21.15.190:3300/0 conn(0x7fd0e80ce430 0x7fd0e80d0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 -- 172.21.15.179:0/2487967575 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80cecd0 con 0x7fd0e815e130 2023-12-07T00:14:22.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/2487967575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815e130 0x7fd0e80d0980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd0e81619f0 tx=0x7fd0d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8f91e34d28fddb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e77fe700 1 -- 172.21.15.179:0/2487967575 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400b870 con 0x7fd0e815e130 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e77fe700 1 -- 172.21.15.179:0/2487967575 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400b9d0 con 0x7fd0e815e130 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.025+0000 7fd0e77fe700 1 -- 172.21.15.179:0/2487967575 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400bd60 con 0x7fd0e815e130 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 -- 172.21.15.179:0/2487967575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815e130 msgr2=0x7fd0e80d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/2487967575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815e130 0x7fd0e80d0980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd0e81619f0 tx=0x7fd0d4009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 -- 172.21.15.179:0/2487967575 shutdown_connections 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/2487967575 >> v2:172.21.15.190:3300/0 conn(0x7fd0e80ce430 0x7fd0e80d0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/2487967575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e815dd50 0x7fd0e81624c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/2487967575 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815e130 0x7fd0e80d0980 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 -- 172.21.15.179:0/2487967575 >> 172.21.15.179:0/2487967575 conn(0x7fd0e806c8e0 msgr2=0x7fd0e806ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 -- 172.21.15.179:0/2487967575 shutdown_connections 2023-12-07T00:14:22.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.026+0000 7fd0ef23d700 1 -- 172.21.15.179:0/2487967575 wait complete. 2023-12-07T00:14:22.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.028+0000 7fd0ef23d700 1 Processor -- start 2023-12-07T00:14:22.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.028+0000 7fd0ef23d700 1 -- start start 2023-12-07T00:14:22.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ef23d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80ce430 0x7fd0e80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ef23d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815dd50 0x7fd0e80b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ef23d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e130 0x7fd0e8160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ef23d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80ce2b0 con 0x7fd0e815dd50 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ef23d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80cb7e0 con 0x7fd0e815e130 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ef23d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80aa900 con 0x7fd0e80ce430 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815dd50 0x7fd0e80b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815dd50 0x7fd0e80b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38890/0 (socket says 172.21.15.179:38890) 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 -- 172.21.15.179:0/3355695057 learned_addr learned my addr 172.21.15.179:0/3355695057 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80ce430 0x7fd0e80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ed7da700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e130 0x7fd0e8160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 -- 172.21.15.179:0/3355695057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80ce430 msgr2=0x7fd0e80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80ce430 0x7fd0e80cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 -- 172.21.15.179:0/3355695057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e130 msgr2=0x7fd0e8160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e130 0x7fd0e8160740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 -- 172.21.15.179:0/3355695057 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009550 con 0x7fd0e815dd50 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815dd50 0x7fd0e80b2760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4000c00 tx=0x7fd0d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e57fa700 1 -- 172.21.15.179:0/3355695057 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4004540 con 0x7fd0e815dd50 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e57fa700 1 -- 172.21.15.179:0/3355695057 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d40036a0 con 0x7fd0e815dd50 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ef23d700 1 -- 172.21.15.179:0/3355695057 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e80d32a0 con 0x7fd0e815dd50 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0e57fa700 1 -- 172.21.15.179:0/3355695057 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4003a50 con 0x7fd0e815dd50 2023-12-07T00:14:22.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.029+0000 7fd0ef23d700 1 -- 172.21.15.179:0/3355695057 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e80d3540 con 0x7fd0e815dd50 2023-12-07T00:14:22.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.031+0000 7fd0e57fa700 1 -- 172.21.15.179:0/3355695057 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0d4021070 con 0x7fd0e815dd50 2023-12-07T00:14:22.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.031+0000 7fd0e57fa700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.031+0000 7fd0e57fa700 1 -- 172.21.15.179:0/3355695057 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0d408aff0 con 0x7fd0e815dd50 2023-12-07T00:14:22.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.031+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.031+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009950 tx=0x7fd0dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.033+0000 7fd0fb436b80 1 Processor -- start 2023-12-07T00:14:22.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.033+0000 7fd0fb436b80 1 -- start start 2023-12-07T00:14:22.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe660840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 0x558bfe660d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 0x558bfe643e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfe58d770 con 0x558bfe61a080 2023-12-07T00:14:22.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfe574750 con 0x558bfe62fed0 2023-12-07T00:14:22.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bfe572070 con 0x558bfe617490 2023-12-07T00:14:22.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe660840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe660840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38896/0 (socket says 172.21.15.179:38896) 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 -- 172.21.15.179:0/3056078884 learned_addr learned my addr 172.21.15.179:0/3056078884 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 -- 172.21.15.179:0/3056078884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 msgr2=0x558bfe643e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3056078884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 0x558bfe643e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 -- 172.21.15.179:0/3056078884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 msgr2=0x558bfe660d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3056078884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 0x558bfe660d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 -- 172.21.15.179:0/3056078884 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bfe3ea5e0 con 0x558bfe61a080 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3056078884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe660840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0092f0 tx=0x7fd0dc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410a93523672d504 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0d27fc700 1 -- 172.21.15.179:0/3056078884 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0146e0 con 0x558bfe61a080 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.034+0000 7fd0d27fc700 1 -- 172.21.15.179:0/3056078884 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc019070 con 0x558bfe61a080 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0d27fc700 1 -- 172.21.15.179:0/3056078884 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc014a60 con 0x558bfe61a080 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3056078884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 msgr2=0x558bfe660840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3056078884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe660840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0092f0 tx=0x7fd0dc012000 comp rx=0 tx=0).stop 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3056078884 shutdown_connections 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3056078884 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 0x558bfe643e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3056078884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe660840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3056078884 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 0x558bfe660d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3056078884 >> 172.21.15.179:0/3056078884 conn(0x558bfe548310 msgr2=0x558bfe65ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:22.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3056078884 shutdown_connections 2023-12-07T00:14:22.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.035+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3056078884 wait complete. 2023-12-07T00:14:22.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.036+0000 7fd0fb436b80 1 -- start start 2023-12-07T00:14:22.037 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.036+0000 7fd0fb436b80 1 Processor -- start 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 0x558bfe66dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe658730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 0x558bfe60e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfe56d960 con 0x558bfe61a080 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfe527510 con 0x558bfe62fed0 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bfe5271b0 con 0x558bfe617490 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0fb436b80 10 client.0 _ll_register_callbacks cb 0x558bfe452a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe658730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe658730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38904/0 (socket says 172.21.15.179:38904) 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 -- 172.21.15.179:0/1910536224 learned_addr learned my addr 172.21.15.179:0/1910536224 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:22.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 0x558bfe66dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0ed7da700 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 0x558bfe60e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 -- 172.21.15.179:0/1910536224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 msgr2=0x558bfe66dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 0x558bfe66dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 -- 172.21.15.179:0/1910536224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 msgr2=0x558bfe60e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 0x558bfe60e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 -- 172.21.15.179:0/1910536224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc00e040 con 0x558bfe61a080 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe658730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4059920 tx=0x7fd0d405a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5b8b7e28dbe623 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0c77fe700 1 -- 172.21.15.179:0/1910536224 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4059310 con 0x558bfe61a080 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0c77fe700 1 -- 172.21.15.179:0/1910536224 <== mon.0 v2:172.21.15.179:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0d405dd70 con 0x558bfe61a080 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.037+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1910536224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bfe60ca40 con 0x558bfe61a080 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0c77fe700 1 -- 172.21.15.179:0/1910536224 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0d4061f20 con 0x558bfe61a080 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0fb436b80 10 client.4416 fetch_fsmap learned FSMap version 7 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1910536224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558bfe396d90 con 0x558bfe61a080 2023-12-07T00:14:22.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0c77fe700 1 -- 172.21.15.179:0/1910536224 <== mon.0 v2:172.21.15.179:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558bfe60ca40 con 0x558bfe61a080 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0c77fe700 1 -- 172.21.15.179:0/1910536224 <== mon.0 v2:172.21.15.179:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fd0d4061a90 con 0x558bfe61a080 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0fb436b80 10 client.4416 fetch_fsmap finished waiting for FSMap version 7 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0fb436b80 10 client.4416 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0fb436b80 20 client.4416 populate_metadata read hostname 'smithi179' 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x558bfe671f40 0x558bfe672320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0fb436b80 4 client.4416 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1910536224 --> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558bfe5e8840 con 0x558bfe671f40 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x558bfe671f40 0x558bfe672320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0c77fe700 10 client.4416 ms_handle_connect on v2:172.21.15.179:6836/4041424409 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.038+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x558bfe671f40 0x558bfe672320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95f79e4f8f98d6da server_cookie=f799513d06e782be in_seq=0 out_seq=0 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0c77fe700 1 -- 172.21.15.179:0/1910536224 <== mds.0 v2:172.21.15.179:6836/4041424409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x558bfe5e8840 con 0x558bfe671f40 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0c77fe700 10 client.4416 handle_command_reply: tid=0 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 client.4416 shutdown 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1910536224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 msgr2=0x558bfe658730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe658730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4059920 tx=0x7fd0d405a460 comp rx=0 tx=0).stop 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1910536224 shutdown_connections 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x558bfe671f40 0x558bfe672320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe62fed0 0x558bfe60e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe617490 0x558bfe66dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0c77fe700 0 client.4416 ms_handle_reset on v2:172.21.15.179:6836/4041424409 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1910536224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe658730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1910536224 >> 172.21.15.179:0/1910536224 conn(0x558bfe548310 msgr2=0x558bfe644800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1910536224 shutdown_connections 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1910536224 wait complete. 2023-12-07T00:14:22.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.039+0000 7fd0fb436b80 20 client.4416 trim_cache size 0 max 16384 2023-12-07T00:14:22.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.057+0000 7fd0fb436b80 1 Processor -- start 2023-12-07T00:14:22.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.057+0000 7fd0fb436b80 1 -- start start 2023-12-07T00:14:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 0x558bfe662490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe60dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe60e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfe3ec8d0 con 0x558bfe61a080 2023-12-07T00:14:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfe647d00 con 0x558bfe617490 2023-12-07T00:14:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bfe61ae50 con 0x558bfe62fed0 2023-12-07T00:14:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe60dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe60dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38912/0 (socket says 172.21.15.179:38912) 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 -- 172.21.15.179:0/1646523690 learned_addr learned my addr 172.21.15.179:0/1646523690 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 0x558bfe662490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0ed7da700 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe60e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 -- 172.21.15.179:0/1646523690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 msgr2=0x558bfe60e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe60e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 -- 172.21.15.179:0/1646523690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 msgr2=0x558bfe662490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 0x558bfe662490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 -- 172.21.15.179:0/1646523690 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bfe616330 con 0x558bfe61a080 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe60dcb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009520 tx=0x7fd0d4026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1551a5faf1c3760 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0d2ffd700 1 -- 172.21.15.179:0/1646523690 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d405dd70 con 0x558bfe61a080 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0d2ffd700 1 -- 172.21.15.179:0/1646523690 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d4061f20 con 0x558bfe61a080 2023-12-07T00:14:22.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.058+0000 7fd0d2ffd700 1 -- 172.21.15.179:0/1646523690 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4059350 con 0x558bfe61a080 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1646523690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 msgr2=0x558bfe60dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe60dcb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009520 tx=0x7fd0d4026000 comp rx=0 tx=0).stop 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1646523690 shutdown_connections 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe60e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 0x558bfe662490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/1646523690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe60dcb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1646523690 >> 172.21.15.179:0/1646523690 conn(0x558bfe548310 msgr2=0x558bfe65df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1646523690 shutdown_connections 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.059+0000 7fd0fb436b80 1 -- 172.21.15.179:0/1646523690 wait complete. 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.060+0000 7fd0fb436b80 1 -- start start 2023-12-07T00:14:22.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.060+0000 7fd0fb436b80 1 Processor -- start 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 0x558bfe642420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe642960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0fb436b80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe645010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfe6719d0 con 0x558bfe61a080 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfe6787e0 con 0x558bfe617490 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0fb436b80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x558bfe678540 con 0x558bfe62fed0 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0fb436b80 10 client.0 _ll_register_callbacks cb 0x558bfe452a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe642960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe642960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38918/0 (socket says 172.21.15.179:38918) 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 -- 172.21.15.179:0/3807476416 learned_addr learned my addr 172.21.15.179:0/3807476416 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:22.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 0x558bfe642420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0ed7da700 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe645010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 -- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 msgr2=0x558bfe645010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe645010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 -- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 msgr2=0x558bfe642420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 0x558bfe642420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 -- 172.21.15.179:0/3807476416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558bfe396d90 con 0x558bfe61a080 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0ed7da700 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe645010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0e7fff700 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe642960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40619f0 tx=0x7fd0d4028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eab4fcb875ce345 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.061+0000 7fd0c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0c77fe700 1 -- 172.21.15.179:0/3807476416 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d402de30 con 0x558bfe61a080 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0c77fe700 1 -- 172.21.15.179:0/3807476416 <== mon.0 v2:172.21.15.179:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd0d4003bb0 con 0x558bfe61a080 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3807476416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0dc019070 con 0x558bfe61a080 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0c77fe700 1 -- 172.21.15.179:0/3807476416 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0d4003d90 con 0x558bfe61a080 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 10 client.4422 fetch_fsmap learned FSMap version 7 2023-12-07T00:14:22.067 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3807476416 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x558bfe37fc10 con 0x558bfe61a080 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0c77fe700 1 -- 172.21.15.179:0/3807476416 <== mon.0 v2:172.21.15.179:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc019070 con 0x558bfe61a080 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0c77fe700 1 -- 172.21.15.179:0/3807476416 <== mon.0 v2:172.21.15.179:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fd0d4055a10 con 0x558bfe61a080 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 10 client.4422 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 20 client.4422 populate_metadata read hostname 'smithi179' 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x558bfe645550 0x558bfe645930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 4 client.4422 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3807476416 --> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558bfe533f80 con 0x558bfe645550 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x558bfe645550 0x558bfe645930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0c77fe700 10 client.4422 ms_handle_connect on v2:172.21.15.179:6836/4041424409 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.062+0000 7fd0ecfd9700 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x558bfe645550 0x558bfe645930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbeae19c035ad90a server_cookie=252e57dc765be4ad in_seq=0 out_seq=0 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0c77fe700 1 -- 172.21.15.179:0/3807476416 <== mds.0 v2:172.21.15.179:6836/4041424409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x558bfe533f80 con 0x558bfe645550 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0c77fe700 10 client.4422 handle_command_reply: tid=0 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 client.4422 shutdown 2023-12-07T00:14:22.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3807476416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 msgr2=0x558bfe642960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe642960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40619f0 tx=0x7fd0d4028000 comp rx=0 tx=0).stop 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3807476416 shutdown_connections 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x558bfe645550 0x558bfe645930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558bfe62fed0 0x558bfe645010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0c77fe700 0 client.4422 ms_handle_reset on v2:172.21.15.179:6836/4041424409 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558bfe617490 0x558bfe642420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 --2- 172.21.15.179:0/3807476416 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x558bfe61a080 0x558bfe642960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3807476416 >> 172.21.15.179:0/3807476416 conn(0x558bfe548310 msgr2=0x558bfe60dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3807476416 shutdown_connections 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 1 -- 172.21.15.179:0/3807476416 wait complete. 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0fb436b80 20 client.4422 trim_cache size 0 max 16384 2023-12-07T00:14:22.069 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "cluster_fsid": "4803447b-a0af-4501-a3c6-e46974a67250", 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "whoami": 0, 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 4266, 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "want_state": "up:active", 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "state": "up:active", 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs", 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "rank_uptime": 7.4292880129999999, 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "mdsmap_epoch": 7, 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_epoch": 27, 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_epoch_barrier": 26, 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout: "uptime": 14.909358023999999 2023-12-07T00:14:22.070 INFO:teuthology.orchestra.run.smithi179.stdout:} 2023-12-07T00:14:22.071 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0ef23d700 1 -- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 msgr2=0x7fd0cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.071 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009950 tx=0x7fd0dc008040 comp rx=0 tx=0).stop 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0ef23d700 1 -- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815dd50 msgr2=0x7fd0e80b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815dd50 0x7fd0e80b2760 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4000c00 tx=0x7fd0d4004750 comp rx=0 tx=0).stop 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0ef23d700 1 -- 172.21.15.179:0/3355695057 shutdown_connections 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.063+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.064+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e130 0x7fd0e8160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.064+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80ce430 0x7fd0e80cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.064+0000 7fd0ef23d700 1 --2- 172.21.15.179:0/3355695057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e815dd50 0x7fd0e80b2760 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.064+0000 7fd0ef23d700 1 -- 172.21.15.179:0/3355695057 >> 172.21.15.179:0/3355695057 conn(0x7fd0e806c8e0 msgr2=0x7fd0e80b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:22.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.064+0000 7fd0ef23d700 1 -- 172.21.15.179:0/3355695057 shutdown_connections 2023-12-07T00:14:22.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.064+0000 7fd0ef23d700 1 -- 172.21.15.179:0/3355695057 wait complete. 2023-12-07T00:14:22.074 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T00:14:22.075 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-07T00:14:22.075 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T00:14:22.195 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.195+0000 7f0604671700 1 Processor -- start 2023-12-07T00:14:22.195 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.195+0000 7f0604671700 1 -- start start 2023-12-07T00:14:22.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.196+0000 7f0604671700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05fc158560 0x7f05fc0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.196+0000 7f0604671700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc0b2c70 0x7f05fc0cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.196+0000 7f0604671700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc15b8d0 con 0x7f05fc15b010 2023-12-07T00:14:22.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.196+0000 7f0604671700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05fc15bbb0 con 0x7f05fc158560 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.196+0000 7f0604671700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc15be90 con 0x7f05fc0b2c70 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f060240d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05fc158560 0x7f05fc0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f0602c0e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc0b2c70 0x7f05fc0cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f060240d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f05fc158560 0x7f05fc0b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41176/0 (socket says 172.21.15.179:41176) 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f0602c0e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc0b2c70 0x7f05fc0cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39342/0 (socket says 172.21.15.179:39342) 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f0601c0c700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f05fc15b010 0x7f05fc0b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:52506/0 (socket says 172.21.15.179:52506) 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f060240d700 1 -- 172.21.15.179:0/2665897467 learned_addr learned my addr 172.21.15.179:0/2665897467 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f0602c0e700 1 -- 172.21.15.179:0/2665897467 >> v2:172.21.15.190:3300/0 conn(0x7f05fc158560 msgr2=0x7f05fc0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f0602c0e700 1 --2- 172.21.15.179:0/2665897467 >> v2:172.21.15.190:3300/0 conn(0x7f05fc158560 0x7f05fc0b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f0602c0e700 1 -- 172.21.15.179:0/2665897467 >> v1:172.21.15.190:6789/0 conn(0x7f05fc15b010 legacy=0x7f05fc0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f0602c0e700 1 -- 172.21.15.179:0/2665897467 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc0ceec0 con 0x7f05fc0b2c70 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f060240d700 1 --2- 172.21.15.179:0/2665897467 >> v2:172.21.15.190:3300/0 conn(0x7f05fc158560 0x7f05fc0b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f0602c0e700 1 --2- 172.21.15.179:0/2665897467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc0b2c70 0x7f05fc0cf3e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009d90 tx=0x7f05f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2dc7045215a304 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.198 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f060140b700 1 -- 172.21.15.179:0/2665897467 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f400e070 con 0x7f05fc0b2c70 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f060140b700 1 -- 172.21.15.179:0/2665897467 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f400bb20 con 0x7f05fc0b2c70 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.197+0000 7f060140b700 1 -- 172.21.15.179:0/2665897467 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4012430 con 0x7f05fc0b2c70 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.198+0000 7f0604671700 1 -- 172.21.15.179:0/2665897467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc0b2c70 msgr2=0x7f05fc0cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.198+0000 7f0604671700 1 --2- 172.21.15.179:0/2665897467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc0b2c70 0x7f05fc0cf3e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009d90 tx=0x7f05f400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.198+0000 7f0604671700 1 -- 172.21.15.179:0/2665897467 shutdown_connections 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.198+0000 7f0604671700 1 --2- 172.21.15.179:0/2665897467 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc0b2c70 0x7f05fc0cf3e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.198+0000 7f0604671700 1 --2- 172.21.15.179:0/2665897467 >> v2:172.21.15.190:3300/0 conn(0x7f05fc158560 0x7f05fc0b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.198+0000 7f0604671700 1 -- 172.21.15.179:0/2665897467 >> 172.21.15.179:0/2665897467 conn(0x7f05fc072970 msgr2=0x7f05fc072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.198+0000 7f0604671700 1 -- 172.21.15.179:0/2665897467 shutdown_connections 2023-12-07T00:14:22.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.198+0000 7f0604671700 1 -- 172.21.15.179:0/2665897467 wait complete. 2023-12-07T00:14:22.202 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.199+0000 7f0604671700 1 Processor -- start 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.199+0000 7f0604671700 1 -- start start 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0604671700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05fc0b2c70 0x7f05fc0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0604671700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05fc158560 0x7f05fc143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0604671700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc15b010 0x7f05fc144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0604671700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc14f190 con 0x7f05fc158560 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0604671700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc14fd10 con 0x7f05fc0b2c70 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0604671700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc1501a0 con 0x7f05fc15b010 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05fc158560 0x7f05fc143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05fc158560 0x7f05fc143ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38932/0 (socket says 172.21.15.179:38932) 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 -- 172.21.15.179:0/2581749307 learned_addr learned my addr 172.21.15.179:0/2581749307 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f060240d700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05fc0b2c70 0x7f05fc0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0602c0e700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc15b010 0x7f05fc144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 -- 172.21.15.179:0/2581749307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc15b010 msgr2=0x7f05fc144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc15b010 0x7f05fc144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.203 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 -- 172.21.15.179:0/2581749307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05fc0b2c70 msgr2=0x7f05fc0b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05fc0b2c70 0x7f05fc0b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 -- 172.21.15.179:0/2581749307 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec009550 con 0x7f05fc158560 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.200+0000 7f0601c0c700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05fc158560 0x7f05fc143ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e8f0 tx=0x7f05f800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.201+0000 7f05f2ffd700 1 -- 172.21.15.179:0/2581749307 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8005d00 con 0x7f05fc158560 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.201+0000 7f05f2ffd700 1 -- 172.21.15.179:0/2581749307 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f8005e60 con 0x7f05fc158560 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.201+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f4009a70 con 0x7f05fc158560 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.201+0000 7f05f2ffd700 1 -- 172.21.15.179:0/2581749307 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8007290 con 0x7f05fc158560 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.201+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc14f6c0 con 0x7f05fc158560 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.202+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05fc14fff0 con 0x7f05fc158560 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.202+0000 7f05f2ffd700 1 -- 172.21.15.179:0/2581749307 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05f80073f0 con 0x7f05fc158560 2023-12-07T00:14:22.204 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.202+0000 7f05f2ffd700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f05e006aed0 0x7f05e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:22.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.203+0000 7f05f2ffd700 1 -- 172.21.15.179:0/2581749307 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f05f808ba70 con 0x7f05fc158560 2023-12-07T00:14:22.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.203+0000 7f060240d700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f05e006aed0 0x7f05e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:22.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.203+0000 7f060240d700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f05e006aed0 0x7f05e006d390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05ec006d30 tx=0x7f05ec0092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:22.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.207+0000 7f05f2ffd700 1 -- 172.21.15.179:0/2581749307 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05f80567a0 con 0x7f05fc158560 2023-12-07T00:14:22.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.439+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05fc04f290 con 0x7f05fc158560 2023-12-07T00:14:22.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.439+0000 7f05f2ffd700 1 -- 172.21.15.179:0/2581749307 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f05f801f070 con 0x7f05fc158560 2023-12-07T00:14:22.439 INFO:teuthology.orchestra.run.smithi179.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-07T00:14:22.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f05e006aed0 msgr2=0x7f05e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f05e006aed0 0x7f05e006d390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05ec006d30 tx=0x7f05ec0092c0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05fc158560 msgr2=0x7f05fc143ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:22.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05fc158560 0x7f05fc143ef0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f05f800e8f0 tx=0x7f05f800ec00 comp rx=0 tx=0).stop 2023-12-07T00:14:22.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 shutdown_connections 2023-12-07T00:14:22.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f05e006aed0 0x7f05e006d390 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f05fc15b010 0x7f05fc144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f05fc0b2c70 0x7f05fc0b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 --2- 172.21.15.179:0/2581749307 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f05fc158560 0x7f05fc143ef0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:22.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 >> 172.21.15.179:0/2581749307 conn(0x7f05fc072970 msgr2=0x7f05fc1596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:22.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 shutdown_connections 2023-12-07T00:14:22.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:22.442+0000 7f0604671700 1 -- 172.21.15.179:0/2581749307 wait complete. 2023-12-07T00:14:22.453 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T00:14:22.453 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T00:14:22.453 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-12-07T00:14:22.453 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-07T00:14:22.453 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-07T00:14:22.454 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T00:14:22.454 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T00:14:22.454 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T00:14:22.454 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-07T00:14:22.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:22.454 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:22.471 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:22.472 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:22.472 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T00:14:22.472 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:22.472 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-07T00:14:22.472 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42345sec preferred_lft 42345sec 2023-12-07T00:14:22.472 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::3535:d433:7794:9e23/64 scope link noprefixroute 2023-12-07T00:14:22.472 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:22.473 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-07T00:14:22.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:22.474 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:22.474 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:22.474 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2023-12-07T00:14:22.474 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2023-12-07T00:14:22.474 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2023-12-07T00:14:22.474 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-07T00:14:22.474 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:22.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:22.638 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T00:14:22.667 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-12-07T00:14:22.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:22.669 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-12-07T00:14:22.736 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-12-07T00:14:22.736 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T00:14:22.736 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T00:14:22.736 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T00:14:22.736 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T00:14:22.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:22.737 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:22.737 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:22.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T00:14:22.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T00:14:22.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T00:14:22.737 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:23.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:23.368 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-12-07T00:14:23.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:23.387 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-12-07T00:14:23.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:23.444 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:23.444 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:23.444 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-07T00:14:23.444 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-07T00:14:23.444 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:23.539 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-07T00:14:23.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:23.539 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:23.540 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:23.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-07T00:14:23.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-07T00:14:23.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-07T00:14:23.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-07T00:14:23.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-07T00:14:23.540 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:23.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:23.747 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:23.747 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:23.747 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-12-07T00:14:23.747 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2023-12-07T00:14:23.747 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:23.846 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-07T00:14:23.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:23.846 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-07T00:14:23.866 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-07T00:14:23.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:23.867 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-07T00:14:23.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2023-12-07T00:14:23.991 DEBUG:teuthology.orchestra.run.smithi179:> cat /proc/self/mounts | awk '{print $2}' 2023-12-07T00:14:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:/sys 2023-12-07T00:14:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:/proc 2023-12-07T00:14:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:/dev 2023-12-07T00:14:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/security 2023-12-07T00:14:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/shm 2023-12-07T00:14:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/pts 2023-12-07T00:14:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:/run 2023-12-07T00:14:24.048 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/systemd 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/pstore 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/bpf 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/memory 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/rdma 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/freezer 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/hugetlb 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/cpuset 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/blkio 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/devices 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/perf_event 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-12-07T00:14:24.049 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/pids 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/tracing 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/config 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/ 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/selinux 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/proc/sys/fs/binfmt_misc 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/debug 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/mqueue 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/hugepages 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/fuse/connections 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/nfs/rpc_pipefs 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/run/user/1000 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-0 2023-12-07T00:14:24.050 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-1 2023-12-07T00:14:24.051 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-2 2023-12-07T00:14:24.051 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-3 2023-12-07T00:14:24.051 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns 2023-12-07T00:14:24.051 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-07T00:14:24.051 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-07T00:14:24.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:24.051 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2023-12-07T00:14:24.104 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-07T00:14:24.104 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-07T00:14:24.147 DEBUG:teuthology.orchestra.run.smithi179:> sudo modprobe fuse 2023-12-07T00:14:24.173 DEBUG:teuthology.orchestra.run.smithi179:> cat /proc/self/mounts | awk '{print $2}' 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/sys 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/proc 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/dev 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/security 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/shm 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/pts 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/run 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/systemd 2023-12-07T00:14:24.230 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/pstore 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/bpf 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/memory 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/rdma 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/freezer 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/hugetlb 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/cpuset 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/blkio 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/devices 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/perf_event 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/cgroup/pids 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/tracing 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/config 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/ 2023-12-07T00:14:24.231 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/selinux 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/proc/sys/fs/binfmt_misc 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/kernel/debug 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/mqueue 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/dev/hugepages 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/sys/fs/fuse/connections 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/nfs/rpc_pipefs 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/run/user/1000 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-0 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-1 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-2 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/var/lib/ceph/osd/ceph-3 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-07T00:14:24.232 INFO:teuthology.orchestra.run.smithi179.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-07T00:14:24.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:24.233 DEBUG:teuthology.orchestra.run.smithi179:> ls /sys/fs/fuse/connections 2023-12-07T00:14:24.257 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi179.stderr:2023-12-07T00:14:24.258+0000 7fed746d85c0 -1 init, newargv = 0x555f9596d180 newargc=15 2023-12-07T00:14:24.257 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi179.stderr:ceph-fuse[111095]: starting ceph client 2023-12-07T00:14:24.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi179.stderr:ceph-fuse[111095]: starting fuse 2023-12-07T00:14:24.273 INFO:teuthology.orchestra.run.smithi179.stdout:46 2023-12-07T00:14:24.274 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> sudo stdin-killer -- python3 -c ' 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> import glob 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> import re 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> import os 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> import subprocess 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> def _find_admin_socket(client_name): 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> files = glob.glob(asok_path) 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-07T00:14:24.274 DEBUG:teuthology.orchestra.run.smithi179:> 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> # Given a non-glob path, it better be there 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> if "*" not in asok_path: 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> assert(len(files) == 1) 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> return files[0] 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> for f in files: 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> contents = proc_f.read() 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> if mountpoint in contents: 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> return f 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> print(_find_admin_socket("client.admin")) 2023-12-07T00:14:24.275 DEBUG:teuthology.orchestra.run.smithi179:> ' 2023-12-07T00:14:24.397 INFO:teuthology.orchestra.run.smithi179.stdout:/var/run/ceph/ceph-client.admin.111095.asok 2023-12-07T00:14:24.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-07T00:14:24.407 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.111095.asok 2023-12-07T00:14:24.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:24.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.111095.asok status 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "metadata": { 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_sha1": "a2cd52c00149b5caff897ea7f79d0529b62620da", 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "ceph_version": "ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev)", 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "entity_id": "admin", 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "hostname": "smithi179", 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "pid": "111095", 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "root": "/" 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:14:24.564 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_count": 0, 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "dentry_pinned_count": 0, 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 4431, 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "inst": { 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "name": { 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "client", 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "num": 4431 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 4032466045 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": { 2023-12-07T00:14:24.565 INFO:teuthology.orchestra.run.smithi179.stdout: "type": "v1", 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "addr": "192.168.0.1:0", 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "nonce": 4032466045 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "inst_str": "client.4431 192.168.0.1:0/4032466045", 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "addr_str": "192.168.0.1:0/4032466045", 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "inode_count": 1, 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "mds_epoch": 7, 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch": 27, 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "osd_epoch_barrier": 0, 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "blocklisted": false, 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs" 2023-12-07T00:14:24.566 INFO:teuthology.orchestra.run.smithi179.stdout:} 2023-12-07T00:14:24.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:24.574 DEBUG:teuthology.orchestra.run.smithi179:> stat --file-system '--printf=%T 2023-12-07T00:14:24.574 DEBUG:teuthology.orchestra.run.smithi179:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-07T00:14:24.591 INFO:teuthology.orchestra.run.smithi179.stdout:fuseblk 2023-12-07T00:14:24.591 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-07T00:14:24.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:24.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-07T00:14:24.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:24.660 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-07T00:14:24.754 INFO:teuthology.orchestra.run.smithi179.stdout:# file: . 2023-12-07T00:14:24.754 INFO:teuthology.orchestra.run.smithi179.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-07T00:14:24.754 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:24.754 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:14:24.754 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:14:24.771 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:24.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.931+0000 7f44e4b7f700 1 Processor -- start 2023-12-07T00:14:24.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.932+0000 7f44e4b7f700 1 -- start start 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.932+0000 7f44e4b7f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44e015bde0 0x7f44e00d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.932+0000 7f44e4b7f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e00cd020 0x7f44e00cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.932+0000 7f44e4b7f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e009ab50 con 0x7f44e0099c00 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.932+0000 7f44e4b7f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e00cf630 con 0x7f44e015bde0 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.932+0000 7f44e4b7f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00cf8f0 con 0x7f44e00cd020 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44ded9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f44e0099c00 0x7f44e015f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45862/0 (socket says 172.21.15.179:45862) 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44ded9d700 1 -- 172.21.15.179:0/1269221015 learned_addr learned my addr 172.21.15.179:0/1269221015 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44de59c700 1 --2- 172.21.15.179:0/1269221015 >> v2:172.21.15.190:3300/0 conn(0x7f44e015bde0 0x7f44e00d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44ddd9b700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e00cd020 0x7f44e00cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601508663 0 0) 0x7f44e009ab50 con 0x7f44e0099c00 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44c80035b0 con 0x7f44e0099c00 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1716500640 0 0) 0x7f44c80035b0 con 0x7f44e0099c00 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e00cd020 msgr2=0x7f44e00cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e00cd020 0x7f44e00cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 >> v2:172.21.15.190:3300/0 conn(0x7f44e015bde0 msgr2=0x7f44e00d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 --2- 172.21.15.179:0/1269221015 >> v2:172.21.15.190:3300/0 conn(0x7f44e015bde0 0x7f44e00d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e00cfbd0 con 0x7f44e0099c00 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f44d80019f0 con 0x7f44e0099c00 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44de59c700 1 --2- 172.21.15.179:0/1269221015 >> v2:172.21.15.190:3300/0 conn(0x7f44e015bde0 0x7f44e00d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 >> v1:172.21.15.179:6789/0 conn(0x7f44e0099c00 legacy=0x7f44e015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c8003a00 0x7f44c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8004850 0x7f44c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e00cd020 0x7f44c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00cf630 con 0x7f44c8003a00 2023-12-07T00:14:24.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00cf8f0 con 0x7f44c8004850 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c800ba10 con 0x7f44e00cd020 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44de59c700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c8003a00 0x7f44c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44ded9d700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e00cd020 0x7f44c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.933+0000 7f44ddd9b700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8004850 0x7f44c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44de59c700 1 -- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e00cd020 msgr2=0x7f44c8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44de59c700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e00cd020 0x7f44c8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44de59c700 1 -- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8004850 msgr2=0x7f44c8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44de59c700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8004850 0x7f44c8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44de59c700 1 -- 172.21.15.179:0/1269221015 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80035b0 con 0x7f44c8003a00 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44de59c700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c8003a00 0x7f44c8003e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009d30 tx=0x7f44c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e999980d1f5c01b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d4009e80 con 0x7f44c8003a00 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400e9a0 con 0x7f44c8003a00 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44dd59a700 1 -- 172.21.15.179:0/1269221015 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400ed30 con 0x7f44c8003a00 2023-12-07T00:14:24.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44e4b7f700 1 -- 172.21.15.179:0/1269221015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c8003a00 msgr2=0x7f44c8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44e4b7f700 1 --2- 172.21.15.179:0/1269221015 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44c8003a00 0x7f44c8003e20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f44d4009d30 tx=0x7f44c8005880 comp rx=0 tx=0).stop 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44ded9d700 1 -- 172.21.15.179:0/1269221015 reap_dead start 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44e4b7f700 1 -- 172.21.15.179:0/1269221015 shutdown_connections 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.934+0000 7f44e4b7f700 1 -- 172.21.15.179:0/1269221015 >> 172.21.15.179:0/1269221015 conn(0x7f44e00b3550 msgr2=0x7f44e00b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.935+0000 7f44e4b7f700 1 -- 172.21.15.179:0/1269221015 shutdown_connections 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.935+0000 7f44e4b7f700 1 -- 172.21.15.179:0/1269221015 wait complete. 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.936+0000 7f44e4b7f700 1 Processor -- start 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.936+0000 7f44e4b7f700 1 -- start start 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44e4b7f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8003a00 0x7f44e006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44e4b7f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e00c78f0 0x7f44e0070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44e4b7f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e014fb20 0x7f44e014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44e4b7f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e015c920 con 0x7f44e00c78f0 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44e4b7f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e0150510 con 0x7f44c8003a00 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44e4b7f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e006e040 con 0x7f44e014fb20 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e00c78f0 0x7f44e0070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e00c78f0 0x7f44e0070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38970/0 (socket says 172.21.15.179:38970) 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 -- 172.21.15.179:0/424676682 learned_addr learned my addr 172.21.15.179:0/424676682 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44de59c700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8003a00 0x7f44e006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ded9d700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e014fb20 0x7f44e014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 -- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e014fb20 msgr2=0x7f44e014ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e014fb20 0x7f44e014ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 -- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8003a00 msgr2=0x7f44e006d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8003a00 0x7f44e006d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 -- 172.21.15.179:0/424676682 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e006dd60 con 0x7f44e00c78f0 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ded9d700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e014fb20 0x7f44e014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ddd9b700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e00c78f0 0x7f44e0070fc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44d00119a0 tx=0x7f44d0011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ceffd700 1 -- 172.21.15.179:0/424676682 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000f940 con 0x7f44e00c78f0 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ceffd700 1 -- 172.21.15.179:0/424676682 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d000faa0 con 0x7f44e00c78f0 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e015c260 con 0x7f44e00c78f0 2023-12-07T00:14:24.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44ceffd700 1 -- 172.21.15.179:0/424676682 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d000fe30 con 0x7f44e00c78f0 2023-12-07T00:14:24.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.937+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e00c8c70 con 0x7f44e00c78f0 2023-12-07T00:14:24.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.938+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e00685f0 con 0x7f44e00c78f0 2023-12-07T00:14:24.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.939+0000 7f44ceffd700 1 -- 172.21.15.179:0/424676682 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44d0014440 con 0x7f44e00c78f0 2023-12-07T00:14:24.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.939+0000 7f44ceffd700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44c006aed0 0x7f44c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:24.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.939+0000 7f44ceffd700 1 -- 172.21.15.179:0/424676682 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44d0089f10 con 0x7f44e00c78f0 2023-12-07T00:14:24.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.939+0000 7f44de59c700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44c006aed0 0x7f44c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:24.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.940+0000 7f44de59c700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44c006aed0 0x7f44c006d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f44d4000c00 tx=0x7f44d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:24.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:24.944+0000 7f44ceffd700 1 -- 172.21.15.179:0/424676682 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44d0054d60 con 0x7f44e00c78f0 2023-12-07T00:14:25.136 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.137+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44e00c7d70 con 0x7f44e00c78f0 2023-12-07T00:14:25.137 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.138+0000 7f44ceffd700 1 -- 172.21.15.179:0/424676682 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f44d0058380 con 0x7f44e00c78f0 2023-12-07T00:14:25.138 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:25.138 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:25.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44c006aed0 msgr2=0x7f44c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44c006aed0 0x7f44c006d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f44d4000c00 tx=0x7f44d4008030 comp rx=0 tx=0).stop 2023-12-07T00:14:25.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e00c78f0 msgr2=0x7f44e0070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e00c78f0 0x7f44e0070fc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f44d00119a0 tx=0x7f44d0011cb0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 shutdown_connections 2023-12-07T00:14:25.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44c006aed0 0x7f44c006d390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e014fb20 0x7f44e014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.141 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44c8003a00 0x7f44e006d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.141 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 --2- 172.21.15.179:0/424676682 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e00c78f0 0x7f44e0070fc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.141 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 >> 172.21.15.179:0/424676682 conn(0x7f44e00b3550 msgr2=0x7f44e00d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:25.141 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 shutdown_connections 2023-12-07T00:14:25.141 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.141+0000 7f44e4b7f700 1 -- 172.21.15.179:0/424676682 wait complete. 2023-12-07T00:14:25.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:25.153 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.277+0000 7f7e2902c700 1 Processor -- start 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.277+0000 7f7e2902c700 1 -- start start 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e2902c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7e2415ab70 0x7f7e24070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e2902c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 0x7f7e240adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e2902c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2406f960 con 0x7f7e240ce770 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e2902c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2415af50 con 0x7f7e2415ab70 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e2902c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2406fc40 con 0x7f7e240d0ed0 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e2259c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7e240ce770 0x7f7e240d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45878/0 (socket says 172.21.15.179:45878) 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e2259c700 1 -- 172.21.15.179:0/1318489083 learned_addr learned my addr 172.21.15.179:0/1318489083 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:25.280 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e22d9d700 1 --2- 172.21.15.179:0/1318489083 >> v2:172.21.15.190:3300/0 conn(0x7f7e2415ab70 0x7f7e24070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e2359e700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 0x7f7e240adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382440058 0 0) 0x7f7e2406f960 con 0x7f7e240ce770 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e0c0035b0 con 0x7f7e240ce770 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2883211422 0 0) 0x7f7e0c0035b0 con 0x7f7e240ce770 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 msgr2=0x7f7e240adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 0x7f7e240adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 >> v2:172.21.15.190:3300/0 conn(0x7f7e2415ab70 msgr2=0x7f7e24070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 --2- 172.21.15.179:0/1318489083 >> v2:172.21.15.190:3300/0 conn(0x7f7e2415ab70 0x7f7e24070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e240cf110 con 0x7f7e240ce770 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e22d9d700 1 --2- 172.21.15.179:0/1318489083 >> v2:172.21.15.190:3300/0 conn(0x7f7e2415ab70 0x7f7e24070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f7e14001670 con 0x7f7e240ce770 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 >> v1:172.21.15.179:6789/0 conn(0x7f7e240ce770 legacy=0x7f7e240d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0c003a00 0x7f7e0c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.278+0000 7f7e21d9b700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 0x7f7e0c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e21d9b700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c004d90 0x7f7e0c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2415af50 con 0x7f7e0c004d90 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2406fc40 con 0x7f7e0c003a00 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c00bac0 con 0x7f7e240d0ed0 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e22d9d700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0c003a00 0x7f7e0c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2259c700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 0x7f7e0c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2359e700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c004d90 0x7f7e0c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2359e700 1 -- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 msgr2=0x7f7e0c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2359e700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 0x7f7e0c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2359e700 1 -- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0c003a00 msgr2=0x7f7e0c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2359e700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0c003a00 0x7f7e0c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2359e700 1 -- 172.21.15.179:0/1318489083 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0035b0 con 0x7f7e0c004d90 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e22d9d700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0c003a00 0x7f7e0c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2259c700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e240d0ed0 0x7f7e0c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e2359e700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c004d90 0x7f7e0c005210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009f90 tx=0x7f7e0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19285030e6b09c9f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00ec30 con 0x7f7e0c004d90 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00f040 con 0x7f7e0c004d90 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.279+0000 7f7e21d9b700 1 -- 172.21.15.179:0/1318489083 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c014480 con 0x7f7e0c004d90 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.280+0000 7f7e2902c700 1 -- 172.21.15.179:0/1318489083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c004d90 msgr2=0x7f7e0c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.280+0000 7f7e2902c700 1 --2- 172.21.15.179:0/1318489083 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0c004d90 0x7f7e0c005210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c009f90 tx=0x7f7e0c005880 comp rx=0 tx=0).stop 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.280+0000 7f7e2359e700 1 -- 172.21.15.179:0/1318489083 reap_dead start 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.280+0000 7f7e2902c700 1 -- 172.21.15.179:0/1318489083 shutdown_connections 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.280+0000 7f7e2902c700 1 -- 172.21.15.179:0/1318489083 >> 172.21.15.179:0/1318489083 conn(0x7f7e24099a40 msgr2=0x7f7e24099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.280+0000 7f7e2902c700 1 -- 172.21.15.179:0/1318489083 shutdown_connections 2023-12-07T00:14:25.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.280+0000 7f7e2902c700 1 -- 172.21.15.179:0/1318489083 wait complete. 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.281+0000 7f7e2902c700 1 Processor -- start 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.281+0000 7f7e2902c700 1 -- start start 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2902c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e24154450 0x7f7e24154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2902c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e240c8f50 0x7f7e240ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2902c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e240cd550 0x7f7e240cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2902c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24154830 con 0x7f7e240cd550 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2902c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240ca9c0 con 0x7f7e240c8f50 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2902c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240cdf20 con 0x7f7e24154450 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e240cd550 0x7f7e240cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e240cd550 0x7f7e240cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:38992/0 (socket says 172.21.15.179:38992) 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2359e700 1 -- 172.21.15.179:0/1176777493 learned_addr learned my addr 172.21.15.179:0/1176777493 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e22d9d700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e24154450 0x7f7e24154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.282+0000 7f7e2259c700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e240c8f50 0x7f7e240ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e2359e700 1 -- 172.21.15.179:0/1176777493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e24154450 msgr2=0x7f7e24154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e2359e700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e24154450 0x7f7e24154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e2359e700 1 -- 172.21.15.179:0/1176777493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e240c8f50 msgr2=0x7f7e240ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e2359e700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e240c8f50 0x7f7e240ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e2359e700 1 -- 172.21.15.179:0/1176777493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e240c93e0 con 0x7f7e240cd550 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e2359e700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e240cd550 0x7f7e240cd9e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c016000 tx=0x7f7e1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e0b7fe700 1 -- 172.21.15.179:0/1176777493 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c007000 con 0x7f7e240cd550 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e0b7fe700 1 -- 172.21.15.179:0/1176777493 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00ee40 con 0x7f7e240cd550 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e240c96c0 con 0x7f7e240cd550 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e0b7fe700 1 -- 172.21.15.179:0/1176777493 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c015d80 con 0x7f7e240cd550 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.283+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e240c9c80 con 0x7f7e240cd550 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.284+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e240685f0 con 0x7f7e240cd550 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.284+0000 7f7e0b7fe700 1 -- 172.21.15.179:0/1176777493 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e1c01d420 con 0x7f7e240cd550 2023-12-07T00:14:25.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.285+0000 7f7e0b7fe700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7e1006aed0 0x7f7e1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.285+0000 7f7e0b7fe700 1 -- 172.21.15.179:0/1176777493 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e1c08b060 con 0x7f7e240cd550 2023-12-07T00:14:25.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.285+0000 7f7e22d9d700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7e1006aed0 0x7f7e1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.285+0000 7f7e22d9d700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7e1006aed0 0x7f7e1006d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e240b0140 tx=0x7f7e18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.289+0000 7f7e0b7fe700 1 -- 172.21.15.179:0/1176777493 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e1c055fd0 con 0x7f7e240cd550 2023-12-07T00:14:25.478 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.477+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e2406ee80 con 0x7f7e240cd550 2023-12-07T00:14:25.478 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.478+0000 7f7e0b7fe700 1 -- 172.21.15.179:0/1176777493 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e1c0595f0 con 0x7f7e240cd550 2023-12-07T00:14:25.478 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:25.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7e1006aed0 msgr2=0x7f7e1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7e1006aed0 0x7f7e1006d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e240b0140 tx=0x7f7e18008040 comp rx=0 tx=0).stop 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e240cd550 msgr2=0x7f7e240cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e240cd550 0x7f7e240cd9e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c016000 tx=0x7f7e1c009750 comp rx=0 tx=0).stop 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 shutdown_connections 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7e1006aed0 0x7f7e1006d390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e240cd550 0x7f7e240cd9e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e24154450 0x7f7e24154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 --2- 172.21.15.179:0/1176777493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e240c8f50 0x7f7e240ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 >> 172.21.15.179:0/1176777493 conn(0x7f7e24099a40 msgr2=0x7f7e240ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 shutdown_connections 2023-12-07T00:14:25.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.480+0000 7f7e2902c700 1 -- 172.21.15.179:0/1176777493 wait complete. 2023-12-07T00:14:25.492 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:14:25.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.616+0000 7ffa006a4700 1 Processor -- start 2023-12-07T00:14:25.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.616+0000 7ffa006a4700 1 -- start start 2023-12-07T00:14:25.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.617+0000 7ffa006a4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8162380 0x7ff9f80cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.617+0000 7ffa006a4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f80cb0f0 con 0x7ff9f8161360 2023-12-07T00:14:25.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.617+0000 7ffa006a4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f8161740 con 0x7ff9f806b680 2023-12-07T00:14:25.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.617+0000 7ffa006a4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81627f0 con 0x7ff9f8162380 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fe440700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff9f8161360 0x7ff9f806af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45898/0 (socket says 172.21.15.179:45898) 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fe440700 1 -- 172.21.15.179:0/1900695852 learned_addr learned my addr 172.21.15.179:0/1900695852 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fec41700 1 --2- 172.21.15.179:0/1900695852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8162380 0x7ff9f80cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fd43e700 1 -- 172.21.15.179:0/1900695852 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038646549 0 0) 0x7ff9f80cb0f0 con 0x7ff9f8161360 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fd43e700 1 -- 172.21.15.179:0/1900695852 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9e40035b0 con 0x7ff9f8161360 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fd43e700 1 -- 172.21.15.179:0/1900695852 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783441160 0 0) 0x7ff9f8161740 con 0x7ff9f806b680 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fd43e700 1 -- 172.21.15.179:0/1900695852 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9f80cb0f0 con 0x7ff9f806b680 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fec41700 1 -- 172.21.15.179:0/1900695852 >> v1:172.21.15.190:6789/0 conn(0x7ff9f806b680 legacy=0x7ff9f8161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fec41700 1 -- 172.21.15.179:0/1900695852 >> v1:172.21.15.179:6789/0 conn(0x7ff9f8161360 legacy=0x7ff9f806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fec41700 1 -- 172.21.15.179:0/1900695852 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f80cb340 con 0x7ff9f8162380 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fec41700 1 --2- 172.21.15.179:0/1900695852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8162380 0x7ff9f80cc100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009dc0 tx=0x7ff9f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30b19a8af56c826d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fd43e700 1 -- 172.21.15.179:0/1900695852 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000e070 con 0x7ff9f8162380 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fd43e700 1 -- 172.21.15.179:0/1900695852 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f000bb20 con 0x7ff9f8162380 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.618+0000 7ff9fd43e700 1 -- 172.21.15.179:0/1900695852 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f000be90 con 0x7ff9f8162380 2023-12-07T00:14:25.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.619+0000 7ffa006a4700 1 -- 172.21.15.179:0/1900695852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8162380 msgr2=0x7ff9f80cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.619+0000 7ffa006a4700 1 --2- 172.21.15.179:0/1900695852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8162380 0x7ff9f80cc100 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009dc0 tx=0x7ff9f000b330 comp rx=0 tx=0).stop 2023-12-07T00:14:25.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.619+0000 7ffa006a4700 1 -- 172.21.15.179:0/1900695852 shutdown_connections 2023-12-07T00:14:25.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.619+0000 7ffa006a4700 1 --2- 172.21.15.179:0/1900695852 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8162380 0x7ff9f80cc100 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.619+0000 7ffa006a4700 1 -- 172.21.15.179:0/1900695852 >> 172.21.15.179:0/1900695852 conn(0x7ff9f8099a40 msgr2=0x7ff9f8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:25.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.619+0000 7ffa006a4700 1 -- 172.21.15.179:0/1900695852 shutdown_connections 2023-12-07T00:14:25.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.619+0000 7ffa006a4700 1 -- 172.21.15.179:0/1900695852 wait complete. 2023-12-07T00:14:25.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.620+0000 7ffa006a4700 1 Processor -- start 2023-12-07T00:14:25.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.620+0000 7ffa006a4700 1 -- start start 2023-12-07T00:14:25.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ffa006a4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f806b680 0x7ff9f81f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ffa006a4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8161360 0x7ff9f81f7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ffa006a4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f8162380 0x7ff9f8158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ffa006a4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f815a4d0 con 0x7ff9f8162380 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ffa006a4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f81598c0 con 0x7ff9f806b680 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ffa006a4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f8159ba0 con 0x7ff9f8161360 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f8162380 0x7ff9f8158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f8162380 0x7ff9f8158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39004/0 (socket says 172.21.15.179:39004) 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 -- 172.21.15.179:0/239640409 learned_addr learned my addr 172.21.15.179:0/239640409 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fdc3f700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8161360 0x7ff9f81f7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fe440700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f806b680 0x7ff9f81f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 -- 172.21.15.179:0/239640409 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8161360 msgr2=0x7ff9f81f7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8161360 0x7ff9f81f7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 -- 172.21.15.179:0/239640409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f806b680 msgr2=0x7ff9f81f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f806b680 0x7ff9f81f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 -- 172.21.15.179:0/239640409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009a70 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9fec41700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f8162380 0x7ff9f8158b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0014040 tx=0x7ff9f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.621+0000 7ff9eeffd700 1 -- 172.21.15.179:0/239640409 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00048c0 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.622+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f8159e80 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.622+0000 7ff9eeffd700 1 -- 172.21.15.179:0/239640409 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0020070 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.622+0000 7ff9eeffd700 1 -- 172.21.15.179:0/239640409 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0027680 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.622+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f81590d0 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.622+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f80685f0 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.623+0000 7ff9eeffd700 1 -- 172.21.15.179:0/239640409 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9f0012430 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.623+0000 7ff9eeffd700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.623+0000 7ff9eeffd700 1 -- 172.21.15.179:0/239640409 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff9f0022070 con 0x7ff9f8162380 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.623+0000 7ff9fe440700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.624+0000 7ff9fe440700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8007fd0 tx=0x7ff9e8007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.628+0000 7ff9eeffd700 1 -- 172.21.15.179:0/239640409 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9f0056220 con 0x7ff9f8162380 2023-12-07T00:14:25.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.821+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9f80b6a20 con 0x7ff9f8162380 2023-12-07T00:14:25.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.821+0000 7ff9eeffd700 1 -- 172.21.15.179:0/239640409 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9f0059840 con 0x7ff9f8162380 2023-12-07T00:14:25.821 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 msgr2=0x7ff9dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff9e8007fd0 tx=0x7ff9e8007de0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f8162380 msgr2=0x7ff9f8158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f8162380 0x7ff9f8158b90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0014040 tx=0x7ff9f0004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 shutdown_connections 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f8162380 0x7ff9f8158b90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f806b680 0x7ff9f81f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 --2- 172.21.15.179:0/239640409 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f8161360 0x7ff9f81f7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 >> 172.21.15.179:0/239640409 conn(0x7ff9f8099a40 msgr2=0x7ff9f8099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 shutdown_connections 2023-12-07T00:14:25.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.823+0000 7ffa006a4700 1 -- 172.21.15.179:0/239640409 wait complete. 2023-12-07T00:14:25.836 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:14:25.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.957+0000 7fc9a73fa700 1 Processor -- start 2023-12-07T00:14:25.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.958+0000 7fc9a73fa700 1 -- start start 2023-12-07T00:14:25.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.958+0000 7fc9a73fa700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc9a015e1c0 0x7fc9a00af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.958+0000 7fc9a73fa700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc9a00c57f0 0x7fc9a00ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a73fa700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00afc40 con 0x7fc9a006e350 2023-12-07T00:14:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a73fa700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a00ad2f0 con 0x7fc9a015e1c0 2023-12-07T00:14:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a73fa700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a00ad5d0 con 0x7fc9a00c57f0 2023-12-07T00:14:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a5196700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc9a015e1c0 0x7fc9a00af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a4995700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc9a006e350 0x7fc9a00c50e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45910/0 (socket says 172.21.15.179:45910) 2023-12-07T00:14:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a5196700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc9a015e1c0 0x7fc9a00af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39008/0 (socket says 172.21.15.179:39008) 2023-12-07T00:14:25.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a4995700 1 -- 172.21.15.179:0/3107527694 learned_addr learned my addr 172.21.15.179:0/3107527694 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a5997700 1 --2- 172.21.15.179:0/3107527694 >> v2:172.21.15.190:3300/0 conn(0x7fc9a00c57f0 0x7fc9a00ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a5196700 1 -- 172.21.15.179:0/3107527694 >> v2:172.21.15.190:3300/0 conn(0x7fc9a00c57f0 msgr2=0x7fc9a00ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a5196700 1 --2- 172.21.15.179:0/3107527694 >> v2:172.21.15.190:3300/0 conn(0x7fc9a00c57f0 0x7fc9a00ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a5196700 1 -- 172.21.15.179:0/3107527694 >> v1:172.21.15.179:6789/0 conn(0x7fc9a006e350 legacy=0x7fc9a00c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a5196700 1 -- 172.21.15.179:0/3107527694 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00ad8b0 con 0x7fc9a015e1c0 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc993fff700 1 -- 172.21.15.179:0/3107527694 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675361898 0 0) 0x7fc99c001110 con 0x7fc9a006e350 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc9a5196700 1 --2- 172.21.15.179:0/3107527694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a00af380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0072450 tx=0x7fc994009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efaa971212a1a92d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc993fff700 1 -- 172.21.15.179:0/3107527694 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994011830 con 0x7fc9a015e1c0 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc993fff700 1 -- 172.21.15.179:0/3107527694 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc994011990 con 0x7fc9a015e1c0 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.959+0000 7fc993fff700 1 -- 172.21.15.179:0/3107527694 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994011d20 con 0x7fc9a015e1c0 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.960+0000 7fc9a73fa700 1 -- 172.21.15.179:0/3107527694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 msgr2=0x7fc9a00af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.960+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/3107527694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a00af380 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0072450 tx=0x7fc994009b20 comp rx=0 tx=0).stop 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.960+0000 7fc9a73fa700 1 -- 172.21.15.179:0/3107527694 shutdown_connections 2023-12-07T00:14:25.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.960+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/3107527694 >> v2:172.21.15.190:3300/0 conn(0x7fc9a00c57f0 0x7fc9a00ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.964 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.960+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/3107527694 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a00af380 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.964 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.960+0000 7fc9a73fa700 1 -- 172.21.15.179:0/3107527694 >> 172.21.15.179:0/3107527694 conn(0x7fc9a00b3270 msgr2=0x7fc9a00b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:25.964 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.960+0000 7fc9a73fa700 1 -- 172.21.15.179:0/3107527694 shutdown_connections 2023-12-07T00:14:25.964 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.960+0000 7fc9a73fa700 1 -- 172.21.15.179:0/3107527694 wait complete. 2023-12-07T00:14:25.964 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.961+0000 7fc9a73fa700 1 Processor -- start 2023-12-07T00:14:25.964 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.961+0000 7fc9a73fa700 1 -- start start 2023-12-07T00:14:25.966 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a73fa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9a006e350 0x7fc9a01eec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.967 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a73fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9a00c57f0 0x7fc9a01407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.967 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a73fa700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a01f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.967 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a73fa700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a01404e0 con 0x7fc9a015e1c0 2023-12-07T00:14:25.967 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a73fa700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a01ef150 con 0x7fc9a006e350 2023-12-07T00:14:25.967 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a73fa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0140ce0 con 0x7fc9a00c57f0 2023-12-07T00:14:25.967 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a01f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.967 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a01f56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39018/0 (socket says 172.21.15.179:39018) 2023-12-07T00:14:25.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 -- 172.21.15.179:0/4077653562 learned_addr learned my addr 172.21.15.179:0/4077653562 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:25.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a4995700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9a00c57f0 0x7fc9a01407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5196700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9a006e350 0x7fc9a01eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 -- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9a00c57f0 msgr2=0x7fc9a01407a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9a00c57f0 0x7fc9a01407a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 -- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9a006e350 msgr2=0x7fc9a01eec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:25.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9a006e350 0x7fc9a01eec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:25.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 -- 172.21.15.179:0/4077653562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9940094a0 con 0x7fc9a015e1c0 2023-12-07T00:14:25.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5196700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9a006e350 0x7fc9a01eec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:25.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.962+0000 7fc9a5997700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a01f56c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc998007e30 tx=0x7fc99800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.963+0000 7fc991ffb700 1 -- 172.21.15.179:0/4077653562 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99800eea0 con 0x7fc9a015e1c0 2023-12-07T00:14:25.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.963+0000 7fc991ffb700 1 -- 172.21.15.179:0/4077653562 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998014420 con 0x7fc9a015e1c0 2023-12-07T00:14:25.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.963+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a015e720 con 0x7fc9a015e1c0 2023-12-07T00:14:25.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.963+0000 7fc991ffb700 1 -- 172.21.15.179:0/4077653562 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980147d0 con 0x7fc9a015e1c0 2023-12-07T00:14:25.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.963+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a01f1b90 con 0x7fc9a015e1c0 2023-12-07T00:14:25.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.964+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a00685f0 con 0x7fc9a015e1c0 2023-12-07T00:14:25.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.964+0000 7fc991ffb700 1 -- 172.21.15.179:0/4077653562 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc998014930 con 0x7fc9a015e1c0 2023-12-07T00:14:25.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.965+0000 7fc991ffb700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc98406af00 0x7fc98406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:25.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.965+0000 7fc991ffb700 1 -- 172.21.15.179:0/4077653562 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc99808a020 con 0x7fc9a015e1c0 2023-12-07T00:14:25.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.965+0000 7fc9a5196700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc98406af00 0x7fc98406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:25.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.965+0000 7fc9a5196700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc98406af00 0x7fc98406d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc994009b60 tx=0x7fc994008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:25.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:25.969+0000 7fc991ffb700 1 -- 172.21.15.179:0/4077653562 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc998054e70 con 0x7fc9a015e1c0 2023-12-07T00:14:26.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.160+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc9a01428e0 con 0x7fc9a015e1c0 2023-12-07T00:14:26.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.161+0000 7fc991ffb700 1 -- 172.21.15.179:0/4077653562 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc998058490 con 0x7fc9a015e1c0 2023-12-07T00:14:26.161 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc98406af00 msgr2=0x7fc98406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc98406af00 0x7fc98406d3c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc994009b60 tx=0x7fc994008030 comp rx=0 tx=0).stop 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 msgr2=0x7fc9a01f56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a01f56c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc998007e30 tx=0x7fc99800e3c0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 shutdown_connections 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc98406af00 0x7fc98406d3c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9a015e1c0 0x7fc9a01f56c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9a006e350 0x7fc9a01eec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 --2- 172.21.15.179:0/4077653562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9a00c57f0 0x7fc9a01407a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 >> 172.21.15.179:0/4077653562 conn(0x7fc9a00b3270 msgr2=0x7fc9a015bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:26.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 shutdown_connections 2023-12-07T00:14:26.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.163+0000 7fc9a73fa700 1 -- 172.21.15.179:0/4077653562 wait complete. 2023-12-07T00:14:26.175 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:14:26.300 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.299+0000 7f55674df700 1 Processor -- start 2023-12-07T00:14:26.300 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.299+0000 7f55674df700 1 -- start start 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f55674df700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 0x7f5560070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f55674df700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55600d0ed0 0x7f55600adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f55674df700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556006f960 con 0x7f55600ce770 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f55674df700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f556015af50 con 0x7f55600d0ed0 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f55674df700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556006fc40 con 0x7f556015ab70 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f5565a7c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55600d0ed0 0x7f55600adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f5565a7c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f55600d0ed0 0x7f55600adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39026/0 (socket says 172.21.15.179:39026) 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f5565a7c700 1 -- 172.21.15.179:0/1036587662 learned_addr learned my addr 172.21.15.179:0/1036587662 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:26.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.300+0000 7f556527b700 1 --2- 172.21.15.179:0/1036587662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 0x7f5560070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f5565a7c700 1 -- 172.21.15.179:0/1036587662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 msgr2=0x7f5560070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f5565a7c700 1 --2- 172.21.15.179:0/1036587662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 0x7f5560070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f5565a7c700 1 -- 172.21.15.179:0/1036587662 >> v1:172.21.15.190:6789/0 conn(0x7f55600ce770 legacy=0x7f55600d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f5565a7c700 1 -- 172.21.15.179:0/1036587662 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55600cf110 con 0x7f55600d0ed0 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f5565a7c700 1 --2- 172.21.15.179:0/1036587662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600d0ed0 0x7f55600adb90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5558009e50 tx=0x7f555800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26765992ae0c8699 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f5557fff700 1 -- 172.21.15.179:0/1036587662 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800e070 con 0x7f55600d0ed0 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f5557fff700 1 -- 172.21.15.179:0/1036587662 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800b910 con 0x7f55600d0ed0 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f5557fff700 1 -- 172.21.15.179:0/1036587662 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800bcc0 con 0x7f55600d0ed0 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f55674df700 1 -- 172.21.15.179:0/1036587662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600d0ed0 msgr2=0x7f55600adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.301+0000 7f55674df700 1 --2- 172.21.15.179:0/1036587662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600d0ed0 0x7f55600adb90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5558009e50 tx=0x7f555800b330 comp rx=0 tx=0).stop 2023-12-07T00:14:26.304 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.302+0000 7f55674df700 1 -- 172.21.15.179:0/1036587662 shutdown_connections 2023-12-07T00:14:26.305 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.302+0000 7f55674df700 1 --2- 172.21.15.179:0/1036587662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600d0ed0 0x7f55600adb90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.305 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.302+0000 7f55674df700 1 --2- 172.21.15.179:0/1036587662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 0x7f5560070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.305 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.302+0000 7f55674df700 1 -- 172.21.15.179:0/1036587662 >> 172.21.15.179:0/1036587662 conn(0x7f5560099a40 msgr2=0x7f5560099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:26.305 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.302+0000 7f55674df700 1 -- 172.21.15.179:0/1036587662 shutdown_connections 2023-12-07T00:14:26.305 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.302+0000 7f55674df700 1 -- 172.21.15.179:0/1036587662 wait complete. 2023-12-07T00:14:26.305 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.303+0000 7f55674df700 1 Processor -- start 2023-12-07T00:14:26.305 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.303+0000 7f55674df700 1 -- start start 2023-12-07T00:14:26.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f55674df700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600ce770 0x7f55601f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f55674df700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55600d0ed0 0x7f55600cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f55674df700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 0x7f55600af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f55674df700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556015d4f0 con 0x7f55600ce770 2023-12-07T00:14:26.308 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f55674df700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55600ccfa0 con 0x7f55600d0ed0 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f55674df700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55600cd280 con 0x7f556015ab70 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600ce770 0x7f55601f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600ce770 0x7f55601f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39028/0 (socket says 172.21.15.179:39028) 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 -- 172.21.15.179:0/3330488569 learned_addr learned my addr 172.21.15.179:0/3330488569 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f5564a7a700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55600d0ed0 0x7f55600cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f5565a7c700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 0x7f55600af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 -- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 msgr2=0x7f55600af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 0x7f55600af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 -- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55600d0ed0 msgr2=0x7f55600cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55600d0ed0 0x7f55600cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 -- 172.21.15.179:0/3330488569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558009b30 con 0x7f55600ce770 2023-12-07T00:14:26.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f5564a7a700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55600d0ed0 0x7f55600cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f556527b700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600ce770 0x7f55601f4990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f555000e870 tx=0x7f555000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f5555ffb700 1 -- 172.21.15.179:0/3330488569 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5550009590 con 0x7f55600ce770 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f5555ffb700 1 -- 172.21.15.179:0/3330488569 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555000ee70 con 0x7f55600ce770 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55600cd560 con 0x7f55600ce770 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.304+0000 7f5555ffb700 1 -- 172.21.15.179:0/3330488569 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555000ca50 con 0x7f55600ce770 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.305+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55600cdb20 con 0x7f55600ce770 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.305+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55600cdce0 con 0x7f55600ce770 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.306+0000 7f5555ffb700 1 -- 172.21.15.179:0/3330488569 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f555000cbb0 con 0x7f55600ce770 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.306+0000 7f5555ffb700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f554406aed0 0x7f554406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.306+0000 7f5555ffb700 1 -- 172.21.15.179:0/3330488569 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f55500898f0 con 0x7f55600ce770 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.306+0000 7f5564a7a700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f554406aed0 0x7f554406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.307+0000 7f5564a7a700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f554406aed0 0x7f554406d390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f55600cab70 tx=0x7f555c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:26.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.311+0000 7f5555ffb700 1 -- 172.21.15.179:0/3330488569 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5550054610 con 0x7f55600ce770 2023-12-07T00:14:26.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.501+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f55600685f0 con 0x7f55600ce770 2023-12-07T00:14:26.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.502+0000 7f5555ffb700 1 -- 172.21.15.179:0/3330488569 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f555000ce60 con 0x7f55600ce770 2023-12-07T00:14:26.503 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:26.504 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f554406aed0 msgr2=0x7f554406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.504 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f554406aed0 0x7f554406d390 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f55600cab70 tx=0x7f555c009040 comp rx=0 tx=0).stop 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600ce770 msgr2=0x7f55601f4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600ce770 0x7f55601f4990 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f555000e870 tx=0x7f555000ec30 comp rx=0 tx=0).stop 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 shutdown_connections 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f554406aed0 0x7f554406d390 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f556015ab70 0x7f55600af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f55600ce770 0x7f55601f4990 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 --2- 172.21.15.179:0/3330488569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f55600d0ed0 0x7f55600cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 >> 172.21.15.179:0/3330488569 conn(0x7f5560099a40 msgr2=0x7f556006ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 shutdown_connections 2023-12-07T00:14:26.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.504+0000 7f55674df700 1 -- 172.21.15.179:0/3330488569 wait complete. 2023-12-07T00:14:26.516 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T00:14:26.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.637+0000 7f467ce47700 1 Processor -- start 2023-12-07T00:14:26.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.637+0000 7f467ce47700 1 -- start start 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.638+0000 7f467ce47700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46780b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.638+0000 7f467ce47700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f467815e220 0x7f46780b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.638+0000 7f467ce47700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467815f330 con 0x7f46780b4c20 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.638+0000 7f467ce47700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46780d1820 con 0x7f467815e220 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.638+0000 7f467ce47700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467815e720 con 0x7f467815de40 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f467659c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46780b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4675d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f467815e220 0x7f46780b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4675d9b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f467815e220 0x7f46780b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41288/0 (socket says 172.21.15.179:41288) 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f467659c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46780b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39450/0 (socket says 172.21.15.179:39450) 2023-12-07T00:14:26.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4675d9b700 1 -- 172.21.15.179:0/2941990625 learned_addr learned my addr 172.21.15.179:0/2941990625 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4676d9d700 1 --1- 172.21.15.179:0/2941990625 >> v1:172.21.15.190:6789/0 conn(0x7f46780b4c20 0x7f467806af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:52616/0 (socket says 172.21.15.179:52616) 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4675d9b700 1 -- 172.21.15.179:0/2941990625 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 msgr2=0x7f46780b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4675d9b700 1 --2- 172.21.15.179:0/2941990625 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46780b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4675d9b700 1 -- 172.21.15.179:0/2941990625 >> v1:172.21.15.190:6789/0 conn(0x7f46780b4c20 legacy=0x7f467806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4675d9b700 1 -- 172.21.15.179:0/2941990625 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467815ea00 con 0x7f467815e220 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f467559a700 1 -- 172.21.15.179:0/2941990625 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730948774 0 0) 0x7f467815f330 con 0x7f46780b4c20 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f467659c700 1 --2- 172.21.15.179:0/2941990625 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46780b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f4675d9b700 1 --2- 172.21.15.179:0/2941990625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 0x7f46780b2560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4668006fd0 tx=0x7f4668009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad6eddb7dd83fe47 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f467559a700 1 -- 172.21.15.179:0/2941990625 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668005e30 con 0x7f467815e220 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f467559a700 1 -- 172.21.15.179:0/2941990625 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4668004030 con 0x7f467815e220 2023-12-07T00:14:26.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.639+0000 7f467559a700 1 -- 172.21.15.179:0/2941990625 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46680043e0 con 0x7f467815e220 2023-12-07T00:14:26.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.640+0000 7f467ce47700 1 -- 172.21.15.179:0/2941990625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 msgr2=0x7f46780b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.640+0000 7f467ce47700 1 --2- 172.21.15.179:0/2941990625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 0x7f46780b2560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4668006fd0 tx=0x7f4668009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.640+0000 7f467ce47700 1 -- 172.21.15.179:0/2941990625 shutdown_connections 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.640+0000 7f467ce47700 1 --2- 172.21.15.179:0/2941990625 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46780b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.640+0000 7f467ce47700 1 --2- 172.21.15.179:0/2941990625 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 0x7f46780b2560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.640+0000 7f467ce47700 1 -- 172.21.15.179:0/2941990625 >> 172.21.15.179:0/2941990625 conn(0x7f4678072970 msgr2=0x7f4678072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.640+0000 7f467ce47700 1 -- 172.21.15.179:0/2941990625 shutdown_connections 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.640+0000 7f467ce47700 1 -- 172.21.15.179:0/2941990625 wait complete. 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.641+0000 7f467ce47700 1 Processor -- start 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467ce47700 1 -- start start 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467ce47700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46780b4c20 0x7f46781f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467ce47700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46781f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467ce47700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 0x7f46781f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467ce47700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780a99e0 con 0x7f46780b4c20 2023-12-07T00:14:26.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467ce47700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46781f41b0 con 0x7f467815e220 2023-12-07T00:14:26.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467ce47700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46781f6dc0 con 0x7f467815de40 2023-12-07T00:14:26.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46780b4c20 0x7f46781f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467659c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46780b4c20 0x7f46781f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39040/0 (socket says 172.21.15.179:39040) 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f467659c700 1 -- 172.21.15.179:0/2261406808 learned_addr learned my addr 172.21.15.179:0/2261406808 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f4675d9b700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46781f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.642+0000 7f4676d9d700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 0x7f46781f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f467659c700 1 -- 172.21.15.179:0/2261406808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 msgr2=0x7f46781f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f467659c700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46781f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f467659c700 1 -- 172.21.15.179:0/2261406808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 msgr2=0x7f46781f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f467659c700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 0x7f46781f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f467659c700 1 -- 172.21.15.179:0/2261406808 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c0094a0 con 0x7f46780b4c20 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f467659c700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46780b4c20 0x7f46781f67e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f466c00ebe0 tx=0x7f466c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:26.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f4666ffd700 1 -- 172.21.15.179:0/2261406808 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00c850 con 0x7f46780b4c20 2023-12-07T00:14:26.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f4666ffd700 1 -- 172.21.15.179:0/2261406808 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c00c9b0 con 0x7f46780b4c20 2023-12-07T00:14:26.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4668009500 con 0x7f46780b4c20 2023-12-07T00:14:26.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f4666ffd700 1 -- 172.21.15.179:0/2261406808 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00cd40 con 0x7f46780b4c20 2023-12-07T00:14:26.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.643+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46781f7380 con 0x7f46780b4c20 2023-12-07T00:14:26.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.644+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46780a88b0 con 0x7f46780b4c20 2023-12-07T00:14:26.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.644+0000 7f4666ffd700 1 -- 172.21.15.179:0/2261406808 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f466c013470 con 0x7f46780b4c20 2023-12-07T00:14:26.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.645+0000 7f4666ffd700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f465806aed0 0x7f465806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:26.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.645+0000 7f4666ffd700 1 -- 172.21.15.179:0/2261406808 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f466c0899c0 con 0x7f46780b4c20 2023-12-07T00:14:26.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.645+0000 7f4675d9b700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f465806aed0 0x7f465806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:26.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.645+0000 7f4675d9b700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f465806aed0 0x7f465806d390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4668006fd0 tx=0x7f4668008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:26.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.649+0000 7f4666ffd700 1 -- 172.21.15.179:0/2261406808 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f466c054780 con 0x7f46780b4c20 2023-12-07T00:14:26.863 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.863+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f467804f290 con 0x7f46780b4c20 2023-12-07T00:14:26.863 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.863+0000 7f4666ffd700 1 -- 172.21.15.179:0/2261406808 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f466c021080 con 0x7f46780b4c20 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f465806aed0 msgr2=0x7f465806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f465806aed0 0x7f465806d390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4668006fd0 tx=0x7f4668008070 comp rx=0 tx=0).stop 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46780b4c20 msgr2=0x7f46781f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46780b4c20 0x7f46781f67e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f466c00ebe0 tx=0x7f466c00eef0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 shutdown_connections 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f465806aed0 0x7f465806d390 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f467815e220 0x7f46781f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f46780b4c20 0x7f46781f67e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 --2- 172.21.15.179:0/2261406808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f467815de40 0x7f46781f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 >> 172.21.15.179:0/2261406808 conn(0x7f4678072970 msgr2=0x7f46780b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 shutdown_connections 2023-12-07T00:14:26.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:26.865+0000 7f467ce47700 1 -- 172.21.15.179:0/2261406808 wait complete. 2023-12-07T00:14:26.867 INFO:teuthology.orchestra.run.smithi179.stderr:listed 0 entries 2023-12-07T00:14:26.877 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:14:26.877 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:14:26.895 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:27.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.054+0000 7f8ba7440700 1 Processor -- start 2023-12-07T00:14:27.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.054+0000 7f8ba7440700 1 -- start start 2023-12-07T00:14:27.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.055+0000 7f8ba7440700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ba015bf40 0x7f8ba00cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.055+0000 7f8ba7440700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8ba0099b20 0x7f8ba0066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.055+0000 7f8ba7440700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba00b1720 con 0x7f8ba00af250 2023-12-07T00:14:27.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.055+0000 7f8ba7440700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba006c670 con 0x7f8ba015bf40 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.055+0000 7f8ba7440700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba006c0b0 con 0x7f8ba0099b20 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.055+0000 7f8ba51dc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ba015bf40 0x7f8ba00cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8ba51dc700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ba015bf40 0x7f8ba00cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39056/0 (socket says 172.21.15.179:39056) 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8ba51dc700 1 -- 172.21.15.179:0/4092120579 learned_addr learned my addr 172.21.15.179:0/4092120579 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8ba49db700 1 --2- 172.21.15.179:0/4092120579 >> v2:172.21.15.190:3300/0 conn(0x7f8ba0099b20 0x7f8ba0066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8ba51dc700 1 -- 172.21.15.179:0/4092120579 >> v2:172.21.15.190:3300/0 conn(0x7f8ba0099b20 msgr2=0x7f8ba0066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8ba51dc700 1 --2- 172.21.15.179:0/4092120579 >> v2:172.21.15.190:3300/0 conn(0x7f8ba0099b20 0x7f8ba0066ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8ba51dc700 1 -- 172.21.15.179:0/4092120579 >> v1:172.21.15.190:6789/0 conn(0x7f8ba00af250 legacy=0x7f8ba00d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8ba51dc700 1 -- 172.21.15.179:0/4092120579 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba006c390 con 0x7f8ba015bf40 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8ba51dc700 1 --2- 172.21.15.179:0/4092120579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba015bf40 0x7f8ba00cc8a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ba009e390 tx=0x7f8b9c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e125066b07005502 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8b97fff700 1 -- 172.21.15.179:0/4092120579 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c011830 con 0x7f8ba015bf40 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8b97fff700 1 -- 172.21.15.179:0/4092120579 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c011990 con 0x7f8ba015bf40 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.056+0000 7f8b97fff700 1 -- 172.21.15.179:0/4092120579 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c011d20 con 0x7f8ba015bf40 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.057+0000 7f8ba7440700 1 -- 172.21.15.179:0/4092120579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba015bf40 msgr2=0x7f8ba00cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.057+0000 7f8ba7440700 1 --2- 172.21.15.179:0/4092120579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba015bf40 0x7f8ba00cc8a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ba009e390 tx=0x7f8b9c009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.057+0000 7f8ba7440700 1 -- 172.21.15.179:0/4092120579 shutdown_connections 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.057+0000 7f8ba7440700 1 --2- 172.21.15.179:0/4092120579 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba015bf40 0x7f8ba00cc8a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.057+0000 7f8ba7440700 1 --2- 172.21.15.179:0/4092120579 >> v2:172.21.15.190:3300/0 conn(0x7f8ba0099b20 0x7f8ba0066ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.057+0000 7f8ba7440700 1 -- 172.21.15.179:0/4092120579 >> 172.21.15.179:0/4092120579 conn(0x7f8ba0072660 msgr2=0x7f8ba00b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:27.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.057+0000 7f8ba7440700 1 -- 172.21.15.179:0/4092120579 shutdown_connections 2023-12-07T00:14:27.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.057+0000 7f8ba7440700 1 -- 172.21.15.179:0/4092120579 wait complete. 2023-12-07T00:14:27.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.058+0000 7f8ba7440700 1 Processor -- start 2023-12-07T00:14:27.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.058+0000 7f8ba7440700 1 -- start start 2023-12-07T00:14:27.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba7440700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba0099b20 0x7f8ba0152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba7440700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba00af250 0x7f8ba01416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba7440700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ba015bf40 0x7f8ba0143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba7440700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0147c90 con 0x7f8ba00af250 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba7440700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba01534e0 con 0x7f8ba0099b20 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba7440700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0153780 con 0x7f8ba015bf40 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba00af250 0x7f8ba01416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba00af250 0x7f8ba01416c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39064/0 (socket says 172.21.15.179:39064) 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 -- 172.21.15.179:0/2624528003 learned_addr learned my addr 172.21.15.179:0/2624528003 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba51dc700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba0099b20 0x7f8ba0152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba59dd700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ba015bf40 0x7f8ba0143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 -- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ba015bf40 msgr2=0x7f8ba0143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ba015bf40 0x7f8ba0143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 -- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba0099b20 msgr2=0x7f8ba0152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba0099b20 0x7f8ba0152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 -- 172.21.15.179:0/2624528003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c009550 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba51dc700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba0099b20 0x7f8ba0152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.059+0000 7f8ba49db700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba00af250 0x7f8ba01416c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000e9b0 tx=0x7f8b9000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.060+0000 7f8b95ffb700 1 -- 172.21.15.179:0/2624528003 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b90009710 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.060+0000 7f8b95ffb700 1 -- 172.21.15.179:0/2624528003 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000c850 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.060+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba0156150 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.060+0000 7f8b95ffb700 1 -- 172.21.15.179:0/2624528003 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9000cbc0 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.060+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba0153a60 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.061+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba0070960 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.061+0000 7f8b95ffb700 1 -- 172.21.15.179:0/2624528003 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b9000cd20 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.061+0000 7f8b95ffb700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b8406aed0 0x7f8b8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.062+0000 7f8b95ffb700 1 -- 172.21.15.179:0/2624528003 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b900899b0 con 0x7f8ba00af250 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.062+0000 7f8ba51dc700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b8406aed0 0x7f8b8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.062+0000 7f8ba51dc700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b8406aed0 0x7f8b8406d390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c014040 tx=0x7f8b9c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.066+0000 7f8b95ffb700 1 -- 172.21.15.179:0/2624528003 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b90054780 con 0x7f8ba00af250 2023-12-07T00:14:27.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.260+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ba00685f0 con 0x7f8ba00af250 2023-12-07T00:14:27.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.262+0000 7f8b95ffb700 1 -- 172.21.15.179:0/2624528003 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f8b90057da0 con 0x7f8ba00af250 2023-12-07T00:14:27.262 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:27.262 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b8406aed0 msgr2=0x7f8b8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b8406aed0 0x7f8b8406d390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c014040 tx=0x7f8b9c008030 comp rx=0 tx=0).stop 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba00af250 msgr2=0x7f8ba01416c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba00af250 0x7f8ba01416c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b9000e9b0 tx=0x7f8b9000ed70 comp rx=0 tx=0).stop 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 shutdown_connections 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8b8406aed0 0x7f8b8406d390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ba015bf40 0x7f8ba0143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ba0099b20 0x7f8ba0152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.264 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 --2- 172.21.15.179:0/2624528003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ba00af250 0x7f8ba01416c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.265 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 >> 172.21.15.179:0/2624528003 conn(0x7f8ba0072660 msgr2=0x7f8ba00d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:27.265 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 shutdown_connections 2023-12-07T00:14:27.265 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.264+0000 7f8ba7440700 1 -- 172.21.15.179:0/2624528003 wait complete. 2023-12-07T00:14:27.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:27.277 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:27.399 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.399+0000 7fb84cc78700 1 Processor -- start 2023-12-07T00:14:27.400 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.399+0000 7fb84cc78700 1 -- start start 2023-12-07T00:14:27.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb84cc78700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb84815de50 0x7fb8480cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb84cc78700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb84806b680 0x7fb8480cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb84cc78700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8480cc550 con 0x7fb8480ccc90 2023-12-07T00:14:27.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb84cc78700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480cd1c0 con 0x7fb84815de50 2023-12-07T00:14:27.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb84cc78700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480cd4a0 con 0x7fb84806b680 2023-12-07T00:14:27.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb84659c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb84815de50 0x7fb8480cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.402 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb845d9b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb8480ccc90 0x7fb84806af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45972/0 (socket says 172.21.15.179:45972) 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb84659c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb84815de50 0x7fb8480cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39070/0 (socket says 172.21.15.179:39070) 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb845d9b700 1 -- 172.21.15.179:0/1781044633 learned_addr learned my addr 172.21.15.179:0/1781044633 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.400+0000 7fb846d9d700 1 --2- 172.21.15.179:0/1781044633 >> v2:172.21.15.190:3300/0 conn(0x7fb84806b680 0x7fb8480cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84659c700 1 -- 172.21.15.179:0/1781044633 >> v2:172.21.15.190:3300/0 conn(0x7fb84806b680 msgr2=0x7fb8480cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84659c700 1 --2- 172.21.15.179:0/1781044633 >> v2:172.21.15.190:3300/0 conn(0x7fb84806b680 0x7fb8480cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84659c700 1 -- 172.21.15.179:0/1781044633 >> v1:172.21.15.179:6789/0 conn(0x7fb8480ccc90 legacy=0x7fb84806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84659c700 1 -- 172.21.15.179:0/1781044633 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480cd780 con 0x7fb84815de50 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84559a700 1 -- 172.21.15.179:0/1781044633 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555119097 0 0) 0x7fb8480cc550 con 0x7fb8480ccc90 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84659c700 1 --2- 172.21.15.179:0/1781044633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb84815de50 0x7fb8480cc010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb8480ce790 tx=0x7fb83c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7064f8daa8897a31 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84559a700 1 -- 172.21.15.179:0/1781044633 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011830 con 0x7fb84815de50 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84559a700 1 -- 172.21.15.179:0/1781044633 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c011990 con 0x7fb84815de50 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84559a700 1 -- 172.21.15.179:0/1781044633 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c011d20 con 0x7fb84815de50 2023-12-07T00:14:27.403 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84cc78700 1 -- 172.21.15.179:0/1781044633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb84815de50 msgr2=0x7fb8480cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.404 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1781044633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb84815de50 0x7fb8480cc010 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb8480ce790 tx=0x7fb83c009b20 comp rx=0 tx=0).stop 2023-12-07T00:14:27.404 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84cc78700 1 -- 172.21.15.179:0/1781044633 shutdown_connections 2023-12-07T00:14:27.404 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1781044633 >> v2:172.21.15.190:3300/0 conn(0x7fb84806b680 0x7fb8480cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.404 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1781044633 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb84815de50 0x7fb8480cc010 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.404 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.401+0000 7fb84cc78700 1 -- 172.21.15.179:0/1781044633 >> 172.21.15.179:0/1781044633 conn(0x7fb848099a40 msgr2=0x7fb848099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:27.404 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.402+0000 7fb84cc78700 1 -- 172.21.15.179:0/1781044633 shutdown_connections 2023-12-07T00:14:27.404 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.402+0000 7fb84cc78700 1 -- 172.21.15.179:0/1781044633 wait complete. 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.403+0000 7fb84cc78700 1 Processor -- start 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.403+0000 7fb84cc78700 1 -- start start 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84cc78700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb84806b680 0x7fb8480c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84cc78700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8480ccc90 0x7fb8480c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84cc78700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb84815de50 0x7fb8480c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84cc78700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480c5c30 con 0x7fb8480ccc90 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84cc78700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480c5600 con 0x7fb84815de50 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84cc78700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8480c7010 con 0x7fb84806b680 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8480ccc90 0x7fb8480c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8480ccc90 0x7fb8480c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39076/0 (socket says 172.21.15.179:39076) 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 -- 172.21.15.179:0/1062754753 learned_addr learned my addr 172.21.15.179:0/1062754753 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:27.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb846d9d700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb84815de50 0x7fb8480c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84659c700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb84806b680 0x7fb8480c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 -- 172.21.15.179:0/1062754753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb84806b680 msgr2=0x7fb8480c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb84806b680 0x7fb8480c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 -- 172.21.15.179:0/1062754753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb84815de50 msgr2=0x7fb8480c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb84815de50 0x7fb8480c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 -- 172.21.15.179:0/1062754753 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0094a0 con 0x7fb8480ccc90 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb845d9b700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8480ccc90 0x7fb8480c6590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c520 tx=0x7fb83800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb836ffd700 1 -- 172.21.15.179:0/1062754753 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838004c80 con 0x7fb8480ccc90 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb836ffd700 1 -- 172.21.15.179:0/1062754753 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838004e00 con 0x7fb8480ccc90 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8480ca650 con 0x7fb8480ccc90 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb836ffd700 1 -- 172.21.15.179:0/1062754753 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838007310 con 0x7fb8480ccc90 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.404+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8480c5850 con 0x7fb8480ccc90 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.405+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8480685f0 con 0x7fb8480ccc90 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.406+0000 7fb836ffd700 1 -- 172.21.15.179:0/1062754753 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb838007470 con 0x7fb8480ccc90 2023-12-07T00:14:27.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.406+0000 7fb836ffd700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb82806aed0 0x7fb82806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.406+0000 7fb84659c700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb82806aed0 0x7fb82806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.406+0000 7fb836ffd700 1 -- 172.21.15.179:0/1062754753 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb838089460 con 0x7fb8480ccc90 2023-12-07T00:14:27.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.407+0000 7fb84659c700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb82806aed0 0x7fb82806d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0090b0 tx=0x7fb83c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.411+0000 7fb836ffd700 1 -- 172.21.15.179:0/1062754753 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8380542b0 con 0x7fb8480ccc90 2023-12-07T00:14:27.600 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.599+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8480c5d70 con 0x7fb8480ccc90 2023-12-07T00:14:27.600 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.600+0000 7fb836ffd700 1 -- 172.21.15.179:0/1062754753 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8480c5d70 con 0x7fb8480ccc90 2023-12-07T00:14:27.600 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:27.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb82806aed0 msgr2=0x7fb82806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb82806aed0 0x7fb82806d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb83c0090b0 tx=0x7fb83c01c040 comp rx=0 tx=0).stop 2023-12-07T00:14:27.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8480ccc90 msgr2=0x7fb8480c6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8480ccc90 0x7fb8480c6590 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c520 tx=0x7fb83800c830 comp rx=0 tx=0).stop 2023-12-07T00:14:27.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 shutdown_connections 2023-12-07T00:14:27.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb82806aed0 0x7fb82806d390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb84815de50 0x7fb8480c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb84806b680 0x7fb8480c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 --2- 172.21.15.179:0/1062754753 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb8480ccc90 0x7fb8480c6590 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 >> 172.21.15.179:0/1062754753 conn(0x7fb848099a40 msgr2=0x7fb84806af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:27.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 shutdown_connections 2023-12-07T00:14:27.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.602+0000 7fb84cc78700 1 -- 172.21.15.179:0/1062754753 wait complete. 2023-12-07T00:14:27.614 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:14:27.742 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.742+0000 7f1599238700 1 Processor -- start 2023-12-07T00:14:27.742 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.742+0000 7f1599238700 1 -- start start 2023-12-07T00:14:27.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f1599238700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f159415ab70 0x7f1594070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f1599238700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159406f960 con 0x7f15940ce770 2023-12-07T00:14:27.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f1599238700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15940cf110 con 0x7f15940d0ed0 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f1599238700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159415af50 con 0x7f159415ab70 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f159259c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f15940ce770 0x7f15940d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:45986/0 (socket says 172.21.15.179:45986) 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f159259c700 1 -- 172.21.15.179:0/760256421 learned_addr learned my addr 172.21.15.179:0/760256421 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f1592d9d700 1 --2- 172.21.15.179:0/760256421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f159415ab70 0x7f1594070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f1591d9b700 1 -- 172.21.15.179:0/760256421 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551638477 0 0) 0x7f159406f960 con 0x7f15940ce770 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.743+0000 7f1591d9b700 1 -- 172.21.15.179:0/760256421 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f157c0035b0 con 0x7f15940ce770 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1591d9b700 1 -- 172.21.15.179:0/760256421 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562107522 0 0) 0x7f15940cf110 con 0x7f15940d0ed0 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1591d9b700 1 -- 172.21.15.179:0/760256421 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f159406f960 con 0x7f15940d0ed0 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1592d9d700 1 -- 172.21.15.179:0/760256421 >> v1:172.21.15.190:6789/0 conn(0x7f15940d0ed0 legacy=0x7f15940adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1591d9b700 1 -- 172.21.15.179:0/760256421 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205906616 0 0) 0x7f157c0035b0 con 0x7f15940ce770 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1592d9d700 1 -- 172.21.15.179:0/760256421 >> v1:172.21.15.179:6789/0 conn(0x7f15940ce770 legacy=0x7f15940d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1592d9d700 1 -- 172.21.15.179:0/760256421 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940cf3f0 con 0x7f159415ab70 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1592d9d700 1 --2- 172.21.15.179:0/760256421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f159415ab70 0x7f1594070880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1584009870 tx=0x7f1584009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7de2d27f7549e0ba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1591d9b700 1 -- 172.21.15.179:0/760256421 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588001670 con 0x7f159415ab70 2023-12-07T00:14:27.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1591d9b700 1 -- 172.21.15.179:0/760256421 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1584004030 con 0x7f159415ab70 2023-12-07T00:14:27.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1591d9b700 1 -- 172.21.15.179:0/760256421 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15840043a0 con 0x7f159415ab70 2023-12-07T00:14:27.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1599238700 1 -- 172.21.15.179:0/760256421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f159415ab70 msgr2=0x7f1594070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1599238700 1 --2- 172.21.15.179:0/760256421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f159415ab70 0x7f1594070880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1584009870 tx=0x7f1584009b80 comp rx=0 tx=0).stop 2023-12-07T00:14:27.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1599238700 1 -- 172.21.15.179:0/760256421 shutdown_connections 2023-12-07T00:14:27.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1599238700 1 --2- 172.21.15.179:0/760256421 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f159415ab70 0x7f1594070880 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.744+0000 7f1599238700 1 -- 172.21.15.179:0/760256421 >> 172.21.15.179:0/760256421 conn(0x7f1594099a40 msgr2=0x7f1594099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:27.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.745+0000 7f1599238700 1 -- 172.21.15.179:0/760256421 shutdown_connections 2023-12-07T00:14:27.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.745+0000 7f1599238700 1 -- 172.21.15.179:0/760256421 wait complete. 2023-12-07T00:14:27.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.746+0000 7f1599238700 1 Processor -- start 2023-12-07T00:14:27.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.746+0000 7f1599238700 1 -- start start 2023-12-07T00:14:27.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f1599238700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15940ce770 0x7f1594156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f1599238700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15940d0ed0 0x7f15940c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f1599238700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159415ab70 0x7f15940b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f1599238700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159406fc40 con 0x7f159415ab70 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f1599238700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c6660 con 0x7f15940ce770 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f1599238700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c5d70 con 0x7f15940d0ed0 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f159359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159415ab70 0x7f15940b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f159359e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159415ab70 0x7f15940b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39092/0 (socket says 172.21.15.179:39092) 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f159359e700 1 -- 172.21.15.179:0/873845233 learned_addr learned my addr 172.21.15.179:0/873845233 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f159259c700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15940d0ed0 0x7f15940c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.747+0000 7f1592d9d700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15940ce770 0x7f1594156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f159359e700 1 -- 172.21.15.179:0/873845233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15940d0ed0 msgr2=0x7f15940c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f159359e700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15940d0ed0 0x7f15940c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f159359e700 1 -- 172.21.15.179:0/873845233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15940ce770 msgr2=0x7f1594156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f159359e700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15940ce770 0x7f1594156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f159359e700 1 -- 172.21.15.179:0/873845233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840094a0 con 0x7f159415ab70 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f159359e700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159415ab70 0x7f15940b4a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f158c00cc50 tx=0x7f158c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f157b7fe700 1 -- 172.21.15.179:0/873845233 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c003c00 con 0x7f159415ab70 2023-12-07T00:14:27.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f157b7fe700 1 -- 172.21.15.179:0/873845233 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c003d60 con 0x7f159415ab70 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f157b7fe700 1 -- 172.21.15.179:0/873845233 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00aab0 con 0x7f159415ab70 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15940c6010 con 0x7f159415ab70 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.748+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15940b5460 con 0x7f159415ab70 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.749+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15940b55f0 con 0x7f159415ab70 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.750+0000 7f157b7fe700 1 -- 172.21.15.179:0/873845233 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f158c00ac10 con 0x7f159415ab70 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.750+0000 7f157b7fe700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f158006aed0 0x7f158006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.750+0000 7f157b7fe700 1 -- 172.21.15.179:0/873845233 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f158c089900 con 0x7f159415ab70 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.750+0000 7f1592d9d700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f158006aed0 0x7f158006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:27.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.750+0000 7f1592d9d700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f158006aed0 0x7f158006d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15840097c0 tx=0x7f1584008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:27.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.754+0000 7f157b7fe700 1 -- 172.21.15.179:0/873845233 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f158c0546c0 con 0x7f159415ab70 2023-12-07T00:14:27.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.943+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15940c67d0 con 0x7f159415ab70 2023-12-07T00:14:27.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.943+0000 7f157b7fe700 1 -- 172.21.15.179:0/873845233 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f158c057ce0 con 0x7f159415ab70 2023-12-07T00:14:27.944 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:27.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f158006aed0 msgr2=0x7f158006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f158006aed0 0x7f158006d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f15840097c0 tx=0x7f1584008030 comp rx=0 tx=0).stop 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159415ab70 msgr2=0x7f15940b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159415ab70 0x7f15940b4a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f158c00cc50 tx=0x7f158c00cf60 comp rx=0 tx=0).stop 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 shutdown_connections 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f158006aed0 0x7f158006d390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f159415ab70 0x7f15940b4a10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15940ce770 0x7f1594156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 --2- 172.21.15.179:0/873845233 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15940d0ed0 0x7f15940c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 >> 172.21.15.179:0/873845233 conn(0x7f1594099a40 msgr2=0x7f15940c9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 shutdown_connections 2023-12-07T00:14:27.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:27.945+0000 7f1599238700 1 -- 172.21.15.179:0/873845233 wait complete. 2023-12-07T00:14:27.957 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:14:28.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.081+0000 7fb9d31ad700 1 Processor -- start 2023-12-07T00:14:28.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.081+0000 7fb9d31ad700 1 -- start start 2023-12-07T00:14:28.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d31ad700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb9cc15ab70 0x7fb9cc070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d31ad700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc0adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d31ad700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9cc06f960 con 0x7fb9cc0ce770 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d31ad700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9cc15af50 con 0x7fb9cc15ab70 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d31ad700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc06fc40 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d0f49700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb9cc15ab70 0x7fb9cc070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d174a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc0adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9cbfff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fb9cc0ce770 0x7fb9cc0d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:52676/0 (socket says 172.21.15.179:52676) 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9cbfff700 1 -- 172.21.15.179:0/3283291333 learned_addr learned my addr 172.21.15.179:0/3283291333 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d174a700 1 -- 172.21.15.179:0/3283291333 >> v2:172.21.15.190:3300/0 conn(0x7fb9cc15ab70 msgr2=0x7fb9cc070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d174a700 1 --2- 172.21.15.179:0/3283291333 >> v2:172.21.15.190:3300/0 conn(0x7fb9cc15ab70 0x7fb9cc070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d174a700 1 -- 172.21.15.179:0/3283291333 >> v1:172.21.15.190:6789/0 conn(0x7fb9cc0ce770 legacy=0x7fb9cc0d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.082+0000 7fb9d174a700 1 -- 172.21.15.179:0/3283291333 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc0cf110 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d174a700 1 --2- 172.21.15.179:0/3283291333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc0adb90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009d90 tx=0x7fb9c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd1a1d4da698841 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9cb7fe700 1 -- 172.21.15.179:0/3283291333 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400e070 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9cb7fe700 1 -- 172.21.15.179:0/3283291333 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c400bb20 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.084 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9cb7fe700 1 -- 172.21.15.179:0/3283291333 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4012430 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d31ad700 1 -- 172.21.15.179:0/3283291333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 msgr2=0x7fb9cc0adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/3283291333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc0adb90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009d90 tx=0x7fb9c400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:28.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d31ad700 1 -- 172.21.15.179:0/3283291333 shutdown_connections 2023-12-07T00:14:28.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/3283291333 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc0adb90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/3283291333 >> v2:172.21.15.190:3300/0 conn(0x7fb9cc15ab70 0x7fb9cc070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d31ad700 1 -- 172.21.15.179:0/3283291333 >> 172.21.15.179:0/3283291333 conn(0x7fb9cc099a40 msgr2=0x7fb9cc099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:28.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d31ad700 1 -- 172.21.15.179:0/3283291333 shutdown_connections 2023-12-07T00:14:28.085 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.083+0000 7fb9d31ad700 1 -- 172.21.15.179:0/3283291333 wait complete. 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.085+0000 7fb9d31ad700 1 Processor -- start 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.085+0000 7fb9d31ad700 1 -- start start 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.085+0000 7fb9d31ad700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9cc0ce770 0x7fb9cc06b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.085+0000 7fb9d31ad700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.085+0000 7fb9d31ad700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9cc15ab70 0x7fb9cc15d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.085+0000 7fb9d31ad700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc15c2b0 con 0x7fb9cc0ce770 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.085+0000 7fb9d31ad700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc15d110 con 0x7fb9cc15ab70 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.085+0000 7fb9d31ad700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc155e30 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9d0f49700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9cc0ce770 0x7fb9cc06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9d0f49700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9cc0ce770 0x7fb9cc06b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39102/0 (socket says 172.21.15.179:39102) 2023-12-07T00:14:28.088 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9d0f49700 1 -- 172.21.15.179:0/568673356 learned_addr learned my addr 172.21.15.179:0/568673356 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9cbfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9d174a700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9cc15ab70 0x7fb9cc15d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9cbfff700 1 -- 172.21.15.179:0/568673356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9cc15ab70 msgr2=0x7fb9cc15d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9cbfff700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9cc15ab70 0x7fb9cc15d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9cbfff700 1 -- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9cc0ce770 msgr2=0x7fb9cc06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9cbfff700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9cc0ce770 0x7fb9cc06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9cbfff700 1 -- 172.21.15.179:0/568673356 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4009a70 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9d0f49700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9cc0ce770 0x7fb9cc06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9cbfff700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc1558f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c4d0 tx=0x7fb9b800c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9c97fa700 1 -- 172.21.15.179:0/568673356 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8005d70 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9c97fa700 1 -- 172.21.15.179:0/568673356 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b800ce80 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9cc15c500 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9c97fa700 1 -- 172.21.15.179:0/568673356 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80072d0 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.086+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9cc15cac0 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.087+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9cc0685f0 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.088+0000 7fb9c97fa700 1 -- 172.21.15.179:0/568673356 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb9b8007430 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.088+0000 7fb9c97fa700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb9b006aed0 0x7fb9b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.088+0000 7fb9c97fa700 1 -- 172.21.15.179:0/568673356 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9b80889d0 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.088+0000 7fb9d0f49700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb9b006aed0 0x7fb9b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.091 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.088+0000 7fb9d0f49700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb9b006aed0 0x7fb9b006d390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00112c0 tx=0x7fb9c0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.093+0000 7fb9c97fa700 1 -- 172.21.15.179:0/568673356 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9b80538d0 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.283+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9cc0b6a20 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.284+0000 7fb9c97fa700 1 -- 172.21.15.179:0/568673356 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9b80170a0 con 0x7fb9cc0d0ed0 2023-12-07T00:14:28.284 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb9b006aed0 msgr2=0x7fb9b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb9b006aed0 0x7fb9b006d390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00112c0 tx=0x7fb9c0009210 comp rx=0 tx=0).stop 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 msgr2=0x7fb9cc1558f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc1558f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9b800c4d0 tx=0x7fb9b800c7e0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 shutdown_connections 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb9b006aed0 0x7fb9b006d390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb9cc15ab70 0x7fb9cc15d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb9cc0ce770 0x7fb9cc06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 --2- 172.21.15.179:0/568673356 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9cc0d0ed0 0x7fb9cc1558f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 >> 172.21.15.179:0/568673356 conn(0x7fb9cc099a40 msgr2=0x7fb9cc0c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:28.287 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 shutdown_connections 2023-12-07T00:14:28.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.286+0000 7fb9d31ad700 1 -- 172.21.15.179:0/568673356 wait complete. 2023-12-07T00:14:28.298 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:14:28.421 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.421+0000 7fc2afc47700 1 Processor -- start 2023-12-07T00:14:28.422 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2afc47700 1 -- start start 2023-12-07T00:14:28.424 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2afc47700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80ce770 0x7fc2a8070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.424 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2afc47700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc2a80d0ed0 0x7fc2a80adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.424 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2afc47700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a806f960 con 0x7fc2a815ab70 2023-12-07T00:14:28.424 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2afc47700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a815af50 con 0x7fc2a80d0ed0 2023-12-07T00:14:28.424 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2afc47700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a806fc40 con 0x7fc2a80ce770 2023-12-07T00:14:28.424 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2ae1e4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc2a80d0ed0 0x7fc2a80adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2ae1e4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc2a80d0ed0 0x7fc2a80adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39114/0 (socket says 172.21.15.179:39114) 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.422+0000 7fc2ae1e4700 1 -- 172.21.15.179:0/1973157202 learned_addr learned my addr 172.21.15.179:0/1973157202 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ad1e2700 1 --2- 172.21.15.179:0/1973157202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80ce770 0x7fc2a8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ae1e4700 1 -- 172.21.15.179:0/1973157202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80ce770 msgr2=0x7fc2a8070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ae1e4700 1 --2- 172.21.15.179:0/1973157202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80ce770 0x7fc2a8070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ae1e4700 1 -- 172.21.15.179:0/1973157202 >> v1:172.21.15.190:6789/0 conn(0x7fc2a815ab70 legacy=0x7fc2a80d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ae1e4700 1 -- 172.21.15.179:0/1973157202 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80cf110 con 0x7fc2a80d0ed0 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ad1e2700 1 --2- 172.21.15.179:0/1973157202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80ce770 0x7fc2a8070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ae1e4700 1 --2- 172.21.15.179:0/1973157202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80d0ed0 0x7fc2a80adb90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009e50 tx=0x7fc2a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503d0103e928b00f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ac9e1700 1 -- 172.21.15.179:0/1973157202 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000e070 con 0x7fc2a80d0ed0 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ac9e1700 1 -- 172.21.15.179:0/1973157202 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000b9c0 con 0x7fc2a80d0ed0 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.423+0000 7fc2ac9e1700 1 -- 172.21.15.179:0/1973157202 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000bd70 con 0x7fc2a80d0ed0 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.424+0000 7fc2afc47700 1 -- 172.21.15.179:0/1973157202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80d0ed0 msgr2=0x7fc2a80adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.425 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.424+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1973157202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80d0ed0 0x7fc2a80adb90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc2a0009e50 tx=0x7fc2a000b330 comp rx=0 tx=0).stop 2023-12-07T00:14:28.426 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.424+0000 7fc2afc47700 1 -- 172.21.15.179:0/1973157202 shutdown_connections 2023-12-07T00:14:28.426 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.424+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1973157202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80d0ed0 0x7fc2a80adb90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.426 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.424+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1973157202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80ce770 0x7fc2a8070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.426 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.424+0000 7fc2afc47700 1 -- 172.21.15.179:0/1973157202 >> 172.21.15.179:0/1973157202 conn(0x7fc2a8099a40 msgr2=0x7fc2a8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:28.426 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.424+0000 7fc2afc47700 1 -- 172.21.15.179:0/1973157202 shutdown_connections 2023-12-07T00:14:28.426 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.424+0000 7fc2afc47700 1 -- 172.21.15.179:0/1973157202 wait complete. 2023-12-07T00:14:28.430 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.425+0000 7fc2afc47700 1 Processor -- start 2023-12-07T00:14:28.430 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.425+0000 7fc2afc47700 1 -- start start 2023-12-07T00:14:28.430 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2afc47700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80ce770 0x7fc2a80b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2afc47700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80d0ed0 0x7fc2a80b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2afc47700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a815ab70 0x7fc2a80b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2afc47700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80b66c0 con 0x7fc2a80ce770 2023-12-07T00:14:28.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2afc47700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80b09e0 con 0x7fc2a815ab70 2023-12-07T00:14:28.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2afc47700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8147380 con 0x7fc2a80d0ed0 2023-12-07T00:14:28.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80ce770 0x7fc2a80b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80ce770 0x7fc2a80b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39116/0 (socket says 172.21.15.179:39116) 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 -- 172.21.15.179:0/1150602576 learned_addr learned my addr 172.21.15.179:0/1150602576 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad1e2700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80d0ed0 0x7fc2a80b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ae1e4700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a815ab70 0x7fc2a80b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 -- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80d0ed0 msgr2=0x7fc2a80b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80d0ed0 0x7fc2a80b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 -- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a815ab70 msgr2=0x7fc2a80b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a815ab70 0x7fc2a80b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 -- 172.21.15.179:0/1150602576 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009b30 con 0x7fc2a80ce770 2023-12-07T00:14:28.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ae1e4700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a815ab70 0x7fc2a80b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2ad9e3700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80ce770 0x7fc2a80b4f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c450 tx=0x7fc29800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc29e7fc700 1 -- 172.21.15.179:0/1150602576 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980052d0 con 0x7fc2a80ce770 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc29e7fc700 1 -- 172.21.15.179:0/1150602576 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298005430 con 0x7fc2a80ce770 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a80b6100 con 0x7fc2a80ce770 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc29e7fc700 1 -- 172.21.15.179:0/1150602576 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980038c0 con 0x7fc2a80ce770 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.426+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a80b0670 con 0x7fc2a80ce770 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.427+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a80685f0 con 0x7fc2a80ce770 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.428+0000 7fc29e7fc700 1 -- 172.21.15.179:0/1150602576 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc298003a20 con 0x7fc2a80ce770 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.428+0000 7fc29e7fc700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc28c06aed0 0x7fc28c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.428+0000 7fc29e7fc700 1 -- 172.21.15.179:0/1150602576 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc298088be0 con 0x7fc2a80ce770 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.428+0000 7fc2ad1e2700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc28c06aed0 0x7fc28c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.429+0000 7fc2ad1e2700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc28c06aed0 0x7fc28c06d390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2a81516a0 tx=0x7fc2a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.433+0000 7fc29e7fc700 1 -- 172.21.15.179:0/1150602576 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc298053a30 con 0x7fc2a80ce770 2023-12-07T00:14:28.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.626+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc2a806b930 con 0x7fc2a80ce770 2023-12-07T00:14:28.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.626+0000 7fc29e7fc700 1 -- 172.21.15.179:0/1150602576 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc2980170a0 con 0x7fc2a80ce770 2023-12-07T00:14:28.627 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:28.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc28c06aed0 msgr2=0x7fc28c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc28c06aed0 0x7fc28c06d390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc2a81516a0 tx=0x7fc2a4008040 comp rx=0 tx=0).stop 2023-12-07T00:14:28.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80ce770 msgr2=0x7fc2a80b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80ce770 0x7fc2a80b4f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c450 tx=0x7fc29800c760 comp rx=0 tx=0).stop 2023-12-07T00:14:28.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 shutdown_connections 2023-12-07T00:14:28.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc28c06aed0 0x7fc28c06d390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc2a815ab70 0x7fc2a80b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc2a80ce770 0x7fc2a80b4f40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 --2- 172.21.15.179:0/1150602576 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2a80d0ed0 0x7fc2a80b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 >> 172.21.15.179:0/1150602576 conn(0x7fc2a8099a40 msgr2=0x7fc2a806af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:28.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 shutdown_connections 2023-12-07T00:14:28.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.629+0000 7fc2afc47700 1 -- 172.21.15.179:0/1150602576 wait complete. 2023-12-07T00:14:28.641 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T00:14:28.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.763+0000 7f8d0f439700 1 Processor -- start 2023-12-07T00:14:28.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.764+0000 7f8d0f439700 1 -- start start 2023-12-07T00:14:28.766 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.764+0000 7f8d0f439700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d08158560 0x7f8d080b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.766 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.764+0000 7f8d0f439700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8d0815b010 0x7f8d080b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.766 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.764+0000 7f8d0f439700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d080b2aa0 0x7f8d0806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.766 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.764+0000 7f8d0f439700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d080b2f10 con 0x7f8d08158560 2023-12-07T00:14:28.766 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.764+0000 7f8d0f439700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0815b8d0 con 0x7f8d0815b010 2023-12-07T00:14:28.766 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.764+0000 7f8d0f439700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0815bbb0 con 0x7f8d080b2aa0 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d08158560 0x7f8d080b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8d08158560 0x7f8d080b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39124/0 (socket says 172.21.15.179:39124) 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 -- 172.21.15.179:0/1786251267 learned_addr learned my addr 172.21.15.179:0/1786251267 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d9d6700 1 --2- 172.21.15.179:0/1786251267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d080b2aa0 0x7f8d0806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0c9d4700 1 --2- 172.21.15.179:0/1786251267 >> v2:172.21.15.190:3300/0 conn(0x7f8d0815b010 0x7f8d080b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 -- 172.21.15.179:0/1786251267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d080b2aa0 msgr2=0x7f8d0806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 --2- 172.21.15.179:0/1786251267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d080b2aa0 0x7f8d0806e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 -- 172.21.15.179:0/1786251267 >> v2:172.21.15.190:3300/0 conn(0x7f8d0815b010 msgr2=0x7f8d080b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 --2- 172.21.15.179:0/1786251267 >> v2:172.21.15.190:3300/0 conn(0x7f8d0815b010 0x7f8d080b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 -- 172.21.15.179:0/1786251267 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0815be90 con 0x7f8d08158560 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8d0d1d5700 1 --2- 172.21.15.179:0/1786251267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08158560 0x7f8d080b4470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d080b49b0 tx=0x7f8cf8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8df7757aae1d3d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8cfffff700 1 -- 172.21.15.179:0/1786251267 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800b870 con 0x7f8d08158560 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8cfffff700 1 -- 172.21.15.179:0/1786251267 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf800b9d0 con 0x7f8d08158560 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.765+0000 7f8cfffff700 1 -- 172.21.15.179:0/1786251267 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800bd60 con 0x7f8d08158560 2023-12-07T00:14:28.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 -- 172.21.15.179:0/1786251267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08158560 msgr2=0x7f8d080b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1786251267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08158560 0x7f8d080b4470 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d080b49b0 tx=0x7f8cf8009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 -- 172.21.15.179:0/1786251267 shutdown_connections 2023-12-07T00:14:28.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1786251267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d080b2aa0 0x7f8d0806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1786251267 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d08158560 0x7f8d080b4470 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1786251267 >> v2:172.21.15.190:3300/0 conn(0x7f8d0815b010 0x7f8d080b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 -- 172.21.15.179:0/1786251267 >> 172.21.15.179:0/1786251267 conn(0x7f8d08072970 msgr2=0x7f8d08072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:28.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 -- 172.21.15.179:0/1786251267 shutdown_connections 2023-12-07T00:14:28.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.766+0000 7f8d0f439700 1 -- 172.21.15.179:0/1786251267 wait complete. 2023-12-07T00:14:28.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.767+0000 7f8d0f439700 1 Processor -- start 2023-12-07T00:14:28.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.767+0000 7f8d0f439700 1 -- start start 2023-12-07T00:14:28.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0f439700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d080b2aa0 0x7f8d080c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0f439700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d08158560 0x7f8d080c5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0f439700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d0815b010 0x7f8d080cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0f439700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081eee80 con 0x7f8d080b2aa0 2023-12-07T00:14:28.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0f439700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081f2970 con 0x7f8d0815b010 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0f439700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d081f2c50 con 0x7f8d08158560 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d080b2aa0 0x7f8d080c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d080b2aa0 0x7f8d080c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39130/0 (socket says 172.21.15.179:39130) 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 -- 172.21.15.179:0/1265274591 learned_addr learned my addr 172.21.15.179:0/1265274591 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0c9d4700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d08158560 0x7f8d080c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d9d6700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d0815b010 0x7f8d080cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 -- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d08158560 msgr2=0x7f8d080c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d08158560 0x7f8d080c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 -- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d0815b010 msgr2=0x7f8d080cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d0815b010 0x7f8d080cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 -- 172.21.15.179:0/1265274591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf8009550 con 0x7f8d080b2aa0 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0c9d4700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d08158560 0x7f8d080c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d9d6700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d0815b010 0x7f8d080cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:28.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8d0d1d5700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d080b2aa0 0x7f8d080c74c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8000c00 tx=0x7f8cf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.768+0000 7f8cfdffb700 1 -- 172.21.15.179:0/1265274591 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8004540 con 0x7f8d080b2aa0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.769+0000 7f8cfdffb700 1 -- 172.21.15.179:0/1265274591 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80036a0 con 0x7f8d080b2aa0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.769+0000 7f8cfdffb700 1 -- 172.21.15.179:0/1265274591 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8003a50 con 0x7f8d080b2aa0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.769+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d081f2f30 con 0x7f8d080b2aa0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.769+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d080c5d80 con 0x7f8d080b2aa0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.770+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0804f290 con 0x7f8d080b2aa0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.770+0000 7f8cfdffb700 1 -- 172.21.15.179:0/1265274591 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cf8021070 con 0x7f8d080b2aa0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.770+0000 7f8cfdffb700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8cec06aed0 0x7f8cec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.771+0000 7f8d0c9d4700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8cec06aed0 0x7f8cec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.771+0000 7f8cfdffb700 1 -- 172.21.15.179:0/1265274591 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8cf808af80 con 0x7f8d080b2aa0 2023-12-07T00:14:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.771+0000 7f8d0c9d4700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8cec06aed0 0x7f8cec06d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d080c7a00 tx=0x7f8d04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:28.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.775+0000 7f8cfdffb700 1 -- 172.21.15.179:0/1265274591 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cf80bde90 con 0x7f8d080b2aa0 2023-12-07T00:14:28.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.978+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8d081eefc0 con 0x7f8d080b2aa0 2023-12-07T00:14:28.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.978+0000 7f8cfdffb700 1 -- 172.21.15.179:0/1265274591 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8cf8029080 con 0x7f8d080b2aa0 2023-12-07T00:14:28.981 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8cec06aed0 msgr2=0x7f8cec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.981 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8cec06aed0 0x7f8cec06d390 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d080c7a00 tx=0x7f8d04008040 comp rx=0 tx=0).stop 2023-12-07T00:14:28.981 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d080b2aa0 msgr2=0x7f8d080c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d080b2aa0 0x7f8d080c74c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8000c00 tx=0x7f8cf8004750 comp rx=0 tx=0).stop 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 shutdown_connections 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8cec06aed0 0x7f8cec06d390 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d0815b010 0x7f8d080cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8d080b2aa0 0x7f8d080c74c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 --2- 172.21.15.179:0/1265274591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d08158560 0x7f8d080c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.980+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 >> 172.21.15.179:0/1265274591 conn(0x7f8d08072970 msgr2=0x7f8d0806bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.981+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 shutdown_connections 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:28.981+0000 7f8d0f439700 1 -- 172.21.15.179:0/1265274591 wait complete. 2023-12-07T00:14:28.982 INFO:teuthology.orchestra.run.smithi179.stderr:listed 0 entries 2023-12-07T00:14:28.993 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi179.front.sepia.ceph.com... 2023-12-07T00:14:28.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:28.993 DEBUG:teuthology.orchestra.run.smithi179:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-07T00:14:29.035 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi179.stderr:ceph-fuse[111095]: fuse finished with error 0 and tester_r 0 2023-12-07T00:14:29.036 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T00:14:29.048 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:14:29.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:29.048 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-07T00:14:29.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:29.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.270+0000 7f9cab1df700 1 Processor -- start 2023-12-07T00:14:29.270 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.270+0000 7f9cab1df700 1 -- start start 2023-12-07T00:14:29.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.270+0000 7f9cab1df700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9ca4158560 0x7f9ca40b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.270+0000 7f9cab1df700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca415b8d0 con 0x7f9ca40b2c70 2023-12-07T00:14:29.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.270+0000 7f9cab1df700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca415bbb0 con 0x7f9ca415b010 2023-12-07T00:14:29.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.270+0000 7f9cab1df700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca415be90 con 0x7f9ca4158560 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca977c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9ca40b2c70 0x7f9ca40cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46044/0 (socket says 172.21.15.179:46044) 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca977c700 1 -- 172.21.15.179:0/2435453250 learned_addr learned my addr 172.21.15.179:0/2435453250 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca8f7b700 1 --2- 172.21.15.179:0/2435453250 >> v2:172.21.15.190:3300/0 conn(0x7f9ca4158560 0x7f9ca40b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca37fe700 1 -- 172.21.15.179:0/2435453250 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808194409 0 0) 0x7f9ca415b8d0 con 0x7f9ca40b2c70 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca37fe700 1 -- 172.21.15.179:0/2435453250 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c940035b0 con 0x7f9ca40b2c70 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca8f7b700 1 -- 172.21.15.179:0/2435453250 >> v1:172.21.15.190:6789/0 conn(0x7f9ca415b010 legacy=0x7f9ca40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca8f7b700 1 -- 172.21.15.179:0/2435453250 >> v1:172.21.15.179:6789/0 conn(0x7f9ca40b2c70 legacy=0x7f9ca40cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca8f7b700 1 -- 172.21.15.179:0/2435453250 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca40ceec0 con 0x7f9ca4158560 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca8f7b700 1 --2- 172.21.15.179:0/2435453250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca4158560 0x7f9ca40b4470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009840 tx=0x7f9c98009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=334fc7afa83f3f29 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca37fe700 1 -- 172.21.15.179:0/2435453250 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98011830 con 0x7f9ca4158560 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca37fe700 1 -- 172.21.15.179:0/2435453250 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c98011990 con 0x7f9ca4158560 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.271+0000 7f9ca37fe700 1 -- 172.21.15.179:0/2435453250 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98011d20 con 0x7f9ca4158560 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.272+0000 7f9cab1df700 1 -- 172.21.15.179:0/2435453250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca4158560 msgr2=0x7f9ca40b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.272+0000 7f9cab1df700 1 --2- 172.21.15.179:0/2435453250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca4158560 0x7f9ca40b4470 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009840 tx=0x7f9c98009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:29.274 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.272+0000 7f9cab1df700 1 -- 172.21.15.179:0/2435453250 shutdown_connections 2023-12-07T00:14:29.274 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.272+0000 7f9cab1df700 1 --2- 172.21.15.179:0/2435453250 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca4158560 0x7f9ca40b4470 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.274 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.272+0000 7f9cab1df700 1 -- 172.21.15.179:0/2435453250 >> 172.21.15.179:0/2435453250 conn(0x7f9ca4072970 msgr2=0x7f9ca4072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:29.274 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.272+0000 7f9cab1df700 1 -- 172.21.15.179:0/2435453250 shutdown_connections 2023-12-07T00:14:29.274 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.272+0000 7f9cab1df700 1 -- 172.21.15.179:0/2435453250 wait complete. 2023-12-07T00:14:29.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.273+0000 7f9cab1df700 1 Processor -- start 2023-12-07T00:14:29.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.273+0000 7f9cab1df700 1 -- start start 2023-12-07T00:14:29.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.274+0000 7f9cab1df700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca40b2c70 0x7f9ca414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.274+0000 7f9cab1df700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ca4158560 0x7f9ca41508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.274+0000 7f9cab1df700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ca415b010 0x7f9ca4150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.274+0000 7f9cab1df700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca41f45f0 con 0x7f9ca4158560 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9cab1df700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca41f3970 con 0x7f9ca40b2c70 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9cab1df700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca41f3c50 con 0x7f9ca415b010 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ca4158560 0x7f9ca41508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ca4158560 0x7f9ca41508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39146/0 (socket says 172.21.15.179:39146) 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 -- 172.21.15.179:0/169041972 learned_addr learned my addr 172.21.15.179:0/169041972 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca8f7b700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca40b2c70 0x7f9ca414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca977c700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ca415b010 0x7f9ca4150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 -- 172.21.15.179:0/169041972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ca415b010 msgr2=0x7f9ca4150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ca415b010 0x7f9ca4150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 -- 172.21.15.179:0/169041972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca40b2c70 msgr2=0x7f9ca414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca40b2c70 0x7f9ca414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.277 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 -- 172.21.15.179:0/169041972 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980094a0 con 0x7f9ca4158560 2023-12-07T00:14:29.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca3fff700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ca4158560 0x7f9ca41508a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c4d0 tx=0x7f9c9000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca17fa700 1 -- 172.21.15.179:0/169041972 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900052d0 con 0x7f9ca4158560 2023-12-07T00:14:29.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca17fa700 1 -- 172.21.15.179:0/169041972 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90005430 con 0x7f9ca4158560 2023-12-07T00:14:29.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9ca17fa700 1 -- 172.21.15.179:0/169041972 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900038f0 con 0x7f9ca4158560 2023-12-07T00:14:29.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca41f3f30 con 0x7f9ca4158560 2023-12-07T00:14:29.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.275+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca414daf0 con 0x7f9ca4158560 2023-12-07T00:14:29.278 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.276+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca404f290 con 0x7f9ca4158560 2023-12-07T00:14:29.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.277+0000 7f9ca17fa700 1 -- 172.21.15.179:0/169041972 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c90003a50 con 0x7f9ca4158560 2023-12-07T00:14:29.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.277+0000 7f9ca17fa700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9c8806aed0 0x7f9c8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.277+0000 7f9ca17fa700 1 -- 172.21.15.179:0/169041972 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c90088b60 con 0x7f9ca4158560 2023-12-07T00:14:29.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.277+0000 7f9ca8f7b700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9c8806aed0 0x7f9c8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.278+0000 7f9ca8f7b700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9c8806aed0 0x7f9c8806d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c980090b0 tx=0x7f9c98008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.282+0000 7f9ca17fa700 1 -- 172.21.15.179:0/169041972 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c900539b0 con 0x7f9ca4158560 2023-12-07T00:14:29.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.475+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ca414dc80 con 0x7f9ca4158560 2023-12-07T00:14:29.476 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.476+0000 7f9ca17fa700 1 -- 172.21.15.179:0/169041972 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f9c90017090 con 0x7f9ca4158560 2023-12-07T00:14:29.476 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:29.476 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9c8806aed0 msgr2=0x7f9c8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9c8806aed0 0x7f9c8806d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c980090b0 tx=0x7f9c98008030 comp rx=0 tx=0).stop 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ca4158560 msgr2=0x7f9ca41508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ca4158560 0x7f9ca41508a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c4d0 tx=0x7f9c9000c7e0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 shutdown_connections 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9c8806aed0 0x7f9c8806d390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9ca415b010 0x7f9ca4150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9ca40b2c70 0x7f9ca414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 --2- 172.21.15.179:0/169041972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ca4158560 0x7f9ca41508a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 >> 172.21.15.179:0/169041972 conn(0x7f9ca4072970 msgr2=0x7f9ca40cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:29.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 shutdown_connections 2023-12-07T00:14:29.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.478+0000 7f9cab1df700 1 -- 172.21.15.179:0/169041972 wait complete. 2023-12-07T00:14:29.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:29.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.611+0000 7f2b1efe0700 1 Processor -- start 2023-12-07T00:14:29.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.611+0000 7f2b1efe0700 1 -- start start 2023-12-07T00:14:29.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b1efe0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2b180b0430 0x7f2b180b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b1efe0700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1806c920 con 0x7f2b1815db80 2023-12-07T00:14:29.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b1efe0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b180b0dd0 con 0x7f2b180ae150 2023-12-07T00:14:29.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b1efe0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b180b1910 con 0x7f2b180b0430 2023-12-07T00:14:29.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b1cd7c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2b1815db80 0x7f2b1806b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46054/0 (socket says 172.21.15.179:46054) 2023-12-07T00:14:29.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b1cd7c700 1 -- 172.21.15.179:0/3149160758 learned_addr learned my addr 172.21.15.179:0/3149160758 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:29.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b17fff700 1 --2- 172.21.15.179:0/3149160758 >> v2:172.21.15.190:3300/0 conn(0x7f2b180b0430 0x7f2b180b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046741854 0 0) 0x7f2b1806c920 con 0x7f2b1815db80 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b080035b0 con 0x7f2b1815db80 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1010827215 0 0) 0x7f2b080035b0 con 0x7f2b1815db80 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 >> v2:172.21.15.190:3300/0 conn(0x7f2b180b0430 msgr2=0x7f2b180b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 --2- 172.21.15.179:0/3149160758 >> v2:172.21.15.190:3300/0 conn(0x7f2b180b0430 0x7f2b180b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 >> v1:172.21.15.190:6789/0 conn(0x7f2b180ae150 legacy=0x7f2b180ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1815df60 con 0x7f2b1815db80 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f2b0c001670 con 0x7f2b1815db80 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 >> v1:172.21.15.179:6789/0 conn(0x7f2b1815db80 legacy=0x7f2b1806b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.612+0000 7f2b177fe700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08003a00 0x7f2b08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b177fe700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b08004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b177fe700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b08005210 0x7f2b0800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180b1910 con 0x7f2b08004850 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0800c1b0 con 0x7f2b08003a00 2023-12-07T00:14:29.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0800c370 con 0x7f2b08005210 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b17fff700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b08004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b1cd7c700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08003a00 0x7f2b08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b1d57d700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b08005210 0x7f2b0800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b17fff700 1 -- 172.21.15.179:0/3149160758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b08005210 msgr2=0x7f2b0800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b17fff700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b08005210 0x7f2b0800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b17fff700 1 -- 172.21.15.179:0/3149160758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08003a00 msgr2=0x7f2b08003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b17fff700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08003a00 0x7f2b08003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b17fff700 1 -- 172.21.15.179:0/3149160758 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080035b0 con 0x7f2b08004850 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b1d57d700 1 -- 172.21.15.179:0/3149160758 reap_dead start 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b17fff700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b08004cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b040096f0 tx=0x7f2b08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e57e84c414ab994 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04013730 con 0x7f2b08004850 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b04013890 con 0x7f2b08004850 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.613+0000 7f2b177fe700 1 -- 172.21.15.179:0/3149160758 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04013c20 con 0x7f2b08004850 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.614+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3149160758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 msgr2=0x7f2b08004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.614+0000 7f2b1efe0700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b08004cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2b040096f0 tx=0x7f2b08005880 comp rx=0 tx=0).stop 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.614+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3149160758 shutdown_connections 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.614+0000 7f2b1efe0700 1 --2- 172.21.15.179:0/3149160758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b08004cd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.614+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3149160758 >> 172.21.15.179:0/3149160758 conn(0x7f2b18072660 msgr2=0x7f2b180b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.614+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3149160758 shutdown_connections 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.614+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3149160758 wait complete. 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.615+0000 7f2b1efe0700 1 Processor -- start 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.615+0000 7f2b1efe0700 1 -- start start 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1efe0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b1813b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1efe0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b1809dc90 0x7f2b1813cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1efe0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b1814f500 0x7f2b1814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1efe0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1813cb70 con 0x7f2b08004850 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1efe0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1813bd00 con 0x7f2b1809dc90 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1efe0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1813bef0 con 0x7f2b1814f500 2023-12-07T00:14:29.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b1813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b1813b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39164/0 (socket says 172.21.15.179:39164) 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 -- 172.21.15.179:0/3991023699 learned_addr learned my addr 172.21.15.179:0/3991023699 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b17fff700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b1809dc90 0x7f2b1813cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1d57d700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b1814f500 0x7f2b1814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 -- 172.21.15.179:0/3991023699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b1814f500 msgr2=0x7f2b1814f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b1814f500 0x7f2b1814f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 -- 172.21.15.179:0/3991023699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b1809dc90 msgr2=0x7f2b1813cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b1809dc90 0x7f2b1813cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 -- 172.21.15.179:0/3991023699 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1813c1d0 con 0x7f2b08004850 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.616+0000 7f2b1cd7c700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b1813b7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0072c0 tx=0x7f2b0c0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.617+0000 7f2b157fa700 1 -- 172.21.15.179:0/3991023699 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c0077b0 con 0x7f2b08004850 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.617+0000 7f2b157fa700 1 -- 172.21.15.179:0/3991023699 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00f850 con 0x7f2b08004850 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.617+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1813c4b0 con 0x7f2b08004850 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.617+0000 7f2b157fa700 1 -- 172.21.15.179:0/3991023699 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00fc00 con 0x7f2b08004850 2023-12-07T00:14:29.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.617+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1809e110 con 0x7f2b08004850 2023-12-07T00:14:29.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.617+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b180b14d0 con 0x7f2b08004850 2023-12-07T00:14:29.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.618+0000 7f2b157fa700 1 -- 172.21.15.179:0/3991023699 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b0c00fd60 con 0x7f2b08004850 2023-12-07T00:14:29.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.618+0000 7f2b157fa700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2afc06aed0 0x7f2afc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.618+0000 7f2b157fa700 1 -- 172.21.15.179:0/3991023699 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b0c089740 con 0x7f2b08004850 2023-12-07T00:14:29.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.618+0000 7f2b17fff700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2afc06aed0 0x7f2afc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.619+0000 7f2b17fff700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2afc06aed0 0x7f2afc06d390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400a010 tx=0x7f2b0401e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.623+0000 7f2b157fa700 1 -- 172.21.15.179:0/3991023699 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b0c054470 con 0x7f2b08004850 2023-12-07T00:14:29.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.816+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b1815df60 con 0x7f2b08004850 2023-12-07T00:14:29.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.817+0000 7f2b157fa700 1 -- 172.21.15.179:0/3991023699 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f2b1815df60 con 0x7f2b08004850 2023-12-07T00:14:29.818 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:29.818 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:29.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2afc06aed0 msgr2=0x7f2afc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2afc06aed0 0x7f2afc06d390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400a010 tx=0x7f2b0401e040 comp rx=0 tx=0).stop 2023-12-07T00:14:29.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 msgr2=0x7f2b1813b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b1813b7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c0072c0 tx=0x7f2b0c0075d0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 shutdown_connections 2023-12-07T00:14:29.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2afc06aed0 0x7f2afc06d390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b1814f500 0x7f2b1814f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b08004850 0x7f2b1813b7c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 --2- 172.21.15.179:0/3991023699 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b1809dc90 0x7f2b1813cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 >> 172.21.15.179:0/3991023699 conn(0x7f2b18072660 msgr2=0x7f2b180ae560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:29.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 shutdown_connections 2023-12-07T00:14:29.821 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.820+0000 7f2b1efe0700 1 -- 172.21.15.179:0/3991023699 wait complete. 2023-12-07T00:14:29.833 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-07T00:14:29.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.955+0000 7f11bb6c8700 1 Processor -- start 2023-12-07T00:14:29.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.955+0000 7f11bb6c8700 1 -- start start 2023-12-07T00:14:29.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11bb6c8700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11b406b680 0x7f11b4168ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11bb6c8700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b40cd1c0 con 0x7f11b415de50 2023-12-07T00:14:29.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11bb6c8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b40cd4a0 con 0x7f11b40ccc90 2023-12-07T00:14:29.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11bb6c8700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b40cd780 con 0x7f11b406b680 2023-12-07T00:14:29.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11b9c65700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11b406b680 0x7f11b4168ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11b9464700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f11b415de50 0x7f11b40cc010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46074/0 (socket says 172.21.15.179:46074) 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11b9464700 1 -- 172.21.15.179:0/2049860570 learned_addr learned my addr 172.21.15.179:0/2049860570 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11b9c65700 1 -- 172.21.15.179:0/2049860570 >> v1:172.21.15.190:6789/0 conn(0x7f11b40ccc90 legacy=0x7f11b406af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11b9c65700 1 -- 172.21.15.179:0/2049860570 >> v1:172.21.15.179:6789/0 conn(0x7f11b415de50 legacy=0x7f11b40cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11abfff700 1 -- 172.21.15.179:0/2049860570 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293876402 0 0) 0x7f11b40cd1c0 con 0x7f11b415de50 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11b9c65700 1 -- 172.21.15.179:0/2049860570 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40cda60 con 0x7f11b406b680 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11b9c65700 1 --2- 172.21.15.179:0/2049860570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b406b680 0x7f11b4168ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009d90 tx=0x7f11ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dea07aa8793292e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11abfff700 1 -- 172.21.15.179:0/2049860570 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00e070 con 0x7f11b406b680 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.956+0000 7f11abfff700 1 -- 172.21.15.179:0/2049860570 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00bbd0 con 0x7f11b406b680 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.957+0000 7f11abfff700 1 -- 172.21.15.179:0/2049860570 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac012430 con 0x7f11b406b680 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.957+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2049860570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b406b680 msgr2=0x7f11b4168ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.957+0000 7f11bb6c8700 1 --2- 172.21.15.179:0/2049860570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b406b680 0x7f11b4168ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f11ac009d90 tx=0x7f11ac00b330 comp rx=0 tx=0).stop 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.957+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2049860570 shutdown_connections 2023-12-07T00:14:29.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.957+0000 7f11bb6c8700 1 --2- 172.21.15.179:0/2049860570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b406b680 0x7f11b4168ce0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.957+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2049860570 >> 172.21.15.179:0/2049860570 conn(0x7f11b4099a40 msgr2=0x7f11b4099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:29.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.957+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2049860570 shutdown_connections 2023-12-07T00:14:29.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.957+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2049860570 wait complete. 2023-12-07T00:14:29.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.958+0000 7f11bb6c8700 1 Processor -- start 2023-12-07T00:14:29.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.958+0000 7f11bb6c8700 1 -- start start 2023-12-07T00:14:29.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11bb6c8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11b406b680 0x7f11b40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11bb6c8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11b40ccc90 0x7f11b40c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11bb6c8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b415de50 0x7f11b414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11bb6c8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b415ab60 con 0x7f11b415de50 2023-12-07T00:14:29.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11bb6c8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b414f5f0 con 0x7f11b40ccc90 2023-12-07T00:14:29.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11bb6c8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b40af530 con 0x7f11b406b680 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9c65700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b415de50 0x7f11b414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9c65700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b415de50 0x7f11b414f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39182/0 (socket says 172.21.15.179:39182) 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9c65700 1 -- 172.21.15.179:0/2395871562 learned_addr learned my addr 172.21.15.179:0/2395871562 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9464700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11b406b680 0x7f11b40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b8c63700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11b40ccc90 0x7f11b40c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9c65700 1 -- 172.21.15.179:0/2395871562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11b406b680 msgr2=0x7f11b40ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9c65700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11b406b680 0x7f11b40ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9c65700 1 -- 172.21.15.179:0/2395871562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11b40ccc90 msgr2=0x7f11b40c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9c65700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11b40ccc90 0x7f11b40c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.959+0000 7f11b9c65700 1 -- 172.21.15.179:0/2395871562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac009a70 con 0x7f11b415de50 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.960+0000 7f11b9c65700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b415de50 0x7f11b414f0b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11ac014040 tx=0x7f11ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.960+0000 7f11a9ffb700 1 -- 172.21.15.179:0/2395871562 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac01b810 con 0x7f11b415de50 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.960+0000 7f11a9ffb700 1 -- 172.21.15.179:0/2395871562 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac020070 con 0x7f11b415de50 2023-12-07T00:14:29.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.960+0000 7f11a9ffb700 1 -- 172.21.15.179:0/2395871562 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac01bbb0 con 0x7f11b415de50 2023-12-07T00:14:29.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.960+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b40aec90 con 0x7f11b415de50 2023-12-07T00:14:29.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.960+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b40af250 con 0x7f11b415de50 2023-12-07T00:14:29.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.961+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b415ad10 con 0x7f11b415de50 2023-12-07T00:14:29.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.961+0000 7f11a9ffb700 1 -- 172.21.15.179:0/2395871562 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11ac01bd10 con 0x7f11b415de50 2023-12-07T00:14:29.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.962+0000 7f11a9ffb700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119806aed0 0x7f119806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:29.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.962+0000 7f11a9ffb700 1 -- 172.21.15.179:0/2395871562 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f11ac022070 con 0x7f11b415de50 2023-12-07T00:14:29.963 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.962+0000 7f11b9464700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119806aed0 0x7f119806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:29.964 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.962+0000 7f11b9464700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119806aed0 0x7f119806d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11b0007c40 tx=0x7f11b0007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:29.966 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:29.967+0000 7f11a9ffb700 1 -- 172.21.15.179:0/2395871562 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11b415ad10 con 0x7f11b415de50 2023-12-07T00:14:30.199 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.199+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f11b40685f0 con 0x7f11b415de50 2023-12-07T00:14:30.718 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.718+0000 7f11a9ffb700 1 -- 172.21.15.179:0/2395871562 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f11ac0566e0 con 0x7f11b415de50 2023-12-07T00:14:30.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119806aed0 msgr2=0x7f119806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:30.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119806aed0 0x7f119806d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f11b0007c40 tx=0x7f11b0007b90 comp rx=0 tx=0).stop 2023-12-07T00:14:30.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b415de50 msgr2=0x7f11b414f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:30.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b415de50 0x7f11b414f0b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11ac014040 tx=0x7f11ac004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:30.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 shutdown_connections 2023-12-07T00:14:30.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119806aed0 0x7f119806d390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:30.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11b415de50 0x7f11b414f0b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:30.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11b406b680 0x7f11b40ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:30.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 --2- 172.21.15.179:0/2395871562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11b40ccc90 0x7f11b40c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:30.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 >> 172.21.15.179:0/2395871562 conn(0x7f11b4099a40 msgr2=0x7f11b40b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:30.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 shutdown_connections 2023-12-07T00:14:30.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.721+0000 7f11bb6c8700 1 -- 172.21.15.179:0/2395871562 wait complete. 2023-12-07T00:14:30.733 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-07T00:14:30.733 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-07T00:14:30.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f38606cc700 1 Processor -- start 2023-12-07T00:14:30.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f38606cc700 1 -- start start 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f38606cc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f38580ce770 0x7f3858070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f38606cc700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385806f960 con 0x7f38580d0ed0 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f38606cc700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38580cf110 con 0x7f385815ab70 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f38606cc700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385815af50 con 0x7f38580ce770 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385ec69700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f38580d0ed0 0x7f38580adb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46094/0 (socket says 172.21.15.179:46094) 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385ec69700 1 -- 172.21.15.179:0/1617719907 learned_addr learned my addr 172.21.15.179:0/1617719907 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385dc67700 1 --2- 172.21.15.179:0/1617719907 >> v2:172.21.15.190:3300/0 conn(0x7f38580ce770 0x7f3858070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385d466700 1 -- 172.21.15.179:0/1617719907 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925937395 0 0) 0x7f385806f960 con 0x7f38580d0ed0 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385d466700 1 -- 172.21.15.179:0/1617719907 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38440035b0 con 0x7f38580d0ed0 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385d466700 1 -- 172.21.15.179:0/1617719907 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283049011 0 0) 0x7f38440035b0 con 0x7f38580d0ed0 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385dc67700 1 -- 172.21.15.179:0/1617719907 >> v1:172.21.15.190:6789/0 conn(0x7f385815ab70 legacy=0x7f38580d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385dc67700 1 -- 172.21.15.179:0/1617719907 >> v1:172.21.15.179:6789/0 conn(0x7f38580d0ed0 legacy=0x7f38580adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:30.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385dc67700 1 -- 172.21.15.179:0/1617719907 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38580cf3f0 con 0x7f38580ce770 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.858+0000 7f385dc67700 1 --2- 172.21.15.179:0/1617719907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38580ce770 0x7f3858070880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3848009840 tx=0x7f3848009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63adece5508157af server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f385d466700 1 -- 172.21.15.179:0/1617719907 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38500019f0 con 0x7f38580ce770 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f385d466700 1 -- 172.21.15.179:0/1617719907 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848004030 con 0x7f38580ce770 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f385d466700 1 -- 172.21.15.179:0/1617719907 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480043a0 con 0x7f38580ce770 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f38606cc700 1 -- 172.21.15.179:0/1617719907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38580ce770 msgr2=0x7f3858070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f38606cc700 1 --2- 172.21.15.179:0/1617719907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38580ce770 0x7f3858070880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3848009840 tx=0x7f3848009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f38606cc700 1 -- 172.21.15.179:0/1617719907 shutdown_connections 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f38606cc700 1 --2- 172.21.15.179:0/1617719907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f38580ce770 0x7f3858070880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f38606cc700 1 -- 172.21.15.179:0/1617719907 >> 172.21.15.179:0/1617719907 conn(0x7f3858099a40 msgr2=0x7f3858099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f38606cc700 1 -- 172.21.15.179:0/1617719907 shutdown_connections 2023-12-07T00:14:30.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.859+0000 7f38606cc700 1 -- 172.21.15.179:0/1617719907 wait complete. 2023-12-07T00:14:30.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.860+0000 7f38606cc700 1 Processor -- start 2023-12-07T00:14:30.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.860+0000 7f38606cc700 1 -- start start 2023-12-07T00:14:30.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f38606cc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38580ce770 0x7f38580c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:30.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f38606cc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580d0ed0 0x7f38580c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:30.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f38606cc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f385815ab70 0x7f38580c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f38606cc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385806fc40 con 0x7f38580d0ed0 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f38606cc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38580cc220 con 0x7f385815ab70 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f38606cc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38580cb300 con 0x7f38580ce770 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385dc67700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580d0ed0 0x7f38580c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385dc67700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580d0ed0 0x7f38580c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39196/0 (socket says 172.21.15.179:39196) 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385dc67700 1 -- 172.21.15.179:0/2792415926 learned_addr learned my addr 172.21.15.179:0/2792415926 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385ec69700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f385815ab70 0x7f38580c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385e468700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38580ce770 0x7f38580c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385dc67700 1 -- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38580ce770 msgr2=0x7f38580c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385dc67700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38580ce770 0x7f38580c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385dc67700 1 -- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f385815ab70 msgr2=0x7f38580c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385dc67700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f385815ab70 0x7f38580c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385dc67700 1 -- 172.21.15.179:0/2792415926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38480094a0 con 0x7f38580d0ed0 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385ec69700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f385815ab70 0x7f38580c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:30.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.861+0000 7f385e468700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38580ce770 0x7f38580c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.862+0000 7f385dc67700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580d0ed0 0x7f38580c6a80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3848009b90 tx=0x7f3848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.862+0000 7f384effd700 1 -- 172.21.15.179:0/2792415926 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848003e80 con 0x7f38580d0ed0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.862+0000 7f384effd700 1 -- 172.21.15.179:0/2792415926 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848010590 con 0x7f38580d0ed0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.862+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580cb5a0 con 0x7f38580d0ed0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.862+0000 7f384effd700 1 -- 172.21.15.179:0/2792415926 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848010920 con 0x7f38580d0ed0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.862+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38580cbb60 con 0x7f38580d0ed0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.863+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385806f560 con 0x7f38580d0ed0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.863+0000 7f384effd700 1 -- 172.21.15.179:0/2792415926 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3848010a80 con 0x7f38580d0ed0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.863+0000 7f384effd700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f383c06aed0 0x7f383c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.864+0000 7f384effd700 1 -- 172.21.15.179:0/2792415926 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f384808b0f0 con 0x7f38580d0ed0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.864+0000 7f385e468700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f383c06aed0 0x7f383c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:30.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.864+0000 7f385e468700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f383c06aed0 0x7f383c06d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3854000f60 tx=0x7f3854009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:30.868 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:30.868+0000 7f384effd700 1 -- 172.21.15.179:0/2792415926 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3848055f40 con 0x7f38580d0ed0 2023-12-07T00:14:31.104 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.105+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f38580685f0 con 0x7f38580d0ed0 2023-12-07T00:14:31.720 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.720+0000 7f384effd700 1 -- 172.21.15.179:0/2792415926 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3848059560 con 0x7f38580d0ed0 2023-12-07T00:14:31.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f383c06aed0 msgr2=0x7f383c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:31.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f383c06aed0 0x7f383c06d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3854000f60 tx=0x7f3854009040 comp rx=0 tx=0).stop 2023-12-07T00:14:31.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580d0ed0 msgr2=0x7f38580c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:31.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580d0ed0 0x7f38580c6a80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3848009b90 tx=0x7f3848004750 comp rx=0 tx=0).stop 2023-12-07T00:14:31.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 shutdown_connections 2023-12-07T00:14:31.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f383c06aed0 0x7f383c06d390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f385815ab70 0x7f38580c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f38580ce770 0x7f38580c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 --2- 172.21.15.179:0/2792415926 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38580d0ed0 0x7f38580c6a80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 >> 172.21.15.179:0/2792415926 conn(0x7f3858099a40 msgr2=0x7f38580b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:31.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 shutdown_connections 2023-12-07T00:14:31.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.723+0000 7f38606cc700 1 -- 172.21.15.179:0/2792415926 wait complete. 2023-12-07T00:14:31.735 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-07T00:14:31.735 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:14:31.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.856+0000 7f9bf16fa700 1 Processor -- start 2023-12-07T00:14:31.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.856+0000 7f9bf16fa700 1 -- start start 2023-12-07T00:14:31.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.857+0000 7f9bf16fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bec15bf40 0x7f9bec0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:31.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.857+0000 7f9bf16fa700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec0b1720 con 0x7f9bec099b20 2023-12-07T00:14:31.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.857+0000 7f9bf16fa700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec06c670 con 0x7f9bec0af250 2023-12-07T00:14:31.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.857+0000 7f9bf16fa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0673f0 con 0x7f9bec15bf40 2023-12-07T00:14:31.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.857+0000 7f9bea7fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9bec099b20 0x7f9bec066ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46104/0 (socket says 172.21.15.179:46104) 2023-12-07T00:14:31.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.857+0000 7f9bea7fc700 1 -- 172.21.15.179:0/3532745438 learned_addr learned my addr 172.21.15.179:0/3532745438 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:31.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.857+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354738146 0 0) 0x7f9bec0b1720 con 0x7f9bec099b20 2023-12-07T00:14:31.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9beaffd700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bec15bf40 0x7f9bec0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd40035b0 con 0x7f9bec099b20 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986889920 0 0) 0x7f9bd40035b0 con 0x7f9bec099b20 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bec15bf40 msgr2=0x7f9bec0cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bec15bf40 0x7f9bec0cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 >> v1:172.21.15.190:6789/0 conn(0x7f9bec0af250 legacy=0x7f9bec0d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec06c0b0 con 0x7f9bec099b20 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f9bdc001670 con 0x7f9bec099b20 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 >> v1:172.21.15.179:6789/0 conn(0x7f9bec099b20 legacy=0x7f9bec066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bec15bf40 0x7f9bd4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bd4003f70 0x7f9bd4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd4004d90 0x7f9bd4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0673f0 con 0x7f9bd4003f70 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd400bb20 con 0x7f9bd4004d90 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd400bce0 con 0x7f9bec15bf40 2023-12-07T00:14:31.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9bea7fc700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bd4003f70 0x7f9bd4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9beaffd700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bec15bf40 0x7f9bd4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9beb7fe700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd4004d90 0x7f9bd4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9bea7fc700 1 -- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bec15bf40 msgr2=0x7f9bd4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9bea7fc700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bec15bf40 0x7f9bd4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9bea7fc700 1 -- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd4004d90 msgr2=0x7f9bd4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9bea7fc700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bd4004d90 0x7f9bd4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9bea7fc700 1 -- 172.21.15.179:0/3532745438 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd40035b0 con 0x7f9bd4003f70 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.858+0000 7f9bea7fc700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bd4003f70 0x7f9bd4004850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c2f0 tx=0x7f9bd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b647ccd76f0135 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00ce30 con 0x7f9bd4003f70 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc005960 con 0x7f9bd4003f70 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9be9ffb700 1 -- 172.21.15.179:0/3532745438 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc005d10 con 0x7f9bd4003f70 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9bf16fa700 1 -- 172.21.15.179:0/3532745438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bd4003f70 msgr2=0x7f9bd4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9bf16fa700 1 --2- 172.21.15.179:0/3532745438 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bd4003f70 0x7f9bd4004850 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00c2f0 tx=0x7f9bd4005880 comp rx=0 tx=0).stop 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9beb7fe700 1 -- 172.21.15.179:0/3532745438 reap_dead start 2023-12-07T00:14:31.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9bf16fa700 1 -- 172.21.15.179:0/3532745438 shutdown_connections 2023-12-07T00:14:31.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9bf16fa700 1 -- 172.21.15.179:0/3532745438 >> 172.21.15.179:0/3532745438 conn(0x7f9bec072660 msgr2=0x7f9bec0b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:31.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9bf16fa700 1 -- 172.21.15.179:0/3532745438 shutdown_connections 2023-12-07T00:14:31.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.859+0000 7f9bf16fa700 1 -- 172.21.15.179:0/3532745438 wait complete. 2023-12-07T00:14:31.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.861+0000 7f9bf16fa700 1 Processor -- start 2023-12-07T00:14:31.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.861+0000 7f9bf16fa700 1 -- start start 2023-12-07T00:14:31.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9bf16fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4003f70 0x7f9bec13e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:31.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9bf16fa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bec0ce790 0x7f9bec152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:31.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9bf16fa700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0cec10 0x7f9bec152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:31.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9bf16fa700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec15f520 con 0x7f9bec0cec10 2023-12-07T00:14:31.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9bf16fa700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0cd6f0 con 0x7f9bec0ce790 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9bf16fa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0cd9d0 con 0x7f9bd4003f70 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0cec10 0x7f9bec152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0cec10 0x7f9bec152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39214/0 (socket says 172.21.15.179:39214) 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 -- 172.21.15.179:0/1338449529 learned_addr learned my addr 172.21.15.179:0/1338449529 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9bea7fc700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bec0ce790 0x7f9bec152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beaffd700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4003f70 0x7f9bec13e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 -- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4003f70 msgr2=0x7f9bec13e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4003f70 0x7f9bec13e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 -- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bec0ce790 msgr2=0x7f9bec152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bec0ce790 0x7f9bec152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 -- 172.21.15.179:0/1338449529 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0cdcb0 con 0x7f9bec0cec10 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9bea7fc700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bec0ce790 0x7f9bec152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:31.866 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.862+0000 7f9beb7fe700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0cec10 0x7f9bec152f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0714f0 tx=0x7f9be400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.863+0000 7f9bd37fe700 1 -- 172.21.15.179:0/1338449529 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4003c10 con 0x7f9bec0cec10 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.863+0000 7f9bd37fe700 1 -- 172.21.15.179:0/1338449529 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be4003d90 con 0x7f9bec0cec10 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.863+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec0cdf90 con 0x7f9bec0cec10 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.863+0000 7f9bd37fe700 1 -- 172.21.15.179:0/1338449529 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400dbd0 con 0x7f9bec0cec10 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.863+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec13e730 con 0x7f9bec0cec10 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.864+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec0ce5e0 con 0x7f9bec0cec10 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.864+0000 7f9bd37fe700 1 -- 172.21.15.179:0/1338449529 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9be400dd30 con 0x7f9bec0cec10 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.864+0000 7f9bd37fe700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9bd806aed0 0x7f9bd806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.865+0000 7f9bd37fe700 1 -- 172.21.15.179:0/1338449529 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9be4089b50 con 0x7f9bec0cec10 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.865+0000 7f9beaffd700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9bd806aed0 0x7f9bd806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:31.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.865+0000 7f9beaffd700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9bd806aed0 0x7f9bd806d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009c60 tx=0x7f9be0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:31.868 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:31.869+0000 7f9bd37fe700 1 -- 172.21.15.179:0/1338449529 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9be40549a0 con 0x7f9bec0cec10 2023-12-07T00:14:32.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.100+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bec0685f0 con 0x7f9bec0cec10 2023-12-07T00:14:32.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.100+0000 7f9bd37fe700 1 -- 172.21.15.179:0/1338449529 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f9be4057fc0 con 0x7f9bec0cec10 2023-12-07T00:14:32.099 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:32.099 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:31.106814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T00:14:32.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9bd806aed0 msgr2=0x7f9bd806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9bd806aed0 0x7f9bd806d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9be0009c60 tx=0x7f9be0009210 comp rx=0 tx=0).stop 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0cec10 msgr2=0x7f9bec152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0cec10 0x7f9bec152f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0714f0 tx=0x7f9be400d430 comp rx=0 tx=0).stop 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 shutdown_connections 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9bd806aed0 0x7f9bd806d390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bec0cec10 0x7f9bec152f50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9bd4003f70 0x7f9bec13e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 --2- 172.21.15.179:0/1338449529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9bec0ce790 0x7f9bec152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 >> 172.21.15.179:0/1338449529 conn(0x7f9bec072660 msgr2=0x7f9bec0afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 shutdown_connections 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.102+0000 7f9bf16fa700 1 -- 172.21.15.179:0/1338449529 wait complete. 2023-12-07T00:14:32.102 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 9 2023-12-07T00:14:32.114 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:32.234 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.235+0000 7f3d88914700 1 Processor -- start 2023-12-07T00:14:32.234 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.235+0000 7f3d88914700 1 -- start start 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d88914700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d840d06b0 0x7f3d84099c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d88914700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8409a570 con 0x7f3d8409a140 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d88914700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8409ab50 con 0x7f3d8415bde0 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d88914700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d840cf630 con 0x7f3d840d06b0 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d82d9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3d8409a140 0x7f3d840b1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46126/0 (socket says 172.21.15.179:46126) 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d82d9d700 1 -- 172.21.15.179:0/3349668973 learned_addr learned my addr 172.21.15.179:0/3349668973 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d81d9b700 1 --2- 172.21.15.179:0/3349668973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d840d06b0 0x7f3d84099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d8159a700 1 -- 172.21.15.179:0/3349668973 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448035914 0 0) 0x7f3d8409a570 con 0x7f3d8409a140 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d8159a700 1 -- 172.21.15.179:0/3349668973 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d6c0035b0 con 0x7f3d8409a140 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d8159a700 1 -- 172.21.15.179:0/3349668973 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105480105 0 0) 0x7f3d8409ab50 con 0x7f3d8415bde0 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d8159a700 1 -- 172.21.15.179:0/3349668973 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d8409a570 con 0x7f3d8415bde0 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d81d9b700 1 -- 172.21.15.179:0/3349668973 >> v1:172.21.15.190:6789/0 conn(0x7f3d8415bde0 legacy=0x7f3d840cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d8159a700 1 -- 172.21.15.179:0/3349668973 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982837035 0 0) 0x7f3d6c0035b0 con 0x7f3d8409a140 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d81d9b700 1 -- 172.21.15.179:0/3349668973 >> v1:172.21.15.179:6789/0 conn(0x7f3d8409a140 legacy=0x7f3d840b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.236+0000 7f3d81d9b700 1 -- 172.21.15.179:0/3349668973 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840cf8f0 con 0x7f3d840d06b0 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d81d9b700 1 --2- 172.21.15.179:0/3349668973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d840d06b0 0x7f3d84099c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009870 tx=0x7f3d78009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad5ad9399995326 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d8159a700 1 -- 172.21.15.179:0/3349668973 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0019f0 con 0x7f3d840d06b0 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d8159a700 1 -- 172.21.15.179:0/3349668973 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78004030 con 0x7f3d840d06b0 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d8159a700 1 -- 172.21.15.179:0/3349668973 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780043c0 con 0x7f3d840d06b0 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d88914700 1 -- 172.21.15.179:0/3349668973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d840d06b0 msgr2=0x7f3d84099c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d88914700 1 --2- 172.21.15.179:0/3349668973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d840d06b0 0x7f3d84099c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009870 tx=0x7f3d78009b80 comp rx=0 tx=0).stop 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d88914700 1 -- 172.21.15.179:0/3349668973 shutdown_connections 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d88914700 1 --2- 172.21.15.179:0/3349668973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d840d06b0 0x7f3d84099c00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d88914700 1 -- 172.21.15.179:0/3349668973 >> 172.21.15.179:0/3349668973 conn(0x7f3d840b3550 msgr2=0x7f3d840b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d88914700 1 -- 172.21.15.179:0/3349668973 shutdown_connections 2023-12-07T00:14:32.238 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.237+0000 7f3d88914700 1 -- 172.21.15.179:0/3349668973 wait complete. 2023-12-07T00:14:32.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.239+0000 7f3d88914700 1 Processor -- start 2023-12-07T00:14:32.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.239+0000 7f3d88914700 1 -- start start 2023-12-07T00:14:32.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d88914700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d8409a140 0x7f3d8415dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d88914700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d840d06b0 0x7f3d8414ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d88914700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d8415bde0 0x7f3d8415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d88914700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8415d7b0 con 0x7f3d8415bde0 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d88914700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8415cba0 con 0x7f3d840d06b0 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d88914700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8415ce80 con 0x7f3d8409a140 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d8415bde0 0x7f3d8415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d8415bde0 0x7f3d8415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39230/0 (socket says 172.21.15.179:39230) 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 -- 172.21.15.179:0/550381216 learned_addr learned my addr 172.21.15.179:0/550381216 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d8259c700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d8409a140 0x7f3d8415dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d81d9b700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d840d06b0 0x7f3d8414ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 -- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d8409a140 msgr2=0x7f3d8415dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d8409a140 0x7f3d8415dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 -- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d840d06b0 msgr2=0x7f3d8414ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d840d06b0 0x7f3d8414ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 -- 172.21.15.179:0/550381216 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d780094a0 con 0x7f3d8415bde0 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d8259c700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d8409a140 0x7f3d8415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:32.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d82d9d700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d8415bde0 0x7f3d8415c1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00cba0 tx=0x7f3d7c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d72ffd700 1 -- 172.21.15.179:0/550381216 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00ab80 con 0x7f3d8415bde0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d72ffd700 1 -- 172.21.15.179:0/550381216 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c00ad00 con 0x7f3d8415bde0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8415d160 con 0x7f3d8415bde0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d72ffd700 1 -- 172.21.15.179:0/550381216 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c007310 con 0x7f3d8415bde0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.240+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8414d230 con 0x7f3d8415bde0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.241+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d840b3130 con 0x7f3d8415bde0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.242+0000 7f3d72ffd700 1 -- 172.21.15.179:0/550381216 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d7c007470 con 0x7f3d8415bde0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.242+0000 7f3d72ffd700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3d6406aed0 0x7f3d6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.242+0000 7f3d72ffd700 1 -- 172.21.15.179:0/550381216 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3d7c089790 con 0x7f3d8415bde0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.242+0000 7f3d8259c700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3d6406aed0 0x7f3d6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.243+0000 7f3d8259c700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3d6406aed0 0x7f3d6406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d74007fd0 tx=0x7f3d74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.247+0000 7f3d72ffd700 1 -- 172.21.15.179:0/550381216 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d7c054550 con 0x7f3d8415bde0 2023-12-07T00:14:32.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.437+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d840685f0 con 0x7f3d8415bde0 2023-12-07T00:14:32.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.438+0000 7f3d72ffd700 1 -- 172.21.15.179:0/550381216 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f3d7c057b70 con 0x7f3d8415bde0 2023-12-07T00:14:32.438 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:32.438 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:32.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3d6406aed0 msgr2=0x7f3d6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3d6406aed0 0x7f3d6406d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3d74007fd0 tx=0x7f3d74009040 comp rx=0 tx=0).stop 2023-12-07T00:14:32.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d8415bde0 msgr2=0x7f3d8415c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d8415bde0 0x7f3d8415c1c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00cba0 tx=0x7f3d7c00cf60 comp rx=0 tx=0).stop 2023-12-07T00:14:32.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 shutdown_connections 2023-12-07T00:14:32.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3d6406aed0 0x7f3d6406d390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d8415bde0 0x7f3d8415c1c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d8409a140 0x7f3d8415dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 --2- 172.21.15.179:0/550381216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d840d06b0 0x7f3d8414ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 >> 172.21.15.179:0/550381216 conn(0x7f3d840b3550 msgr2=0x7f3d840739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:32.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 shutdown_connections 2023-12-07T00:14:32.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.441+0000 7f3d88914700 1 -- 172.21.15.179:0/550381216 wait complete. 2023-12-07T00:14:32.452 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T00:14:32.453 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T00:14:32.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.574+0000 7fad62a9f700 1 Processor -- start 2023-12-07T00:14:32.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.574+0000 7fad62a9f700 1 -- start start 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad62a9f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fad5c15e220 0x7fad5c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad62a9f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c0b2aa0 0x7fad5c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad62a9f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c15f330 con 0x7fad5c15de40 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad62a9f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c0d1820 con 0x7fad5c15e220 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad62a9f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0b2ed0 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad6103c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c0b2aa0 0x7fad5c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad5bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fad5c15e220 0x7fad5c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad5bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fad5c15e220 0x7fad5c0b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41488/0 (socket says 172.21.15.179:41488) 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad6103c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c0b2aa0 0x7fad5c15f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39652/0 (socket says 172.21.15.179:39652) 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad5bfff700 1 -- 172.21.15.179:0/1501273600 learned_addr learned my addr 172.21.15.179:0/1501273600 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:32.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.575+0000 7fad6083b700 1 --1- 172.21.15.179:0/1501273600 >> v1:172.21.15.190:6789/0 conn(0x7fad5c15de40 0x7fad5c0b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:52814/0 (socket says 172.21.15.179:52814) 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad6103c700 1 -- 172.21.15.179:0/1501273600 >> v2:172.21.15.190:3300/0 conn(0x7fad5c15e220 msgr2=0x7fad5c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad6103c700 1 --2- 172.21.15.179:0/1501273600 >> v2:172.21.15.190:3300/0 conn(0x7fad5c15e220 0x7fad5c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad6103c700 1 -- 172.21.15.179:0/1501273600 >> v1:172.21.15.190:6789/0 conn(0x7fad5c15de40 legacy=0x7fad5c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad6103c700 1 -- 172.21.15.179:0/1501273600 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c15e720 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad5bfff700 1 --2- 172.21.15.179:0/1501273600 >> v2:172.21.15.190:3300/0 conn(0x7fad5c15e220 0x7fad5c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad6103c700 1 --2- 172.21.15.179:0/1501273600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c0b2aa0 0x7fad5c15f870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad54009d90 tx=0x7fad5400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f18e6f60362e1ba9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad5b7fe700 1 -- 172.21.15.179:0/1501273600 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5400e070 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad5b7fe700 1 -- 172.21.15.179:0/1501273600 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5400bb20 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.576+0000 7fad5b7fe700 1 -- 172.21.15.179:0/1501273600 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad54012430 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.577+0000 7fad62a9f700 1 -- 172.21.15.179:0/1501273600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c0b2aa0 msgr2=0x7fad5c15f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.577+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1501273600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c0b2aa0 0x7fad5c15f870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad54009d90 tx=0x7fad5400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.577+0000 7fad62a9f700 1 -- 172.21.15.179:0/1501273600 shutdown_connections 2023-12-07T00:14:32.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.577+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1501273600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c0b2aa0 0x7fad5c15f870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.577+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1501273600 >> v2:172.21.15.190:3300/0 conn(0x7fad5c15e220 0x7fad5c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.577+0000 7fad62a9f700 1 -- 172.21.15.179:0/1501273600 >> 172.21.15.179:0/1501273600 conn(0x7fad5c072970 msgr2=0x7fad5c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:32.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.577+0000 7fad62a9f700 1 -- 172.21.15.179:0/1501273600 shutdown_connections 2023-12-07T00:14:32.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.577+0000 7fad62a9f700 1 -- 172.21.15.179:0/1501273600 wait complete. 2023-12-07T00:14:32.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.578+0000 7fad62a9f700 1 Processor -- start 2023-12-07T00:14:32.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.578+0000 7fad62a9f700 1 -- start start 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad62a9f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad5c0b2aa0 0x7fad5c1e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad62a9f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5c15de40 0x7fad5c0cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad62a9f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c15e220 0x7fad5c14aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad62a9f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0cead0 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad62a9f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0cdec0 con 0x7fad5c15de40 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad62a9f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0ce1a0 con 0x7fad5c15e220 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad5c0b2aa0 0x7fad5c1e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad5c0b2aa0 0x7fad5c1e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39240/0 (socket says 172.21.15.179:39240) 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 -- 172.21.15.179:0/1497366269 learned_addr learned my addr 172.21.15.179:0/1497366269 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad5bfff700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5c15de40 0x7fad5c0cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6103c700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c15e220 0x7fad5c14aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 -- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c15e220 msgr2=0x7fad5c14aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c15e220 0x7fad5c14aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 -- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5c15de40 msgr2=0x7fad5c0cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5c15de40 0x7fad5c0cef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 -- 172.21.15.179:0/1497366269 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad48009500 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6103c700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c15e220 0x7fad5c14aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad6083b700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad5c0b2aa0 0x7fad5c1e7ef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad5000c520 tx=0x7fad5000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.579+0000 7fad597fa700 1 -- 172.21.15.179:0/1497366269 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50005cb0 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.580+0000 7fad597fa700 1 -- 172.21.15.179:0/1497366269 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50005e10 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.580+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad54009a70 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.580+0000 7fad597fa700 1 -- 172.21.15.179:0/1497366269 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500072d0 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.580+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c0ce760 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.580+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c04f290 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.581+0000 7fad597fa700 1 -- 172.21.15.179:0/1497366269 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad50007430 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.581+0000 7fad597fa700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fad4006aed0 0x7fad4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.581+0000 7fad597fa700 1 -- 172.21.15.179:0/1497366269 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad50088c40 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.581+0000 7fad5bfff700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fad4006aed0 0x7fad4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.582+0000 7fad5bfff700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fad4006aed0 0x7fad4006d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad5c1f7000 tx=0x7fad48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.586+0000 7fad597fa700 1 -- 172.21.15.179:0/1497366269 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad50053b40 con 0x7fad5c0b2aa0 2023-12-07T00:14:32.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.779+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 --> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad5c15efc0 con 0x7fad4006aed0 2023-12-07T00:14:32.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.789+0000 7fad597fa700 1 -- 172.21.15.179:0/1497366269 <== mgr.4104 v2:172.21.15.179:6832/1592863421 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345304 (secure 0 0 0) 0x7fad48011830 con 0x7fad4006aed0 2023-12-07T00:14:32.792 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:32.795 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fad4006aed0 msgr2=0x7fad4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.795 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fad4006aed0 0x7fad4006d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad5c1f7000 tx=0x7fad48008040 comp rx=0 tx=0).stop 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad5c0b2aa0 msgr2=0x7fad5c1e7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad5c0b2aa0 0x7fad5c1e7ef0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad5000c520 tx=0x7fad5000c8e0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 shutdown_connections 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fad4006aed0 0x7fad4006d390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5c15e220 0x7fad5c14aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fad5c0b2aa0 0x7fad5c1e7ef0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 --2- 172.21.15.179:0/1497366269 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5c15de40 0x7fad5c0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 >> 172.21.15.179:0/1497366269 conn(0x7fad5c072970 msgr2=0x7fad5c0b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 shutdown_connections 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.793+0000 7fad62a9f700 1 -- 172.21.15.179:0/1497366269 wait complete. 2023-12-07T00:14:32.796 INFO:teuthology.orchestra.run.smithi179.stderr:dumped all 2023-12-07T00:14:32.804 INFO:teuthology.orchestra.run.smithi179.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-12-07T00:14:32.517271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3579904,"data_stored":2119604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2228,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.834978"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890228+0000","last_change":"2023-12-07T00:14:14.643199+0000","last_active":"2023-12-07T00:14:19.890228+0000","last_peered":"2023-12-07T00:14:19.890228+0000","last_clean":"2023-12-07T00:14:19.890228+0000","last_became_active":"2023-12-07T00:14:14.642929+0000","last_became_peered":"2023-12-07T00:14:14.642929+0000","last_unstale":"2023-12-07T00:14:19.890228+0000","last_undegraded":"2023-12-07T00:14:19.890228+0000","last_fullsized":"2023-12-07T00:14:19.890228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:20:09.627523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889353+0000","last_change":"2023-12-07T00:14:14.644949+0000","last_active":"2023-12-07T00:14:19.889353+0000","last_peered":"2023-12-07T00:14:19.889353+0000","last_clean":"2023-12-07T00:14:19.889353+0000","last_became_active":"2023-12-07T00:14:14.644679+0000","last_became_peered":"2023-12-07T00:14:14.644679+0000","last_unstale":"2023-12-07T00:14:19.889353+0000","last_undegraded":"2023-12-07T00:14:19.889353+0000","last_fullsized":"2023-12-07T00:14:19.889353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889573+0000","last_change":"2023-12-07T00:14:14.645513+0000","last_active":"2023-12-07T00:14:19.889573+0000","last_peered":"2023-12-07T00:14:19.889573+0000","last_clean":"2023-12-07T00:14:19.889573+0000","last_became_active":"2023-12-07T00:14:14.645261+0000","last_became_peered":"2023-12-07T00:14:14.645261+0000","last_unstale":"2023-12-07T00:14:19.889573+0000","last_undegraded":"2023-12-07T00:14:19.889573+0000","last_fullsized":"2023-12-07T00:14:19.889573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683459+0000","last_change":"2023-12-07T00:14:14.646952+0000","last_active":"2023-12-07T00:14:19.683459+0000","last_peered":"2023-12-07T00:14:19.683459+0000","last_clean":"2023-12-07T00:14:19.683459+0000","last_became_active":"2023-12-07T00:14:14.646645+0000","last_became_peered":"2023-12-07T00:14:14.646645+0000","last_unstale":"2023-12-07T00:14:19.683459+0000","last_undegraded":"2023-12-07T00:14:19.683459+0000","last_fullsized":"2023-12-07T00:14:19.683459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889608+0000","last_change":"2023-12-07T00:14:14.645840+0000","last_active":"2023-12-07T00:14:19.889608+0000","last_peered":"2023-12-07T00:14:19.889608+0000","last_clean":"2023-12-07T00:14:19.889608+0000","last_became_active":"2023-12-07T00:14:14.645226+0000","last_became_peered":"2023-12-07T00:14:14.645226+0000","last_unstale":"2023-12-07T00:14:19.889608+0000","last_undegraded":"2023-12-07T00:14:19.889608+0000","last_fullsized":"2023-12-07T00:14:19.889608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:24.947977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683090+0000","last_change":"2023-12-07T00:14:14.642310+0000","last_active":"2023-12-07T00:14:19.683090+0000","last_peered":"2023-12-07T00:14:19.683090+0000","last_clean":"2023-12-07T00:14:19.683090+0000","last_became_active":"2023-12-07T00:14:14.642041+0000","last_became_peered":"2023-12-07T00:14:14.642041+0000","last_unstale":"2023-12-07T00:14:19.683090+0000","last_undegraded":"2023-12-07T00:14:19.683090+0000","last_fullsized":"2023-12-07T00:14:19.683090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:20:09.627523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889514+0000","last_change":"2023-12-07T00:14:14.651174+0000","last_active":"2023-12-07T00:14:19.889514+0000","last_peered":"2023-12-07T00:14:19.889514+0000","last_clean":"2023-12-07T00:14:19.889514+0000","last_became_active":"2023-12-07T00:14:14.650891+0000","last_became_peered":"2023-12-07T00:14:14.650891+0000","last_unstale":"2023-12-07T00:14:19.889514+0000","last_undegraded":"2023-12-07T00:14:19.889514+0000","last_fullsized":"2023-12-07T00:14:19.889514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680378+0000","last_change":"2023-12-07T00:14:14.651410+0000","last_active":"2023-12-07T00:14:19.680378+0000","last_peered":"2023-12-07T00:14:19.680378+0000","last_clean":"2023-12-07T00:14:19.680378+0000","last_became_active":"2023-12-07T00:14:14.651150+0000","last_became_peered":"2023-12-07T00:14:14.651150+0000","last_unstale":"2023-12-07T00:14:19.680378+0000","last_undegraded":"2023-12-07T00:14:19.680378+0000","last_fullsized":"2023-12-07T00:14:19.680378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890130+0000","last_change":"2023-12-07T00:14:14.649568+0000","last_active":"2023-12-07T00:14:19.890130+0000","last_peered":"2023-12-07T00:14:19.890130+0000","last_clean":"2023-12-07T00:14:19.890130+0000","last_became_active":"2023-12-07T00:14:14.649226+0000","last_became_peered":"2023-12-07T00:14:14.649226+0000","last_unstale":"2023-12-07T00:14:19.890130+0000","last_undegraded":"2023-12-07T00:14:19.890130+0000","last_fullsized":"2023-12-07T00:14:19.890130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683413+0000","last_change":"2023-12-07T00:14:14.641982+0000","last_active":"2023-12-07T00:14:19.683413+0000","last_peered":"2023-12-07T00:14:19.683413+0000","last_clean":"2023-12-07T00:14:19.683413+0000","last_became_active":"2023-12-07T00:14:14.641635+0000","last_became_peered":"2023-12-07T00:14:14.641635+0000","last_unstale":"2023-12-07T00:14:19.683413+0000","last_undegraded":"2023-12-07T00:14:19.683413+0000","last_fullsized":"2023-12-07T00:14:19.683413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683349+0000","last_change":"2023-12-07T00:14:14.641705+0000","last_active":"2023-12-07T00:14:19.683349+0000","last_peered":"2023-12-07T00:14:19.683349+0000","last_clean":"2023-12-07T00:14:19.683349+0000","last_became_active":"2023-12-07T00:14:14.640554+0000","last_became_peered":"2023-12-07T00:14:14.640554+0000","last_unstale":"2023-12-07T00:14:19.683349+0000","last_undegraded":"2023-12-07T00:14:19.683349+0000","last_fullsized":"2023-12-07T00:14:19.683349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890100+0000","last_change":"2023-12-07T00:14:14.638208+0000","last_active":"2023-12-07T00:14:19.890100+0000","last_peered":"2023-12-07T00:14:19.890100+0000","last_clean":"2023-12-07T00:14:19.890100+0000","last_became_active":"2023-12-07T00:14:14.637940+0000","last_became_peered":"2023-12-07T00:14:14.637940+0000","last_unstale":"2023-12-07T00:14:19.890100+0000","last_undegraded":"2023-12-07T00:14:19.890100+0000","last_fullsized":"2023-12-07T00:14:19.890100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:09.512398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680049+0000","last_change":"2023-12-07T00:14:14.655710+0000","last_active":"2023-12-07T00:14:19.680049+0000","last_peered":"2023-12-07T00:14:19.680049+0000","last_clean":"2023-12-07T00:14:19.680049+0000","last_became_active":"2023-12-07T00:14:14.652457+0000","last_became_peered":"2023-12-07T00:14:14.652457+0000","last_unstale":"2023-12-07T00:14:19.680049+0000","last_undegraded":"2023-12-07T00:14:19.680049+0000","last_fullsized":"2023-12-07T00:14:19.680049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889539+0000","last_change":"2023-12-07T00:14:14.654290+0000","last_active":"2023-12-07T00:14:19.889539+0000","last_peered":"2023-12-07T00:14:19.889539+0000","last_clean":"2023-12-07T00:14:19.889539+0000","last_became_active":"2023-12-07T00:14:14.654021+0000","last_became_peered":"2023-12-07T00:14:14.654021+0000","last_unstale":"2023-12-07T00:14:19.889539+0000","last_undegraded":"2023-12-07T00:14:19.889539+0000","last_fullsized":"2023-12-07T00:14:19.889539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:18.698925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888456+0000","last_change":"2023-12-07T00:14:14.646526+0000","last_active":"2023-12-07T00:14:19.888456+0000","last_peered":"2023-12-07T00:14:19.888456+0000","last_clean":"2023-12-07T00:14:19.888456+0000","last_became_active":"2023-12-07T00:14:14.646114+0000","last_became_peered":"2023-12-07T00:14:14.646114+0000","last_unstale":"2023-12-07T00:14:19.888456+0000","last_undegraded":"2023-12-07T00:14:19.888456+0000","last_fullsized":"2023-12-07T00:14:19.888456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682644+0000","last_change":"2023-12-07T00:14:14.642157+0000","last_active":"2023-12-07T00:14:19.682644+0000","last_peered":"2023-12-07T00:14:19.682644+0000","last_clean":"2023-12-07T00:14:19.682644+0000","last_became_active":"2023-12-07T00:14:14.641857+0000","last_became_peered":"2023-12-07T00:14:14.641857+0000","last_unstale":"2023-12-07T00:14:19.682644+0000","last_undegraded":"2023-12-07T00:14:19.682644+0000","last_fullsized":"2023-12-07T00:14:19.682644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684069+0000","last_change":"2023-12-07T00:14:14.643563+0000","last_active":"2023-12-07T00:14:19.684069+0000","last_peered":"2023-12-07T00:14:19.684069+0000","last_clean":"2023-12-07T00:14:19.684069+0000","last_became_active":"2023-12-07T00:14:14.643055+0000","last_became_peered":"2023-12-07T00:14:14.643055+0000","last_unstale":"2023-12-07T00:14:19.684069+0000","last_undegraded":"2023-12-07T00:14:19.684069+0000","last_fullsized":"2023-12-07T00:14:19.684069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:36.710499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889136+0000","last_change":"2023-12-07T00:14:14.636014+0000","last_active":"2023-12-07T00:14:19.889136+0000","last_peered":"2023-12-07T00:14:19.889136+0000","last_clean":"2023-12-07T00:14:19.889136+0000","last_became_active":"2023-12-07T00:14:14.635717+0000","last_became_peered":"2023-12-07T00:14:14.635717+0000","last_unstale":"2023-12-07T00:14:19.889136+0000","last_undegraded":"2023-12-07T00:14:19.889136+0000","last_fullsized":"2023-12-07T00:14:19.889136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:24.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890290+0000","last_change":"2023-12-07T00:14:14.645014+0000","last_active":"2023-12-07T00:14:19.890290+0000","last_peered":"2023-12-07T00:14:19.890290+0000","last_clean":"2023-12-07T00:14:19.890290+0000","last_became_active":"2023-12-07T00:14:14.644738+0000","last_became_peered":"2023-12-07T00:14:14.644738+0000","last_unstale":"2023-12-07T00:14:19.890290+0000","last_undegraded":"2023-12-07T00:14:19.890290+0000","last_fullsized":"2023-12-07T00:14:19.890290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367254+0000","last_change":"2023-12-07T00:14:19.076496+0000","last_active":"2023-12-07T00:14:21.367254+0000","last_peered":"2023-12-07T00:14:21.367254+0000","last_clean":"2023-12-07T00:14:21.367254+0000","last_became_active":"2023-12-07T00:14:19.076104+0000","last_became_peered":"2023-12-07T00:14:19.076104+0000","last_unstale":"2023-12-07T00:14:21.367254+0000","last_undegraded":"2023-12-07T00:14:21.367254+0000","last_fullsized":"2023-12-07T00:14:21.367254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:19:30.998083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889786+0000","last_change":"2023-12-07T00:14:13.630530+0000","last_active":"2023-12-07T00:14:19.889786+0000","last_peered":"2023-12-07T00:14:19.889786+0000","last_clean":"2023-12-07T00:14:19.889786+0000","last_became_active":"2023-12-07T00:14:13.630248+0000","last_became_peered":"2023-12-07T00:14:13.630248+0000","last_unstale":"2023-12-07T00:14:19.889786+0000","last_undegraded":"2023-12-07T00:14:19.889786+0000","last_fullsized":"2023-12-07T00:14:19.889786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680935+0000","last_change":"2023-12-07T00:14:14.650100+0000","last_active":"2023-12-07T00:14:19.680935+0000","last_peered":"2023-12-07T00:14:19.680935+0000","last_clean":"2023-12-07T00:14:19.680935+0000","last_became_active":"2023-12-07T00:14:14.649807+0000","last_became_peered":"2023-12-07T00:14:14.649807+0000","last_unstale":"2023-12-07T00:14:19.680935+0000","last_undegraded":"2023-12-07T00:14:19.680935+0000","last_fullsized":"2023-12-07T00:14:19.680935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684337+0000","last_change":"2023-12-07T00:14:18.665602+0000","last_active":"2023-12-07T00:14:20.684337+0000","last_peered":"2023-12-07T00:14:20.684337+0000","last_clean":"2023-12-07T00:14:20.684337+0000","last_became_active":"2023-12-07T00:14:18.665065+0000","last_became_peered":"2023-12-07T00:14:18.665065+0000","last_unstale":"2023-12-07T00:14:20.684337+0000","last_undegraded":"2023-12-07T00:14:20.684337+0000","last_fullsized":"2023-12-07T00:14:20.684337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:28.978624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680641+0000","last_change":"2023-12-07T00:14:13.635320+0000","last_active":"2023-12-07T00:14:19.680641+0000","last_peered":"2023-12-07T00:14:19.680641+0000","last_clean":"2023-12-07T00:14:19.680641+0000","last_became_active":"2023-12-07T00:14:13.635008+0000","last_became_peered":"2023-12-07T00:14:13.635008+0000","last_unstale":"2023-12-07T00:14:19.680641+0000","last_undegraded":"2023-12-07T00:14:19.680641+0000","last_fullsized":"2023-12-07T00:14:19.680641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:17.694563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889743+0000","last_change":"2023-12-07T00:14:14.642235+0000","last_active":"2023-12-07T00:14:19.889743+0000","last_peered":"2023-12-07T00:14:19.889743+0000","last_clean":"2023-12-07T00:14:19.889743+0000","last_became_active":"2023-12-07T00:14:14.641920+0000","last_became_peered":"2023-12-07T00:14:14.641920+0000","last_unstale":"2023-12-07T00:14:19.889743+0000","last_undegraded":"2023-12-07T00:14:19.889743+0000","last_fullsized":"2023-12-07T00:14:19.889743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684737+0000","last_change":"2023-12-07T00:14:18.665909+0000","last_active":"2023-12-07T00:14:20.684737+0000","last_peered":"2023-12-07T00:14:20.684737+0000","last_clean":"2023-12-07T00:14:20.684737+0000","last_became_active":"2023-12-07T00:14:18.665195+0000","last_became_peered":"2023-12-07T00:14:18.665195+0000","last_unstale":"2023-12-07T00:14:20.684737+0000","last_undegraded":"2023-12-07T00:14:20.684737+0000","last_fullsized":"2023-12-07T00:14:20.684737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:36.812638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889883+0000","last_change":"2023-12-07T00:14:13.639070+0000","last_active":"2023-12-07T00:14:19.889883+0000","last_peered":"2023-12-07T00:14:19.889883+0000","last_clean":"2023-12-07T00:14:19.889883+0000","last_became_active":"2023-12-07T00:14:13.638806+0000","last_became_peered":"2023-12-07T00:14:13.638806+0000","last_unstale":"2023-12-07T00:14:19.889883+0000","last_undegraded":"2023-12-07T00:14:19.889883+0000","last_fullsized":"2023-12-07T00:14:19.889883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:17.694563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683306+0000","last_change":"2023-12-07T00:14:14.638446+0000","last_active":"2023-12-07T00:14:19.683306+0000","last_peered":"2023-12-07T00:14:19.683306+0000","last_clean":"2023-12-07T00:14:19.683306+0000","last_became_active":"2023-12-07T00:14:14.638158+0000","last_became_peered":"2023-12-07T00:14:14.638158+0000","last_unstale":"2023-12-07T00:14:19.683306+0000","last_undegraded":"2023-12-07T00:14:19.683306+0000","last_fullsized":"2023-12-07T00:14:19.683306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684589+0000","last_change":"2023-12-07T00:14:18.669676+0000","last_active":"2023-12-07T00:14:20.684589+0000","last_peered":"2023-12-07T00:14:20.684589+0000","last_clean":"2023-12-07T00:14:20.684589+0000","last_became_active":"2023-12-07T00:14:18.669279+0000","last_became_peered":"2023-12-07T00:14:18.669279+0000","last_unstale":"2023-12-07T00:14:20.684589+0000","last_undegraded":"2023-12-07T00:14:20.684589+0000","last_fullsized":"2023-12-07T00:14:20.684589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:31.897202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889817+0000","last_change":"2023-12-07T00:14:13.635829+0000","last_active":"2023-12-07T00:14:19.889817+0000","last_peered":"2023-12-07T00:14:19.889817+0000","last_clean":"2023-12-07T00:14:19.889817+0000","last_became_active":"2023-12-07T00:14:13.635554+0000","last_became_peered":"2023-12-07T00:14:13.635554+0000","last_unstale":"2023-12-07T00:14:19.889817+0000","last_undegraded":"2023-12-07T00:14:19.889817+0000","last_fullsized":"2023-12-07T00:14:19.889817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684138+0000","last_change":"2023-12-07T00:14:14.638063+0000","last_active":"2023-12-07T00:14:19.684138+0000","last_peered":"2023-12-07T00:14:19.684138+0000","last_clean":"2023-12-07T00:14:19.684138+0000","last_became_active":"2023-12-07T00:14:14.637766+0000","last_became_peered":"2023-12-07T00:14:14.637766+0000","last_unstale":"2023-12-07T00:14:19.684138+0000","last_undegraded":"2023-12-07T00:14:19.684138+0000","last_fullsized":"2023-12-07T00:14:19.684138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367970+0000","last_change":"2023-12-07T00:14:18.668124+0000","last_active":"2023-12-07T00:14:21.367970+0000","last_peered":"2023-12-07T00:14:21.367970+0000","last_clean":"2023-12-07T00:14:21.367970+0000","last_became_active":"2023-12-07T00:14:18.667677+0000","last_became_peered":"2023-12-07T00:14:18.667677+0000","last_unstale":"2023-12-07T00:14:21.367970+0000","last_undegraded":"2023-12-07T00:14:21.367970+0000","last_fullsized":"2023-12-07T00:14:21.367970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:29:46.330072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680292+0000","last_change":"2023-12-07T00:14:13.639589+0000","last_active":"2023-12-07T00:14:19.680292+0000","last_peered":"2023-12-07T00:14:19.680292+0000","last_clean":"2023-12-07T00:14:19.680292+0000","last_became_active":"2023-12-07T00:14:13.639315+0000","last_became_peered":"2023-12-07T00:14:13.639315+0000","last_unstale":"2023-12-07T00:14:19.680292+0000","last_undegraded":"2023-12-07T00:14:19.680292+0000","last_fullsized":"2023-12-07T00:14:19.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889199+0000","last_change":"2023-12-07T00:14:14.638371+0000","last_active":"2023-12-07T00:14:19.889199+0000","last_peered":"2023-12-07T00:14:19.889199+0000","last_clean":"2023-12-07T00:14:19.889199+0000","last_became_active":"2023-12-07T00:14:14.638090+0000","last_became_peered":"2023-12-07T00:14:14.638090+0000","last_unstale":"2023-12-07T00:14:19.889199+0000","last_undegraded":"2023-12-07T00:14:19.889199+0000","last_fullsized":"2023-12-07T00:14:19.889199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:02:05.622336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.681229+0000","last_change":"2023-12-07T00:14:18.667960+0000","last_active":"2023-12-07T00:14:20.681229+0000","last_peered":"2023-12-07T00:14:20.681229+0000","last_clean":"2023-12-07T00:14:20.681229+0000","last_became_active":"2023-12-07T00:14:18.667569+0000","last_became_peered":"2023-12-07T00:14:18.667569+0000","last_unstale":"2023-12-07T00:14:20.681229+0000","last_undegraded":"2023-12-07T00:14:20.681229+0000","last_fullsized":"2023-12-07T00:14:20.681229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:18.112203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683017+0000","last_change":"2023-12-07T00:14:13.637477+0000","last_active":"2023-12-07T00:14:19.683017+0000","last_peered":"2023-12-07T00:14:19.683017+0000","last_clean":"2023-12-07T00:14:19.683017+0000","last_became_active":"2023-12-07T00:14:13.637044+0000","last_became_peered":"2023-12-07T00:14:13.637044+0000","last_unstale":"2023-12-07T00:14:19.683017+0000","last_undegraded":"2023-12-07T00:14:19.683017+0000","last_fullsized":"2023-12-07T00:14:19.683017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888973+0000","last_change":"2023-12-07T00:14:14.648736+0000","last_active":"2023-12-07T00:14:19.888973+0000","last_peered":"2023-12-07T00:14:19.888973+0000","last_clean":"2023-12-07T00:14:19.888973+0000","last_became_active":"2023-12-07T00:14:14.648449+0000","last_became_peered":"2023-12-07T00:14:14.648449+0000","last_unstale":"2023-12-07T00:14:19.888973+0000","last_undegraded":"2023-12-07T00:14:19.888973+0000","last_fullsized":"2023-12-07T00:14:19.888973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.706104+0000","last_change":"2023-12-07T00:14:18.671310+0000","last_active":"2023-12-07T00:14:20.706104+0000","last_peered":"2023-12-07T00:14:20.706104+0000","last_clean":"2023-12-07T00:14:20.706104+0000","last_became_active":"2023-12-07T00:14:18.670905+0000","last_became_peered":"2023-12-07T00:14:18.670905+0000","last_unstale":"2023-12-07T00:14:20.706104+0000","last_undegraded":"2023-12-07T00:14:20.706104+0000","last_fullsized":"2023-12-07T00:14:20.706104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:36.812638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679983+0000","last_change":"2023-12-07T00:14:13.636864+0000","last_active":"2023-12-07T00:14:19.679983+0000","last_peered":"2023-12-07T00:14:19.679983+0000","last_clean":"2023-12-07T00:14:19.679983+0000","last_became_active":"2023-12-07T00:14:13.636497+0000","last_became_peered":"2023-12-07T00:14:13.636497+0000","last_unstale":"2023-12-07T00:14:19.679983+0000","last_undegraded":"2023-12-07T00:14:19.679983+0000","last_fullsized":"2023-12-07T00:14:19.679983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679793+0000","last_change":"2023-12-07T00:14:14.647211+0000","last_active":"2023-12-07T00:14:19.679793+0000","last_peered":"2023-12-07T00:14:19.679793+0000","last_clean":"2023-12-07T00:14:19.679793+0000","last_became_active":"2023-12-07T00:14:14.646890+0000","last_became_peered":"2023-12-07T00:14:14.646890+0000","last_unstale":"2023-12-07T00:14:19.679793+0000","last_undegraded":"2023-12-07T00:14:19.679793+0000","last_fullsized":"2023-12-07T00:14:19.679793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367712+0000","last_change":"2023-12-07T00:14:19.073249+0000","last_active":"2023-12-07T00:14:21.367712+0000","last_peered":"2023-12-07T00:14:21.367712+0000","last_clean":"2023-12-07T00:14:21.367712+0000","last_became_active":"2023-12-07T00:14:19.072757+0000","last_became_peered":"2023-12-07T00:14:19.072757+0000","last_unstale":"2023-12-07T00:14:21.367712+0000","last_undegraded":"2023-12-07T00:14:21.367712+0000","last_fullsized":"2023-12-07T00:14:21.367712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684347+0000","last_change":"2023-12-07T00:14:13.630879+0000","last_active":"2023-12-07T00:14:19.684347+0000","last_peered":"2023-12-07T00:14:19.684347+0000","last_clean":"2023-12-07T00:14:19.684347+0000","last_became_active":"2023-12-07T00:14:13.630299+0000","last_became_peered":"2023-12-07T00:14:13.630299+0000","last_unstale":"2023-12-07T00:14:19.684347+0000","last_undegraded":"2023-12-07T00:14:19.684347+0000","last_fullsized":"2023-12-07T00:14:19.684347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888694+0000","last_change":"2023-12-07T00:14:14.651244+0000","last_active":"2023-12-07T00:14:19.888694+0000","last_peered":"2023-12-07T00:14:19.888694+0000","last_clean":"2023-12-07T00:14:19.888694+0000","last_became_active":"2023-12-07T00:14:14.650996+0000","last_became_peered":"2023-12-07T00:14:14.650996+0000","last_unstale":"2023-12-07T00:14:19.888694+0000","last_undegraded":"2023-12-07T00:14:19.888694+0000","last_fullsized":"2023-12-07T00:14:19.888694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367059+0000","last_change":"2023-12-07T00:14:19.073306+0000","last_active":"2023-12-07T00:14:21.367059+0000","last_peered":"2023-12-07T00:14:21.367059+0000","last_clean":"2023-12-07T00:14:21.367059+0000","last_became_active":"2023-12-07T00:14:19.072870+0000","last_became_peered":"2023-12-07T00:14:19.072870+0000","last_unstale":"2023-12-07T00:14:21.367059+0000","last_undegraded":"2023-12-07T00:14:21.367059+0000","last_fullsized":"2023-12-07T00:14:21.367059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:02:29.749218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683882+0000","last_change":"2023-12-07T00:14:13.636919+0000","last_active":"2023-12-07T00:14:19.683882+0000","last_peered":"2023-12-07T00:14:19.683882+0000","last_clean":"2023-12-07T00:14:19.683882+0000","last_became_active":"2023-12-07T00:14:13.636581+0000","last_became_peered":"2023-12-07T00:14:13.636581+0000","last_unstale":"2023-12-07T00:14:19.683882+0000","last_undegraded":"2023-12-07T00:14:19.683882+0000","last_fullsized":"2023-12-07T00:14:19.683882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683788+0000","last_change":"2023-12-07T00:14:14.644313+0000","last_active":"2023-12-07T00:14:19.683788+0000","last_peered":"2023-12-07T00:14:19.683788+0000","last_clean":"2023-12-07T00:14:19.683788+0000","last_became_active":"2023-12-07T00:14:14.643846+0000","last_became_peered":"2023-12-07T00:14:14.643846+0000","last_unstale":"2023-12-07T00:14:19.683788+0000","last_undegraded":"2023-12-07T00:14:19.683788+0000","last_fullsized":"2023-12-07T00:14:19.683788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367087+0000","last_change":"2023-12-07T00:14:18.664942+0000","last_active":"2023-12-07T00:14:21.367087+0000","last_peered":"2023-12-07T00:14:21.367087+0000","last_clean":"2023-12-07T00:14:21.367087+0000","last_became_active":"2023-12-07T00:14:18.664530+0000","last_became_peered":"2023-12-07T00:14:18.664530+0000","last_unstale":"2023-12-07T00:14:21.367087+0000","last_undegraded":"2023-12-07T00:14:21.367087+0000","last_fullsized":"2023-12-07T00:14:21.367087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:50:31.696056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683699+0000","last_change":"2023-12-07T00:14:13.638292+0000","last_active":"2023-12-07T00:14:19.683699+0000","last_peered":"2023-12-07T00:14:19.683699+0000","last_clean":"2023-12-07T00:14:19.683699+0000","last_became_active":"2023-12-07T00:14:13.637982+0000","last_became_peered":"2023-12-07T00:14:13.637982+0000","last_unstale":"2023-12-07T00:14:19.683699+0000","last_undegraded":"2023-12-07T00:14:19.683699+0000","last_fullsized":"2023-12-07T00:14:19.683699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889880+0000","last_change":"2023-12-07T00:14:14.649013+0000","last_active":"2023-12-07T00:14:19.889880+0000","last_peered":"2023-12-07T00:14:19.889880+0000","last_clean":"2023-12-07T00:14:19.889880+0000","last_became_active":"2023-12-07T00:14:14.648768+0000","last_became_peered":"2023-12-07T00:14:14.648768+0000","last_unstale":"2023-12-07T00:14:19.889880+0000","last_undegraded":"2023-12-07T00:14:19.889880+0000","last_fullsized":"2023-12-07T00:14:19.889880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685363+0000","last_change":"2023-12-07T00:14:18.661970+0000","last_active":"2023-12-07T00:14:20.685363+0000","last_peered":"2023-12-07T00:14:20.685363+0000","last_clean":"2023-12-07T00:14:20.685363+0000","last_became_active":"2023-12-07T00:14:18.661509+0000","last_became_peered":"2023-12-07T00:14:18.661509+0000","last_unstale":"2023-12-07T00:14:20.685363+0000","last_undegraded":"2023-12-07T00:14:20.685363+0000","last_fullsized":"2023-12-07T00:14:20.685363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889467+0000","last_change":"2023-12-07T00:14:13.632679+0000","last_active":"2023-12-07T00:14:19.889467+0000","last_peered":"2023-12-07T00:14:19.889467+0000","last_clean":"2023-12-07T00:14:19.889467+0000","last_became_active":"2023-12-07T00:14:13.632414+0000","last_became_peered":"2023-12-07T00:14:13.632414+0000","last_unstale":"2023-12-07T00:14:19.889467+0000","last_undegraded":"2023-12-07T00:14:19.889467+0000","last_fullsized":"2023-12-07T00:14:19.889467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890001+0000","last_change":"2023-12-07T00:14:14.643589+0000","last_active":"2023-12-07T00:14:19.890001+0000","last_peered":"2023-12-07T00:14:19.890001+0000","last_clean":"2023-12-07T00:14:19.890001+0000","last_became_active":"2023-12-07T00:14:14.642709+0000","last_became_peered":"2023-12-07T00:14:14.642709+0000","last_unstale":"2023-12-07T00:14:19.890001+0000","last_undegraded":"2023-12-07T00:14:19.890001+0000","last_fullsized":"2023-12-07T00:14:19.890001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:25:52.844383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274940+0000","last_change":"2023-12-07T00:14:18.672498+0000","last_active":"2023-12-07T00:14:21.274940+0000","last_peered":"2023-12-07T00:14:21.274940+0000","last_clean":"2023-12-07T00:14:21.274940+0000","last_became_active":"2023-12-07T00:14:18.671937+0000","last_became_peered":"2023-12-07T00:14:18.671937+0000","last_unstale":"2023-12-07T00:14:21.274940+0000","last_undegraded":"2023-12-07T00:14:21.274940+0000","last_fullsized":"2023-12-07T00:14:21.274940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:24.753524+0000","last_change":"2023-12-07T00:14:13.637631+0000","last_active":"2023-12-07T00:14:24.753524+0000","last_peered":"2023-12-07T00:14:24.753524+0000","last_clean":"2023-12-07T00:14:24.753524+0000","last_became_active":"2023-12-07T00:14:13.637168+0000","last_became_peered":"2023-12-07T00:14:13.637168+0000","last_unstale":"2023-12-07T00:14:24.753524+0000","last_undegraded":"2023-12-07T00:14:24.753524+0000","last_fullsized":"2023-12-07T00:14:24.753524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:04.965261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890062+0000","last_change":"2023-12-07T00:14:14.650093+0000","last_active":"2023-12-07T00:14:19.890062+0000","last_peered":"2023-12-07T00:14:19.890062+0000","last_clean":"2023-12-07T00:14:19.890062+0000","last_became_active":"2023-12-07T00:14:14.649823+0000","last_became_peered":"2023-12-07T00:14:14.649823+0000","last_unstale":"2023-12-07T00:14:19.890062+0000","last_undegraded":"2023-12-07T00:14:19.890062+0000","last_fullsized":"2023-12-07T00:14:19.890062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367661+0000","last_change":"2023-12-07T00:14:19.071276+0000","last_active":"2023-12-07T00:14:21.367661+0000","last_peered":"2023-12-07T00:14:21.367661+0000","last_clean":"2023-12-07T00:14:21.367661+0000","last_became_active":"2023-12-07T00:14:19.070824+0000","last_became_peered":"2023-12-07T00:14:19.070824+0000","last_unstale":"2023-12-07T00:14:21.367661+0000","last_undegraded":"2023-12-07T00:14:21.367661+0000","last_fullsized":"2023-12-07T00:14:21.367661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:08.025637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888896+0000","last_change":"2023-12-07T00:14:13.631611+0000","last_active":"2023-12-07T00:14:19.888896+0000","last_peered":"2023-12-07T00:14:19.888896+0000","last_clean":"2023-12-07T00:14:19.888896+0000","last_became_active":"2023-12-07T00:14:13.631235+0000","last_became_peered":"2023-12-07T00:14:13.631235+0000","last_unstale":"2023-12-07T00:14:19.888896+0000","last_undegraded":"2023-12-07T00:14:19.888896+0000","last_fullsized":"2023-12-07T00:14:19.888896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:23.927140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889622+0000","last_change":"2023-12-07T00:14:14.644562+0000","last_active":"2023-12-07T00:14:19.889622+0000","last_peered":"2023-12-07T00:14:19.889622+0000","last_clean":"2023-12-07T00:14:19.889622+0000","last_became_active":"2023-12-07T00:14:14.644312+0000","last_became_peered":"2023-12-07T00:14:14.644312+0000","last_unstale":"2023-12-07T00:14:19.889622+0000","last_undegraded":"2023-12-07T00:14:19.889622+0000","last_fullsized":"2023-12-07T00:14:19.889622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:56.516763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367810+0000","last_change":"2023-12-07T00:14:19.070516+0000","last_active":"2023-12-07T00:14:21.367810+0000","last_peered":"2023-12-07T00:14:21.367810+0000","last_clean":"2023-12-07T00:14:21.367810+0000","last_became_active":"2023-12-07T00:14:19.069991+0000","last_became_peered":"2023-12-07T00:14:19.069991+0000","last_unstale":"2023-12-07T00:14:21.367810+0000","last_undegraded":"2023-12-07T00:14:21.367810+0000","last_fullsized":"2023-12-07T00:14:21.367810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:10:44.043162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682934+0000","last_change":"2023-12-07T00:14:13.633584+0000","last_active":"2023-12-07T00:14:19.682934+0000","last_peered":"2023-12-07T00:14:19.682934+0000","last_clean":"2023-12-07T00:14:19.682934+0000","last_became_active":"2023-12-07T00:14:13.633318+0000","last_became_peered":"2023-12-07T00:14:13.633318+0000","last_unstale":"2023-12-07T00:14:19.682934+0000","last_undegraded":"2023-12-07T00:14:19.682934+0000","last_fullsized":"2023-12-07T00:14:19.682934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:27.937653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889684+0000","last_change":"2023-12-07T00:14:14.646779+0000","last_active":"2023-12-07T00:14:19.889684+0000","last_peered":"2023-12-07T00:14:19.889684+0000","last_clean":"2023-12-07T00:14:19.889684+0000","last_became_active":"2023-12-07T00:14:14.646527+0000","last_became_peered":"2023-12-07T00:14:14.646527+0000","last_unstale":"2023-12-07T00:14:19.889684+0000","last_undegraded":"2023-12-07T00:14:19.889684+0000","last_fullsized":"2023-12-07T00:14:19.889684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:27.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367356+0000","last_change":"2023-12-07T00:14:19.073255+0000","last_active":"2023-12-07T00:14:21.367356+0000","last_peered":"2023-12-07T00:14:21.367356+0000","last_clean":"2023-12-07T00:14:21.367356+0000","last_became_active":"2023-12-07T00:14:19.072813+0000","last_became_peered":"2023-12-07T00:14:19.072813+0000","last_unstale":"2023-12-07T00:14:21.367356+0000","last_undegraded":"2023-12-07T00:14:21.367356+0000","last_fullsized":"2023-12-07T00:14:21.367356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:28:56.476351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683628+0000","last_change":"2023-12-07T00:14:13.637391+0000","last_active":"2023-12-07T00:14:19.683628+0000","last_peered":"2023-12-07T00:14:19.683628+0000","last_clean":"2023-12-07T00:14:19.683628+0000","last_became_active":"2023-12-07T00:14:13.636965+0000","last_became_peered":"2023-12-07T00:14:13.636965+0000","last_unstale":"2023-12-07T00:14:19.683628+0000","last_undegraded":"2023-12-07T00:14:19.683628+0000","last_fullsized":"2023-12-07T00:14:19.683628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683105+0000","last_change":"2023-12-07T00:14:14.644444+0000","last_active":"2023-12-07T00:14:19.683105+0000","last_peered":"2023-12-07T00:14:19.683105+0000","last_clean":"2023-12-07T00:14:19.683105+0000","last_became_active":"2023-12-07T00:14:14.644176+0000","last_became_peered":"2023-12-07T00:14:14.644176+0000","last_unstale":"2023-12-07T00:14:19.683105+0000","last_undegraded":"2023-12-07T00:14:19.683105+0000","last_fullsized":"2023-12-07T00:14:19.683105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367421+0000","last_change":"2023-12-07T00:14:18.674600+0000","last_active":"2023-12-07T00:14:21.367421+0000","last_peered":"2023-12-07T00:14:21.367421+0000","last_clean":"2023-12-07T00:14:21.367421+0000","last_became_active":"2023-12-07T00:14:18.674181+0000","last_became_peered":"2023-12-07T00:14:18.674181+0000","last_unstale":"2023-12-07T00:14:21.367421+0000","last_undegraded":"2023-12-07T00:14:21.367421+0000","last_fullsized":"2023-12-07T00:14:21.367421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888243+0000","last_change":"2023-12-07T00:14:13.624390+0000","last_active":"2023-12-07T00:14:19.888243+0000","last_peered":"2023-12-07T00:14:19.888243+0000","last_clean":"2023-12-07T00:14:19.888243+0000","last_became_active":"2023-12-07T00:14:13.624106+0000","last_became_peered":"2023-12-07T00:14:13.624106+0000","last_unstale":"2023-12-07T00:14:19.888243+0000","last_undegraded":"2023-12-07T00:14:19.888243+0000","last_fullsized":"2023-12-07T00:14:19.888243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:20:00.819376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889987+0000","last_change":"2023-12-07T00:14:14.653680+0000","last_active":"2023-12-07T00:14:19.889987+0000","last_peered":"2023-12-07T00:14:19.889987+0000","last_clean":"2023-12-07T00:14:19.889987+0000","last_became_active":"2023-12-07T00:14:14.653401+0000","last_became_peered":"2023-12-07T00:14:14.653401+0000","last_unstale":"2023-12-07T00:14:19.889987+0000","last_undegraded":"2023-12-07T00:14:19.889987+0000","last_fullsized":"2023-12-07T00:14:19.889987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685126+0000","last_change":"2023-12-07T00:14:18.675345+0000","last_active":"2023-12-07T00:14:20.685126+0000","last_peered":"2023-12-07T00:14:20.685126+0000","last_clean":"2023-12-07T00:14:20.685126+0000","last_became_active":"2023-12-07T00:14:18.674896+0000","last_became_peered":"2023-12-07T00:14:18.674896+0000","last_unstale":"2023-12-07T00:14:20.685126+0000","last_undegraded":"2023-12-07T00:14:20.685126+0000","last_fullsized":"2023-12-07T00:14:20.685126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889444+0000","last_change":"2023-12-07T00:14:13.631569+0000","last_active":"2023-12-07T00:14:19.889444+0000","last_peered":"2023-12-07T00:14:19.889444+0000","last_clean":"2023-12-07T00:14:19.889444+0000","last_became_active":"2023-12-07T00:14:13.631324+0000","last_became_peered":"2023-12-07T00:14:13.631324+0000","last_unstale":"2023-12-07T00:14:19.889444+0000","last_undegraded":"2023-12-07T00:14:19.889444+0000","last_fullsized":"2023-12-07T00:14:19.889444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:20.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889942+0000","last_change":"2023-12-07T00:14:14.654814+0000","last_active":"2023-12-07T00:14:19.889942+0000","last_peered":"2023-12-07T00:14:19.889942+0000","last_clean":"2023-12-07T00:14:19.889942+0000","last_became_active":"2023-12-07T00:14:14.654539+0000","last_became_peered":"2023-12-07T00:14:14.654539+0000","last_unstale":"2023-12-07T00:14:19.889942+0000","last_undegraded":"2023-12-07T00:14:19.889942+0000","last_fullsized":"2023-12-07T00:14:19.889942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:32.781991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274758+0000","last_change":"2023-12-07T00:14:18.672450+0000","last_active":"2023-12-07T00:14:21.274758+0000","last_peered":"2023-12-07T00:14:21.274758+0000","last_clean":"2023-12-07T00:14:21.274758+0000","last_became_active":"2023-12-07T00:14:18.671488+0000","last_became_peered":"2023-12-07T00:14:18.671488+0000","last_unstale":"2023-12-07T00:14:21.274758+0000","last_undegraded":"2023-12-07T00:14:21.274758+0000","last_fullsized":"2023-12-07T00:14:21.274758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889341+0000","last_change":"2023-12-07T00:14:13.628825+0000","last_active":"2023-12-07T00:14:19.889341+0000","last_peered":"2023-12-07T00:14:19.889341+0000","last_clean":"2023-12-07T00:14:19.889341+0000","last_became_active":"2023-12-07T00:14:13.628268+0000","last_became_peered":"2023-12-07T00:14:13.628268+0000","last_unstale":"2023-12-07T00:14:19.889341+0000","last_undegraded":"2023-12-07T00:14:19.889341+0000","last_fullsized":"2023-12-07T00:14:19.889341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684300+0000","last_change":"2023-12-07T00:14:14.648381+0000","last_active":"2023-12-07T00:14:19.684300+0000","last_peered":"2023-12-07T00:14:19.684300+0000","last_clean":"2023-12-07T00:14:19.684300+0000","last_became_active":"2023-12-07T00:14:14.647909+0000","last_became_peered":"2023-12-07T00:14:14.647909+0000","last_unstale":"2023-12-07T00:14:19.684300+0000","last_undegraded":"2023-12-07T00:14:19.684300+0000","last_fullsized":"2023-12-07T00:14:19.684300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:24.947977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274850+0000","last_change":"2023-12-07T00:14:18.672792+0000","last_active":"2023-12-07T00:14:21.274850+0000","last_peered":"2023-12-07T00:14:21.274850+0000","last_clean":"2023-12-07T00:14:21.274850+0000","last_became_active":"2023-12-07T00:14:18.672377+0000","last_became_peered":"2023-12-07T00:14:18.672377+0000","last_unstale":"2023-12-07T00:14:21.274850+0000","last_undegraded":"2023-12-07T00:14:21.274850+0000","last_fullsized":"2023-12-07T00:14:21.274850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682851+0000","last_change":"2023-12-07T00:14:13.630678+0000","last_active":"2023-12-07T00:14:19.682851+0000","last_peered":"2023-12-07T00:14:19.682851+0000","last_clean":"2023-12-07T00:14:19.682851+0000","last_became_active":"2023-12-07T00:14:13.630330+0000","last_became_peered":"2023-12-07T00:14:13.630330+0000","last_unstale":"2023-12-07T00:14:19.682851+0000","last_undegraded":"2023-12-07T00:14:19.682851+0000","last_fullsized":"2023-12-07T00:14:19.682851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:39.332777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889755+0000","last_change":"2023-12-07T00:14:14.645768+0000","last_active":"2023-12-07T00:14:19.889755+0000","last_peered":"2023-12-07T00:14:19.889755+0000","last_clean":"2023-12-07T00:14:19.889755+0000","last_became_active":"2023-12-07T00:14:14.645426+0000","last_became_peered":"2023-12-07T00:14:14.645426+0000","last_unstale":"2023-12-07T00:14:19.889755+0000","last_undegraded":"2023-12-07T00:14:19.889755+0000","last_fullsized":"2023-12-07T00:14:19.889755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:24.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.275200+0000","last_change":"2023-12-07T00:14:18.671276+0000","last_active":"2023-12-07T00:14:21.275200+0000","last_peered":"2023-12-07T00:14:21.275200+0000","last_clean":"2023-12-07T00:14:21.275200+0000","last_became_active":"2023-12-07T00:14:18.670847+0000","last_became_peered":"2023-12-07T00:14:18.670847+0000","last_unstale":"2023-12-07T00:14:21.275200+0000","last_undegraded":"2023-12-07T00:14:21.275200+0000","last_fullsized":"2023-12-07T00:14:21.275200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888363+0000","last_change":"2023-12-07T00:14:14.644465+0000","last_active":"2023-12-07T00:14:19.888363+0000","last_peered":"2023-12-07T00:14:19.888363+0000","last_clean":"2023-12-07T00:14:19.888363+0000","last_became_active":"2023-12-07T00:14:14.644158+0000","last_became_peered":"2023-12-07T00:14:14.644158+0000","last_unstale":"2023-12-07T00:14:19.888363+0000","last_undegraded":"2023-12-07T00:14:19.888363+0000","last_fullsized":"2023-12-07T00:14:19.888363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888598+0000","last_change":"2023-12-07T00:14:13.633388+0000","last_active":"2023-12-07T00:14:19.888598+0000","last_peered":"2023-12-07T00:14:19.888598+0000","last_clean":"2023-12-07T00:14:19.888598+0000","last_became_active":"2023-12-07T00:14:13.633091+0000","last_became_peered":"2023-12-07T00:14:13.633091+0000","last_unstale":"2023-12-07T00:14:19.888598+0000","last_undegraded":"2023-12-07T00:14:19.888598+0000","last_fullsized":"2023-12-07T00:14:19.888598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:24:13.479657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.706143+0000","last_change":"2023-12-07T00:14:19.071553+0000","last_active":"2023-12-07T00:14:20.706143+0000","last_peered":"2023-12-07T00:14:20.706143+0000","last_clean":"2023-12-07T00:14:20.706143+0000","last_became_active":"2023-12-07T00:14:19.071152+0000","last_became_peered":"2023-12-07T00:14:19.071152+0000","last_unstale":"2023-12-07T00:14:20.706143+0000","last_undegraded":"2023-12-07T00:14:20.706143+0000","last_fullsized":"2023-12-07T00:14:20.706143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680168+0000","last_change":"2023-12-07T00:14:14.652614+0000","last_active":"2023-12-07T00:14:19.680168+0000","last_peered":"2023-12-07T00:14:19.680168+0000","last_clean":"2023-12-07T00:14:19.680168+0000","last_became_active":"2023-12-07T00:14:14.652330+0000","last_became_peered":"2023-12-07T00:14:14.652330+0000","last_unstale":"2023-12-07T00:14:19.680168+0000","last_undegraded":"2023-12-07T00:14:19.680168+0000","last_fullsized":"2023-12-07T00:14:19.680168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683065+0000","last_change":"2023-12-07T00:14:13.632410+0000","last_active":"2023-12-07T00:14:19.683065+0000","last_peered":"2023-12-07T00:14:19.683065+0000","last_clean":"2023-12-07T00:14:19.683065+0000","last_became_active":"2023-12-07T00:14:13.632131+0000","last_became_peered":"2023-12-07T00:14:13.632131+0000","last_unstale":"2023-12-07T00:14:19.683065+0000","last_undegraded":"2023-12-07T00:14:19.683065+0000","last_fullsized":"2023-12-07T00:14:19.683065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:08.508036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890283+0000","last_change":"2023-12-07T00:14:04.636514+0000","last_active":"2023-12-07T00:14:19.890283+0000","last_peered":"2023-12-07T00:14:19.890283+0000","last_clean":"2023-12-07T00:14:19.890283+0000","last_became_active":"2023-12-07T00:14:04.635540+0000","last_became_peered":"2023-12-07T00:14:04.635540+0000","last_unstale":"2023-12-07T00:14:19.890283+0000","last_undegraded":"2023-12-07T00:14:19.890283+0000","last_fullsized":"2023-12-07T00:14:19.890283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_clean_scrub_stamp":"2023-12-07T00:14:03.541217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:08:01.012662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367559+0000","last_change":"2023-12-07T00:14:19.070256+0000","last_active":"2023-12-07T00:14:21.367559+0000","last_peered":"2023-12-07T00:14:21.367559+0000","last_clean":"2023-12-07T00:14:21.367559+0000","last_became_active":"2023-12-07T00:14:19.069857+0000","last_became_peered":"2023-12-07T00:14:19.069857+0000","last_unstale":"2023-12-07T00:14:21.367559+0000","last_undegraded":"2023-12-07T00:14:21.367559+0000","last_fullsized":"2023-12-07T00:14:21.367559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890041+0000","last_change":"2023-12-07T00:14:14.646599+0000","last_active":"2023-12-07T00:14:19.890041+0000","last_peered":"2023-12-07T00:14:19.890041+0000","last_clean":"2023-12-07T00:14:19.890041+0000","last_became_active":"2023-12-07T00:14:14.646211+0000","last_became_peered":"2023-12-07T00:14:14.646211+0000","last_unstale":"2023-12-07T00:14:19.890041+0000","last_undegraded":"2023-12-07T00:14:19.890041+0000","last_fullsized":"2023-12-07T00:14:19.890041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:05.969623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890386+0000","last_change":"2023-12-07T00:14:13.628132+0000","last_active":"2023-12-07T00:14:19.890386+0000","last_peered":"2023-12-07T00:14:19.890386+0000","last_clean":"2023-12-07T00:14:19.890386+0000","last_became_active":"2023-12-07T00:14:13.627883+0000","last_became_peered":"2023-12-07T00:14:13.627883+0000","last_unstale":"2023-12-07T00:14:19.890386+0000","last_undegraded":"2023-12-07T00:14:19.890386+0000","last_fullsized":"2023-12-07T00:14:19.890386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:08.508036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366914+0000","last_change":"2023-12-07T00:14:19.070287+0000","last_active":"2023-12-07T00:14:21.366914+0000","last_peered":"2023-12-07T00:14:21.366914+0000","last_clean":"2023-12-07T00:14:21.366914+0000","last_became_active":"2023-12-07T00:14:19.069931+0000","last_became_peered":"2023-12-07T00:14:19.069931+0000","last_unstale":"2023-12-07T00:14:21.366914+0000","last_undegraded":"2023-12-07T00:14:21.366914+0000","last_fullsized":"2023-12-07T00:14:21.366914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889775+0000","last_change":"2023-12-07T00:14:13.630867+0000","last_active":"2023-12-07T00:14:19.889775+0000","last_peered":"2023-12-07T00:14:19.889775+0000","last_clean":"2023-12-07T00:14:19.889775+0000","last_became_active":"2023-12-07T00:14:13.630542+0000","last_became_peered":"2023-12-07T00:14:13.630542+0000","last_unstale":"2023-12-07T00:14:19.889775+0000","last_undegraded":"2023-12-07T00:14:19.889775+0000","last_fullsized":"2023-12-07T00:14:19.889775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889492+0000","last_change":"2023-12-07T00:14:14.646636+0000","last_active":"2023-12-07T00:14:19.889492+0000","last_peered":"2023-12-07T00:14:19.889492+0000","last_clean":"2023-12-07T00:14:19.889492+0000","last_became_active":"2023-12-07T00:14:14.645841+0000","last_became_peered":"2023-12-07T00:14:14.645841+0000","last_unstale":"2023-12-07T00:14:19.889492+0000","last_undegraded":"2023-12-07T00:14:19.889492+0000","last_fullsized":"2023-12-07T00:14:19.889492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366975+0000","last_change":"2023-12-07T00:14:19.073292+0000","last_active":"2023-12-07T00:14:21.366975+0000","last_peered":"2023-12-07T00:14:21.366975+0000","last_clean":"2023-12-07T00:14:21.366975+0000","last_became_active":"2023-12-07T00:14:19.072850+0000","last_became_peered":"2023-12-07T00:14:19.072850+0000","last_unstale":"2023-12-07T00:14:21.366975+0000","last_undegraded":"2023-12-07T00:14:21.366975+0000","last_fullsized":"2023-12-07T00:14:21.366975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:35:28.448140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889274+0000","last_change":"2023-12-07T00:14:13.637981+0000","last_active":"2023-12-07T00:14:19.889274+0000","last_peered":"2023-12-07T00:14:19.889274+0000","last_clean":"2023-12-07T00:14:19.889274+0000","last_became_active":"2023-12-07T00:14:13.637648+0000","last_became_peered":"2023-12-07T00:14:13.637648+0000","last_unstale":"2023-12-07T00:14:19.889274+0000","last_undegraded":"2023-12-07T00:14:19.889274+0000","last_fullsized":"2023-12-07T00:14:19.889274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680868+0000","last_change":"2023-12-07T00:14:14.646947+0000","last_active":"2023-12-07T00:14:19.680868+0000","last_peered":"2023-12-07T00:14:19.680868+0000","last_clean":"2023-12-07T00:14:19.680868+0000","last_became_active":"2023-12-07T00:14:14.646649+0000","last_became_peered":"2023-12-07T00:14:14.646649+0000","last_unstale":"2023-12-07T00:14:19.680868+0000","last_undegraded":"2023-12-07T00:14:19.680868+0000","last_fullsized":"2023-12-07T00:14:19.680868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684472+0000","last_change":"2023-12-07T00:14:19.073479+0000","last_active":"2023-12-07T00:14:20.684472+0000","last_peered":"2023-12-07T00:14:20.684472+0000","last_clean":"2023-12-07T00:14:20.684472+0000","last_became_active":"2023-12-07T00:14:19.073084+0000","last_became_peered":"2023-12-07T00:14:19.073084+0000","last_unstale":"2023-12-07T00:14:20.684472+0000","last_undegraded":"2023-12-07T00:14:20.684472+0000","last_fullsized":"2023-12-07T00:14:20.684472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:40.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683778+0000","last_change":"2023-12-07T00:14:13.637916+0000","last_active":"2023-12-07T00:14:19.683778+0000","last_peered":"2023-12-07T00:14:19.683778+0000","last_clean":"2023-12-07T00:14:19.683778+0000","last_became_active":"2023-12-07T00:14:13.637538+0000","last_became_peered":"2023-12-07T00:14:13.637538+0000","last_unstale":"2023-12-07T00:14:19.683778+0000","last_undegraded":"2023-12-07T00:14:19.683778+0000","last_fullsized":"2023-12-07T00:14:19.683778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890503+0000","last_change":"2023-12-07T00:14:14.648223+0000","last_active":"2023-12-07T00:14:19.890503+0000","last_peered":"2023-12-07T00:14:19.890503+0000","last_clean":"2023-12-07T00:14:19.890503+0000","last_became_active":"2023-12-07T00:14:14.647966+0000","last_became_peered":"2023-12-07T00:14:14.647966+0000","last_unstale":"2023-12-07T00:14:19.890503+0000","last_undegraded":"2023-12-07T00:14:19.890503+0000","last_fullsized":"2023-12-07T00:14:19.890503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684860+0000","last_change":"2023-12-07T00:14:18.665311+0000","last_active":"2023-12-07T00:14:20.684860+0000","last_peered":"2023-12-07T00:14:20.684860+0000","last_clean":"2023-12-07T00:14:20.684860+0000","last_became_active":"2023-12-07T00:14:18.664892+0000","last_became_peered":"2023-12-07T00:14:18.664892+0000","last_unstale":"2023-12-07T00:14:20.684860+0000","last_undegraded":"2023-12-07T00:14:20.684860+0000","last_fullsized":"2023-12-07T00:14:20.684860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890458+0000","last_change":"2023-12-07T00:14:13.630986+0000","last_active":"2023-12-07T00:14:19.890458+0000","last_peered":"2023-12-07T00:14:19.890458+0000","last_clean":"2023-12-07T00:14:19.890458+0000","last_became_active":"2023-12-07T00:14:13.630609+0000","last_became_peered":"2023-12-07T00:14:13.630609+0000","last_unstale":"2023-12-07T00:14:19.890458+0000","last_undegraded":"2023-12-07T00:14:19.890458+0000","last_fullsized":"2023-12-07T00:14:19.890458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:53.916550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888978+0000","last_change":"2023-12-07T00:14:14.635608+0000","last_active":"2023-12-07T00:14:19.888978+0000","last_peered":"2023-12-07T00:14:19.888978+0000","last_clean":"2023-12-07T00:14:19.888978+0000","last_became_active":"2023-12-07T00:14:14.635340+0000","last_became_peered":"2023-12-07T00:14:14.635340+0000","last_unstale":"2023-12-07T00:14:19.888978+0000","last_undegraded":"2023-12-07T00:14:19.888978+0000","last_fullsized":"2023-12-07T00:14:19.888978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:54.920912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.275281+0000","last_change":"2023-12-07T00:14:19.071557+0000","last_active":"2023-12-07T00:14:21.275281+0000","last_peered":"2023-12-07T00:14:21.275281+0000","last_clean":"2023-12-07T00:14:21.275281+0000","last_became_active":"2023-12-07T00:14:19.071128+0000","last_became_peered":"2023-12-07T00:14:19.071128+0000","last_unstale":"2023-12-07T00:14:21.275281+0000","last_undegraded":"2023-12-07T00:14:21.275281+0000","last_fullsized":"2023-12-07T00:14:21.275281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:53:14.211329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888538+0000","last_change":"2023-12-07T00:14:13.629382+0000","last_active":"2023-12-07T00:14:19.888538+0000","last_peered":"2023-12-07T00:14:19.888538+0000","last_clean":"2023-12-07T00:14:19.888538+0000","last_became_active":"2023-12-07T00:14:13.629097+0000","last_became_peered":"2023-12-07T00:14:13.629097+0000","last_unstale":"2023-12-07T00:14:19.888538+0000","last_undegraded":"2023-12-07T00:14:19.888538+0000","last_fullsized":"2023-12-07T00:14:19.888538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:23.927140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679917+0000","last_change":"2023-12-07T00:14:14.655117+0000","last_active":"2023-12-07T00:14:19.679917+0000","last_peered":"2023-12-07T00:14:19.679917+0000","last_clean":"2023-12-07T00:14:19.679917+0000","last_became_active":"2023-12-07T00:14:14.652105+0000","last_became_peered":"2023-12-07T00:14:14.652105+0000","last_unstale":"2023-12-07T00:14:19.679917+0000","last_undegraded":"2023-12-07T00:14:19.679917+0000","last_fullsized":"2023-12-07T00:14:19.679917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685032+0000","last_change":"2023-12-07T00:14:18.665600+0000","last_active":"2023-12-07T00:14:20.685032+0000","last_peered":"2023-12-07T00:14:20.685032+0000","last_clean":"2023-12-07T00:14:20.685032+0000","last_became_active":"2023-12-07T00:14:18.664901+0000","last_became_peered":"2023-12-07T00:14:18.664901+0000","last_unstale":"2023-12-07T00:14:20.685032+0000","last_undegraded":"2023-12-07T00:14:20.685032+0000","last_fullsized":"2023-12-07T00:14:20.685032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889054+0000","last_change":"2023-12-07T00:14:13.633312+0000","last_active":"2023-12-07T00:14:19.889054+0000","last_peered":"2023-12-07T00:14:19.889054+0000","last_clean":"2023-12-07T00:14:19.889054+0000","last_became_active":"2023-12-07T00:14:13.633034+0000","last_became_peered":"2023-12-07T00:14:13.633034+0000","last_unstale":"2023-12-07T00:14:19.889054+0000","last_undegraded":"2023-12-07T00:14:19.889054+0000","last_fullsized":"2023-12-07T00:14:19.889054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:04.965261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680317+0000","last_change":"2023-12-07T00:14:14.655550+0000","last_active":"2023-12-07T00:14:19.680317+0000","last_peered":"2023-12-07T00:14:19.680317+0000","last_clean":"2023-12-07T00:14:19.680317+0000","last_became_active":"2023-12-07T00:14:14.651780+0000","last_became_peered":"2023-12-07T00:14:14.651780+0000","last_unstale":"2023-12-07T00:14:19.680317+0000","last_undegraded":"2023-12-07T00:14:19.680317+0000","last_fullsized":"2023-12-07T00:14:19.680317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685294+0000","last_change":"2023-12-07T00:14:18.669658+0000","last_active":"2023-12-07T00:14:20.685294+0000","last_peered":"2023-12-07T00:14:20.685294+0000","last_clean":"2023-12-07T00:14:20.685294+0000","last_became_active":"2023-12-07T00:14:18.669258+0000","last_became_peered":"2023-12-07T00:14:18.669258+0000","last_unstale":"2023-12-07T00:14:20.685294+0000","last_undegraded":"2023-12-07T00:14:20.685294+0000","last_fullsized":"2023-12-07T00:14:20.685294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890157+0000","last_change":"2023-12-07T00:14:13.634671+0000","last_active":"2023-12-07T00:14:19.890157+0000","last_peered":"2023-12-07T00:14:19.890157+0000","last_clean":"2023-12-07T00:14:19.890157+0000","last_became_active":"2023-12-07T00:14:13.634416+0000","last_became_peered":"2023-12-07T00:14:13.634416+0000","last_unstale":"2023-12-07T00:14:19.890157+0000","last_undegraded":"2023-12-07T00:14:19.890157+0000","last_fullsized":"2023-12-07T00:14:19.890157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:15.155566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683669+0000","last_change":"2023-12-07T00:14:14.646535+0000","last_active":"2023-12-07T00:14:19.683669+0000","last_peered":"2023-12-07T00:14:19.683669+0000","last_clean":"2023-12-07T00:14:19.683669+0000","last_became_active":"2023-12-07T00:14:14.646262+0000","last_became_peered":"2023-12-07T00:14:14.646262+0000","last_unstale":"2023-12-07T00:14:19.683669+0000","last_undegraded":"2023-12-07T00:14:19.683669+0000","last_fullsized":"2023-12-07T00:14:19.683669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.705879+0000","last_change":"2023-12-07T00:14:19.070666+0000","last_active":"2023-12-07T00:14:20.705879+0000","last_peered":"2023-12-07T00:14:20.705879+0000","last_clean":"2023-12-07T00:14:20.705879+0000","last_became_active":"2023-12-07T00:14:19.070102+0000","last_became_peered":"2023-12-07T00:14:19.070102+0000","last_unstale":"2023-12-07T00:14:20.705879+0000","last_undegraded":"2023-12-07T00:14:20.705879+0000","last_fullsized":"2023-12-07T00:14:20.705879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:40.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888826+0000","last_change":"2023-12-07T00:14:13.630742+0000","last_active":"2023-12-07T00:14:19.888826+0000","last_peered":"2023-12-07T00:14:19.888826+0000","last_clean":"2023-12-07T00:14:19.888826+0000","last_became_active":"2023-12-07T00:14:13.630467+0000","last_became_peered":"2023-12-07T00:14:13.630467+0000","last_unstale":"2023-12-07T00:14:19.888826+0000","last_undegraded":"2023-12-07T00:14:19.888826+0000","last_fullsized":"2023-12-07T00:14:19.888826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:53.916550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889980+0000","last_change":"2023-12-07T00:14:14.649293+0000","last_active":"2023-12-07T00:14:19.889980+0000","last_peered":"2023-12-07T00:14:19.889980+0000","last_clean":"2023-12-07T00:14:19.889980+0000","last_became_active":"2023-12-07T00:14:14.649021+0000","last_became_peered":"2023-12-07T00:14:14.649021+0000","last_unstale":"2023-12-07T00:14:19.889980+0000","last_undegraded":"2023-12-07T00:14:19.889980+0000","last_fullsized":"2023-12-07T00:14:19.889980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:16.080287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366749+0000","last_change":"2023-12-07T00:14:18.669575+0000","last_active":"2023-12-07T00:14:21.366749+0000","last_peered":"2023-12-07T00:14:21.366749+0000","last_clean":"2023-12-07T00:14:21.366749+0000","last_became_active":"2023-12-07T00:14:18.669100+0000","last_became_peered":"2023-12-07T00:14:18.669100+0000","last_unstale":"2023-12-07T00:14:21.366749+0000","last_undegraded":"2023-12-07T00:14:21.366749+0000","last_fullsized":"2023-12-07T00:14:21.366749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889422+0000","last_change":"2023-12-07T00:14:13.629136+0000","last_active":"2023-12-07T00:14:19.889422+0000","last_peered":"2023-12-07T00:14:19.889422+0000","last_clean":"2023-12-07T00:14:19.889422+0000","last_became_active":"2023-12-07T00:14:13.628827+0000","last_became_peered":"2023-12-07T00:14:13.628827+0000","last_unstale":"2023-12-07T00:14:19.889422+0000","last_undegraded":"2023-12-07T00:14:19.889422+0000","last_fullsized":"2023-12-07T00:14:19.889422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683381+0000","last_change":"2023-12-07T00:14:14.647552+0000","last_active":"2023-12-07T00:14:19.683381+0000","last_peered":"2023-12-07T00:14:19.683381+0000","last_clean":"2023-12-07T00:14:19.683381+0000","last_became_active":"2023-12-07T00:14:14.647247+0000","last_became_peered":"2023-12-07T00:14:14.647247+0000","last_unstale":"2023-12-07T00:14:19.683381+0000","last_undegraded":"2023-12-07T00:14:19.683381+0000","last_fullsized":"2023-12-07T00:14:19.683381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367215+0000","last_change":"2023-12-07T00:14:19.073305+0000","last_active":"2023-12-07T00:14:21.367215+0000","last_peered":"2023-12-07T00:14:21.367215+0000","last_clean":"2023-12-07T00:14:21.367215+0000","last_became_active":"2023-12-07T00:14:19.072907+0000","last_became_peered":"2023-12-07T00:14:19.072907+0000","last_unstale":"2023-12-07T00:14:21.367215+0000","last_undegraded":"2023-12-07T00:14:21.367215+0000","last_fullsized":"2023-12-07T00:14:21.367215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:53:14.211329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889029+0000","last_change":"2023-12-07T00:14:13.626391+0000","last_active":"2023-12-07T00:14:19.889029+0000","last_peered":"2023-12-07T00:14:19.889029+0000","last_clean":"2023-12-07T00:14:19.889029+0000","last_became_active":"2023-12-07T00:14:13.626017+0000","last_became_peered":"2023-12-07T00:14:13.626017+0000","last_unstale":"2023-12-07T00:14:19.889029+0000","last_undegraded":"2023-12-07T00:14:19.889029+0000","last_fullsized":"2023-12-07T00:14:19.889029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:02:04.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890256+0000","last_change":"2023-12-07T00:14:14.647419+0000","last_active":"2023-12-07T00:14:19.890256+0000","last_peered":"2023-12-07T00:14:19.890256+0000","last_clean":"2023-12-07T00:14:19.890256+0000","last_became_active":"2023-12-07T00:14:14.647169+0000","last_became_peered":"2023-12-07T00:14:14.647169+0000","last_unstale":"2023-12-07T00:14:19.890256+0000","last_undegraded":"2023-12-07T00:14:19.890256+0000","last_fullsized":"2023-12-07T00:14:19.890256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:36.710499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683191+0000","last_change":"2023-12-07T00:14:14.643376+0000","last_active":"2023-12-07T00:14:19.683191+0000","last_peered":"2023-12-07T00:14:19.683191+0000","last_clean":"2023-12-07T00:14:19.683191+0000","last_became_active":"2023-12-07T00:14:14.643090+0000","last_became_peered":"2023-12-07T00:14:14.643090+0000","last_unstale":"2023-12-07T00:14:19.683191+0000","last_undegraded":"2023-12-07T00:14:19.683191+0000","last_fullsized":"2023-12-07T00:14:19.683191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888376+0000","last_change":"2023-12-07T00:14:14.639433+0000","last_active":"2023-12-07T00:14:19.888376+0000","last_peered":"2023-12-07T00:14:19.888376+0000","last_clean":"2023-12-07T00:14:19.888376+0000","last_became_active":"2023-12-07T00:14:14.639177+0000","last_became_peered":"2023-12-07T00:14:14.639177+0000","last_unstale":"2023-12-07T00:14:19.888376+0000","last_undegraded":"2023-12-07T00:14:19.888376+0000","last_fullsized":"2023-12-07T00:14:19.888376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:09.512398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682993+0000","last_change":"2023-12-07T00:14:14.647105+0000","last_active":"2023-12-07T00:14:19.682993+0000","last_peered":"2023-12-07T00:14:19.682993+0000","last_clean":"2023-12-07T00:14:19.682993+0000","last_became_active":"2023-12-07T00:14:14.646811+0000","last_became_peered":"2023-12-07T00:14:14.646811+0000","last_unstale":"2023-12-07T00:14:19.682993+0000","last_undegraded":"2023-12-07T00:14:19.682993+0000","last_fullsized":"2023-12-07T00:14:19.682993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:27.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889051+0000","last_change":"2023-12-07T00:14:14.658213+0000","last_active":"2023-12-07T00:14:19.889051+0000","last_peered":"2023-12-07T00:14:19.889051+0000","last_clean":"2023-12-07T00:14:19.889051+0000","last_became_active":"2023-12-07T00:14:14.657944+0000","last_became_peered":"2023-12-07T00:14:14.657944+0000","last_unstale":"2023-12-07T00:14:19.889051+0000","last_undegraded":"2023-12-07T00:14:19.889051+0000","last_fullsized":"2023-12-07T00:14:19.889051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680455+0000","last_change":"2023-12-07T00:14:14.650342+0000","last_active":"2023-12-07T00:14:19.680455+0000","last_peered":"2023-12-07T00:14:19.680455+0000","last_clean":"2023-12-07T00:14:19.680455+0000","last_became_active":"2023-12-07T00:14:14.650042+0000","last_became_peered":"2023-12-07T00:14:14.650042+0000","last_unstale":"2023-12-07T00:14:19.680455+0000","last_undegraded":"2023-12-07T00:14:19.680455+0000","last_fullsized":"2023-12-07T00:14:19.680455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889376+0000","last_change":"2023-12-07T00:14:14.649194+0000","last_active":"2023-12-07T00:14:19.889376+0000","last_peered":"2023-12-07T00:14:19.889376+0000","last_clean":"2023-12-07T00:14:19.889376+0000","last_became_active":"2023-12-07T00:14:14.648929+0000","last_became_peered":"2023-12-07T00:14:14.648929+0000","last_unstale":"2023-12-07T00:14:19.889376+0000","last_undegraded":"2023-12-07T00:14:19.889376+0000","last_fullsized":"2023-12-07T00:14:19.889376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683509+0000","last_change":"2023-12-07T00:14:14.643466+0000","last_active":"2023-12-07T00:14:19.683509+0000","last_peered":"2023-12-07T00:14:19.683509+0000","last_clean":"2023-12-07T00:14:19.683509+0000","last_became_active":"2023-12-07T00:14:14.643195+0000","last_became_peered":"2023-12-07T00:14:14.643195+0000","last_unstale":"2023-12-07T00:14:19.683509+0000","last_undegraded":"2023-12-07T00:14:19.683509+0000","last_fullsized":"2023-12-07T00:14:19.683509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680917+0000","last_change":"2023-12-07T00:14:14.647201+0000","last_active":"2023-12-07T00:14:19.680917+0000","last_peered":"2023-12-07T00:14:19.680917+0000","last_clean":"2023-12-07T00:14:19.680917+0000","last_became_active":"2023-12-07T00:14:14.646844+0000","last_became_peered":"2023-12-07T00:14:14.646844+0000","last_unstale":"2023-12-07T00:14:19.680917+0000","last_undegraded":"2023-12-07T00:14:19.680917+0000","last_fullsized":"2023-12-07T00:14:19.680917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682760+0000","last_change":"2023-12-07T00:14:14.652468+0000","last_active":"2023-12-07T00:14:19.682760+0000","last_peered":"2023-12-07T00:14:19.682760+0000","last_clean":"2023-12-07T00:14:19.682760+0000","last_became_active":"2023-12-07T00:14:14.652125+0000","last_became_peered":"2023-12-07T00:14:14.652125+0000","last_unstale":"2023-12-07T00:14:19.682760+0000","last_undegraded":"2023-12-07T00:14:19.682760+0000","last_fullsized":"2023-12-07T00:14:19.682760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680075+0000","last_change":"2023-12-07T00:14:14.646216+0000","last_active":"2023-12-07T00:14:19.680075+0000","last_peered":"2023-12-07T00:14:19.680075+0000","last_clean":"2023-12-07T00:14:19.680075+0000","last_became_active":"2023-12-07T00:14:14.645667+0000","last_became_peered":"2023-12-07T00:14:14.645667+0000","last_unstale":"2023-12-07T00:14:19.680075+0000","last_undegraded":"2023-12-07T00:14:19.680075+0000","last_fullsized":"2023-12-07T00:14:19.680075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683019+0000","last_change":"2023-12-07T00:14:14.643268+0000","last_active":"2023-12-07T00:14:19.683019+0000","last_peered":"2023-12-07T00:14:19.683019+0000","last_clean":"2023-12-07T00:14:19.683019+0000","last_became_active":"2023-12-07T00:14:14.642911+0000","last_became_peered":"2023-12-07T00:14:14.642911+0000","last_unstale":"2023-12-07T00:14:19.683019+0000","last_undegraded":"2023-12-07T00:14:19.683019+0000","last_fullsized":"2023-12-07T00:14:19.683019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889125+0000","last_change":"2023-12-07T00:14:14.654077+0000","last_active":"2023-12-07T00:14:19.889125+0000","last_peered":"2023-12-07T00:14:19.889125+0000","last_clean":"2023-12-07T00:14:19.889125+0000","last_became_active":"2023-12-07T00:14:14.653784+0000","last_became_peered":"2023-12-07T00:14:14.653784+0000","last_unstale":"2023-12-07T00:14:19.889125+0000","last_undegraded":"2023-12-07T00:14:19.889125+0000","last_fullsized":"2023-12-07T00:14:19.889125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:14.081556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683657+0000","last_change":"2023-12-07T00:14:14.647010+0000","last_active":"2023-12-07T00:14:19.683657+0000","last_peered":"2023-12-07T00:14:19.683657+0000","last_clean":"2023-12-07T00:14:19.683657+0000","last_became_active":"2023-12-07T00:14:14.646731+0000","last_became_peered":"2023-12-07T00:14:14.646731+0000","last_unstale":"2023-12-07T00:14:19.683657+0000","last_undegraded":"2023-12-07T00:14:19.683657+0000","last_fullsized":"2023-12-07T00:14:19.683657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":707149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":116359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":897024,"data_stored":707205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":116325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":116289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T00:14:32.810 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T00:14:32.965 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.966+0000 7fdbd1cb4700 1 Processor -- start 2023-12-07T00:14:32.965 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.966+0000 7fdbd1cb4700 1 -- start start 2023-12-07T00:14:32.967 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbd1cb4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc06e7e0 0x7fdbcc15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbd1cb4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdbcc15f220 0x7fdbcc0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbd1cb4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc15e850 con 0x7fdbcc144330 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbd1cb4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc15e520 con 0x7fdbcc15f220 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbd1cb4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc144710 con 0x7fdbcc06e7e0 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdbcc15f220 0x7fdbcc0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcbfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdbcc15f220 0x7fdbcc0b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39252/0 (socket says 172.21.15.179:39252) 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcbfff700 1 -- 172.21.15.179:0/3590501979 learned_addr learned my addr 172.21.15.179:0/3590501979 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcb7fe700 1 --1- 172.21.15.179:0/3590501979 >> v1:172.21.15.179:6789/0 conn(0x7fdbcc144330 0x7fdbcc15af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46150/0 (socket says 172.21.15.179:46150) 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcaffd700 1 --2- 172.21.15.179:0/3590501979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc06e7e0 0x7fdbcc15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcbfff700 1 -- 172.21.15.179:0/3590501979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc06e7e0 msgr2=0x7fdbcc15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcbfff700 1 --2- 172.21.15.179:0/3590501979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc06e7e0 0x7fdbcc15ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcbfff700 1 -- 172.21.15.179:0/3590501979 >> v1:172.21.15.179:6789/0 conn(0x7fdbcc144330 legacy=0x7fdbcc15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcbfff700 1 -- 172.21.15.179:0/3590501979 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc15b7f0 con 0x7fdbcc15f220 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.967+0000 7fdbcbfff700 1 --2- 172.21.15.179:0/3590501979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc0b3270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009e50 tx=0x7fdbc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a988ce7903365511 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbca7fc700 1 -- 172.21.15.179:0/3590501979 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400e070 con 0x7fdbcc15f220 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbca7fc700 1 -- 172.21.15.179:0/3590501979 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc400b9c0 con 0x7fdbcc15f220 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbca7fc700 1 -- 172.21.15.179:0/3590501979 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400bd70 con 0x7fdbcc15f220 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/3590501979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 msgr2=0x7fdbcc0b3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/3590501979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc0b3270 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009e50 tx=0x7fdbc400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/3590501979 shutdown_connections 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/3590501979 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc0b3270 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/3590501979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc06e7e0 0x7fdbcc15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/3590501979 >> 172.21.15.179:0/3590501979 conn(0x7fdbcc06b150 msgr2=0x7fdbcc06b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/3590501979 shutdown_connections 2023-12-07T00:14:32.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.968+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/3590501979 wait complete. 2023-12-07T00:14:32.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.969+0000 7fdbd1cb4700 1 Processor -- start 2023-12-07T00:14:32.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbd1cb4700 1 -- start start 2023-12-07T00:14:32.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbd1cb4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbcc06e7e0 0x7fdbcc159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbd1cb4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc144330 0x7fdbcc13a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.973 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbd1cb4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc133940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbd1cb4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc15a890 con 0x7fdbcc15f220 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbd1cb4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc13a9d0 con 0x7fdbcc06e7e0 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbd1cb4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc13acb0 con 0x7fdbcc144330 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbcbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc133940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbcbfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc133940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39258/0 (socket says 172.21.15.179:39258) 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.970+0000 7fdbcbfff700 1 -- 172.21.15.179:0/2374526177 learned_addr learned my addr 172.21.15.179:0/2374526177 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcaffd700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc144330 0x7fdbcc13a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcb7fe700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbcc06e7e0 0x7fdbcc159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcbfff700 1 -- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc144330 msgr2=0x7fdbcc13a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcbfff700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc144330 0x7fdbcc13a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcbfff700 1 -- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbcc06e7e0 msgr2=0x7fdbcc159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcbfff700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbcc06e7e0 0x7fdbcc159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcbfff700 1 -- 172.21.15.179:0/2374526177 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4009b30 con 0x7fdbcc15f220 2023-12-07T00:14:32.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcaffd700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc144330 0x7fdbcc13a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcb7fe700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbcc06e7e0 0x7fdbcc159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbcbfff700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc133940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4012000 tx=0x7fdbc4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbb3fff700 1 -- 172.21.15.179:0/2374526177 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4004960 con 0x7fdbcc15f220 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbb3fff700 1 -- 172.21.15.179:0/2374526177 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc40092e0 con 0x7fdbcc15f220 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc13af90 con 0x7fdbcc15f220 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbb3fff700 1 -- 172.21.15.179:0/2374526177 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc401b650 con 0x7fdbcc15f220 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.971+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc137bf0 con 0x7fdbcc15f220 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.972+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc137d80 con 0x7fdbcc15f220 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.972+0000 7fdbb3fff700 1 -- 172.21.15.179:0/2374526177 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbc401b7b0 con 0x7fdbcc15f220 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.973+0000 7fdbb3fff700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdbb806aed0 0x7fdbb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.973+0000 7fdbb3fff700 1 -- 172.21.15.179:0/2374526177 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdbc408ae90 con 0x7fdbcc15f220 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.973+0000 7fdbcb7fe700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdbb806aed0 0x7fdbb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:32.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.973+0000 7fdbcb7fe700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdbb806aed0 0x7fdbb806d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0000f60 tx=0x7fdbc0007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:32.976 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:32.977+0000 7fdbb3fff700 1 -- 172.21.15.179:0/2374526177 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdbc4055d90 con 0x7fdbcc15f220 2023-12-07T00:14:33.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.164+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 --> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbcc15bdb0 con 0x7fdbb806aed0 2023-12-07T00:14:33.172 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.173+0000 7fdbb3fff700 1 -- 172.21.15.179:0/2374526177 <== mgr.4104 v2:172.21.15.179:6832/1592863421 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345304 (secure 0 0 0) 0x7fdbc0005cd0 con 0x7fdbb806aed0 2023-12-07T00:14:33.176 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.176+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdbb806aed0 msgr2=0x7fdbb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.176+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdbb806aed0 0x7fdbb806d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0000f60 tx=0x7fdbc0007dd0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.176+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 msgr2=0x7fdbcc133940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.176+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc133940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4012000 tx=0x7fdbc4004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.176+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 shutdown_connections 2023-12-07T00:14:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.176+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdbb806aed0 0x7fdbb806d390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.177+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdbcc15f220 0x7fdbcc133940 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.179 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.177+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbcc06e7e0 0x7fdbcc159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.177+0000 7fdbd1cb4700 1 --2- 172.21.15.179:0/2374526177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbcc144330 0x7fdbcc13a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.177+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 >> 172.21.15.179:0/2374526177 conn(0x7fdbcc06b150 msgr2=0x7fdbcc15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:33.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.177+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 shutdown_connections 2023-12-07T00:14:33.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.177+0000 7fdbd1cb4700 1 -- 172.21.15.179:0/2374526177 wait complete. 2023-12-07T00:14:33.180 INFO:teuthology.orchestra.run.smithi179.stderr:dumped all 2023-12-07T00:14:33.188 INFO:teuthology.orchestra.run.smithi179.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-12-07T00:14:32.517271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3579904,"data_stored":2119604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2228,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.834978"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890228+0000","last_change":"2023-12-07T00:14:14.643199+0000","last_active":"2023-12-07T00:14:19.890228+0000","last_peered":"2023-12-07T00:14:19.890228+0000","last_clean":"2023-12-07T00:14:19.890228+0000","last_became_active":"2023-12-07T00:14:14.642929+0000","last_became_peered":"2023-12-07T00:14:14.642929+0000","last_unstale":"2023-12-07T00:14:19.890228+0000","last_undegraded":"2023-12-07T00:14:19.890228+0000","last_fullsized":"2023-12-07T00:14:19.890228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:20:09.627523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889353+0000","last_change":"2023-12-07T00:14:14.644949+0000","last_active":"2023-12-07T00:14:19.889353+0000","last_peered":"2023-12-07T00:14:19.889353+0000","last_clean":"2023-12-07T00:14:19.889353+0000","last_became_active":"2023-12-07T00:14:14.644679+0000","last_became_peered":"2023-12-07T00:14:14.644679+0000","last_unstale":"2023-12-07T00:14:19.889353+0000","last_undegraded":"2023-12-07T00:14:19.889353+0000","last_fullsized":"2023-12-07T00:14:19.889353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889573+0000","last_change":"2023-12-07T00:14:14.645513+0000","last_active":"2023-12-07T00:14:19.889573+0000","last_peered":"2023-12-07T00:14:19.889573+0000","last_clean":"2023-12-07T00:14:19.889573+0000","last_became_active":"2023-12-07T00:14:14.645261+0000","last_became_peered":"2023-12-07T00:14:14.645261+0000","last_unstale":"2023-12-07T00:14:19.889573+0000","last_undegraded":"2023-12-07T00:14:19.889573+0000","last_fullsized":"2023-12-07T00:14:19.889573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683459+0000","last_change":"2023-12-07T00:14:14.646952+0000","last_active":"2023-12-07T00:14:19.683459+0000","last_peered":"2023-12-07T00:14:19.683459+0000","last_clean":"2023-12-07T00:14:19.683459+0000","last_became_active":"2023-12-07T00:14:14.646645+0000","last_became_peered":"2023-12-07T00:14:14.646645+0000","last_unstale":"2023-12-07T00:14:19.683459+0000","last_undegraded":"2023-12-07T00:14:19.683459+0000","last_fullsized":"2023-12-07T00:14:19.683459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889608+0000","last_change":"2023-12-07T00:14:14.645840+0000","last_active":"2023-12-07T00:14:19.889608+0000","last_peered":"2023-12-07T00:14:19.889608+0000","last_clean":"2023-12-07T00:14:19.889608+0000","last_became_active":"2023-12-07T00:14:14.645226+0000","last_became_peered":"2023-12-07T00:14:14.645226+0000","last_unstale":"2023-12-07T00:14:19.889608+0000","last_undegraded":"2023-12-07T00:14:19.889608+0000","last_fullsized":"2023-12-07T00:14:19.889608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:24.947977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683090+0000","last_change":"2023-12-07T00:14:14.642310+0000","last_active":"2023-12-07T00:14:19.683090+0000","last_peered":"2023-12-07T00:14:19.683090+0000","last_clean":"2023-12-07T00:14:19.683090+0000","last_became_active":"2023-12-07T00:14:14.642041+0000","last_became_peered":"2023-12-07T00:14:14.642041+0000","last_unstale":"2023-12-07T00:14:19.683090+0000","last_undegraded":"2023-12-07T00:14:19.683090+0000","last_fullsized":"2023-12-07T00:14:19.683090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:20:09.627523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889514+0000","last_change":"2023-12-07T00:14:14.651174+0000","last_active":"2023-12-07T00:14:19.889514+0000","last_peered":"2023-12-07T00:14:19.889514+0000","last_clean":"2023-12-07T00:14:19.889514+0000","last_became_active":"2023-12-07T00:14:14.650891+0000","last_became_peered":"2023-12-07T00:14:14.650891+0000","last_unstale":"2023-12-07T00:14:19.889514+0000","last_undegraded":"2023-12-07T00:14:19.889514+0000","last_fullsized":"2023-12-07T00:14:19.889514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680378+0000","last_change":"2023-12-07T00:14:14.651410+0000","last_active":"2023-12-07T00:14:19.680378+0000","last_peered":"2023-12-07T00:14:19.680378+0000","last_clean":"2023-12-07T00:14:19.680378+0000","last_became_active":"2023-12-07T00:14:14.651150+0000","last_became_peered":"2023-12-07T00:14:14.651150+0000","last_unstale":"2023-12-07T00:14:19.680378+0000","last_undegraded":"2023-12-07T00:14:19.680378+0000","last_fullsized":"2023-12-07T00:14:19.680378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890130+0000","last_change":"2023-12-07T00:14:14.649568+0000","last_active":"2023-12-07T00:14:19.890130+0000","last_peered":"2023-12-07T00:14:19.890130+0000","last_clean":"2023-12-07T00:14:19.890130+0000","last_became_active":"2023-12-07T00:14:14.649226+0000","last_became_peered":"2023-12-07T00:14:14.649226+0000","last_unstale":"2023-12-07T00:14:19.890130+0000","last_undegraded":"2023-12-07T00:14:19.890130+0000","last_fullsized":"2023-12-07T00:14:19.890130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683413+0000","last_change":"2023-12-07T00:14:14.641982+0000","last_active":"2023-12-07T00:14:19.683413+0000","last_peered":"2023-12-07T00:14:19.683413+0000","last_clean":"2023-12-07T00:14:19.683413+0000","last_became_active":"2023-12-07T00:14:14.641635+0000","last_became_peered":"2023-12-07T00:14:14.641635+0000","last_unstale":"2023-12-07T00:14:19.683413+0000","last_undegraded":"2023-12-07T00:14:19.683413+0000","last_fullsized":"2023-12-07T00:14:19.683413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683349+0000","last_change":"2023-12-07T00:14:14.641705+0000","last_active":"2023-12-07T00:14:19.683349+0000","last_peered":"2023-12-07T00:14:19.683349+0000","last_clean":"2023-12-07T00:14:19.683349+0000","last_became_active":"2023-12-07T00:14:14.640554+0000","last_became_peered":"2023-12-07T00:14:14.640554+0000","last_unstale":"2023-12-07T00:14:19.683349+0000","last_undegraded":"2023-12-07T00:14:19.683349+0000","last_fullsized":"2023-12-07T00:14:19.683349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890100+0000","last_change":"2023-12-07T00:14:14.638208+0000","last_active":"2023-12-07T00:14:19.890100+0000","last_peered":"2023-12-07T00:14:19.890100+0000","last_clean":"2023-12-07T00:14:19.890100+0000","last_became_active":"2023-12-07T00:14:14.637940+0000","last_became_peered":"2023-12-07T00:14:14.637940+0000","last_unstale":"2023-12-07T00:14:19.890100+0000","last_undegraded":"2023-12-07T00:14:19.890100+0000","last_fullsized":"2023-12-07T00:14:19.890100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:09.512398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680049+0000","last_change":"2023-12-07T00:14:14.655710+0000","last_active":"2023-12-07T00:14:19.680049+0000","last_peered":"2023-12-07T00:14:19.680049+0000","last_clean":"2023-12-07T00:14:19.680049+0000","last_became_active":"2023-12-07T00:14:14.652457+0000","last_became_peered":"2023-12-07T00:14:14.652457+0000","last_unstale":"2023-12-07T00:14:19.680049+0000","last_undegraded":"2023-12-07T00:14:19.680049+0000","last_fullsized":"2023-12-07T00:14:19.680049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889539+0000","last_change":"2023-12-07T00:14:14.654290+0000","last_active":"2023-12-07T00:14:19.889539+0000","last_peered":"2023-12-07T00:14:19.889539+0000","last_clean":"2023-12-07T00:14:19.889539+0000","last_became_active":"2023-12-07T00:14:14.654021+0000","last_became_peered":"2023-12-07T00:14:14.654021+0000","last_unstale":"2023-12-07T00:14:19.889539+0000","last_undegraded":"2023-12-07T00:14:19.889539+0000","last_fullsized":"2023-12-07T00:14:19.889539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:18.698925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888456+0000","last_change":"2023-12-07T00:14:14.646526+0000","last_active":"2023-12-07T00:14:19.888456+0000","last_peered":"2023-12-07T00:14:19.888456+0000","last_clean":"2023-12-07T00:14:19.888456+0000","last_became_active":"2023-12-07T00:14:14.646114+0000","last_became_peered":"2023-12-07T00:14:14.646114+0000","last_unstale":"2023-12-07T00:14:19.888456+0000","last_undegraded":"2023-12-07T00:14:19.888456+0000","last_fullsized":"2023-12-07T00:14:19.888456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682644+0000","last_change":"2023-12-07T00:14:14.642157+0000","last_active":"2023-12-07T00:14:19.682644+0000","last_peered":"2023-12-07T00:14:19.682644+0000","last_clean":"2023-12-07T00:14:19.682644+0000","last_became_active":"2023-12-07T00:14:14.641857+0000","last_became_peered":"2023-12-07T00:14:14.641857+0000","last_unstale":"2023-12-07T00:14:19.682644+0000","last_undegraded":"2023-12-07T00:14:19.682644+0000","last_fullsized":"2023-12-07T00:14:19.682644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684069+0000","last_change":"2023-12-07T00:14:14.643563+0000","last_active":"2023-12-07T00:14:19.684069+0000","last_peered":"2023-12-07T00:14:19.684069+0000","last_clean":"2023-12-07T00:14:19.684069+0000","last_became_active":"2023-12-07T00:14:14.643055+0000","last_became_peered":"2023-12-07T00:14:14.643055+0000","last_unstale":"2023-12-07T00:14:19.684069+0000","last_undegraded":"2023-12-07T00:14:19.684069+0000","last_fullsized":"2023-12-07T00:14:19.684069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:36.710499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889136+0000","last_change":"2023-12-07T00:14:14.636014+0000","last_active":"2023-12-07T00:14:19.889136+0000","last_peered":"2023-12-07T00:14:19.889136+0000","last_clean":"2023-12-07T00:14:19.889136+0000","last_became_active":"2023-12-07T00:14:14.635717+0000","last_became_peered":"2023-12-07T00:14:14.635717+0000","last_unstale":"2023-12-07T00:14:19.889136+0000","last_undegraded":"2023-12-07T00:14:19.889136+0000","last_fullsized":"2023-12-07T00:14:19.889136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:24.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890290+0000","last_change":"2023-12-07T00:14:14.645014+0000","last_active":"2023-12-07T00:14:19.890290+0000","last_peered":"2023-12-07T00:14:19.890290+0000","last_clean":"2023-12-07T00:14:19.890290+0000","last_became_active":"2023-12-07T00:14:14.644738+0000","last_became_peered":"2023-12-07T00:14:14.644738+0000","last_unstale":"2023-12-07T00:14:19.890290+0000","last_undegraded":"2023-12-07T00:14:19.890290+0000","last_fullsized":"2023-12-07T00:14:19.890290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367254+0000","last_change":"2023-12-07T00:14:19.076496+0000","last_active":"2023-12-07T00:14:21.367254+0000","last_peered":"2023-12-07T00:14:21.367254+0000","last_clean":"2023-12-07T00:14:21.367254+0000","last_became_active":"2023-12-07T00:14:19.076104+0000","last_became_peered":"2023-12-07T00:14:19.076104+0000","last_unstale":"2023-12-07T00:14:21.367254+0000","last_undegraded":"2023-12-07T00:14:21.367254+0000","last_fullsized":"2023-12-07T00:14:21.367254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:19:30.998083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889786+0000","last_change":"2023-12-07T00:14:13.630530+0000","last_active":"2023-12-07T00:14:19.889786+0000","last_peered":"2023-12-07T00:14:19.889786+0000","last_clean":"2023-12-07T00:14:19.889786+0000","last_became_active":"2023-12-07T00:14:13.630248+0000","last_became_peered":"2023-12-07T00:14:13.630248+0000","last_unstale":"2023-12-07T00:14:19.889786+0000","last_undegraded":"2023-12-07T00:14:19.889786+0000","last_fullsized":"2023-12-07T00:14:19.889786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680935+0000","last_change":"2023-12-07T00:14:14.650100+0000","last_active":"2023-12-07T00:14:19.680935+0000","last_peered":"2023-12-07T00:14:19.680935+0000","last_clean":"2023-12-07T00:14:19.680935+0000","last_became_active":"2023-12-07T00:14:14.649807+0000","last_became_peered":"2023-12-07T00:14:14.649807+0000","last_unstale":"2023-12-07T00:14:19.680935+0000","last_undegraded":"2023-12-07T00:14:19.680935+0000","last_fullsized":"2023-12-07T00:14:19.680935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684337+0000","last_change":"2023-12-07T00:14:18.665602+0000","last_active":"2023-12-07T00:14:20.684337+0000","last_peered":"2023-12-07T00:14:20.684337+0000","last_clean":"2023-12-07T00:14:20.684337+0000","last_became_active":"2023-12-07T00:14:18.665065+0000","last_became_peered":"2023-12-07T00:14:18.665065+0000","last_unstale":"2023-12-07T00:14:20.684337+0000","last_undegraded":"2023-12-07T00:14:20.684337+0000","last_fullsized":"2023-12-07T00:14:20.684337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:28.978624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680641+0000","last_change":"2023-12-07T00:14:13.635320+0000","last_active":"2023-12-07T00:14:19.680641+0000","last_peered":"2023-12-07T00:14:19.680641+0000","last_clean":"2023-12-07T00:14:19.680641+0000","last_became_active":"2023-12-07T00:14:13.635008+0000","last_became_peered":"2023-12-07T00:14:13.635008+0000","last_unstale":"2023-12-07T00:14:19.680641+0000","last_undegraded":"2023-12-07T00:14:19.680641+0000","last_fullsized":"2023-12-07T00:14:19.680641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:17.694563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889743+0000","last_change":"2023-12-07T00:14:14.642235+0000","last_active":"2023-12-07T00:14:19.889743+0000","last_peered":"2023-12-07T00:14:19.889743+0000","last_clean":"2023-12-07T00:14:19.889743+0000","last_became_active":"2023-12-07T00:14:14.641920+0000","last_became_peered":"2023-12-07T00:14:14.641920+0000","last_unstale":"2023-12-07T00:14:19.889743+0000","last_undegraded":"2023-12-07T00:14:19.889743+0000","last_fullsized":"2023-12-07T00:14:19.889743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684737+0000","last_change":"2023-12-07T00:14:18.665909+0000","last_active":"2023-12-07T00:14:20.684737+0000","last_peered":"2023-12-07T00:14:20.684737+0000","last_clean":"2023-12-07T00:14:20.684737+0000","last_became_active":"2023-12-07T00:14:18.665195+0000","last_became_peered":"2023-12-07T00:14:18.665195+0000","last_unstale":"2023-12-07T00:14:20.684737+0000","last_undegraded":"2023-12-07T00:14:20.684737+0000","last_fullsized":"2023-12-07T00:14:20.684737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:36.812638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889883+0000","last_change":"2023-12-07T00:14:13.639070+0000","last_active":"2023-12-07T00:14:19.889883+0000","last_peered":"2023-12-07T00:14:19.889883+0000","last_clean":"2023-12-07T00:14:19.889883+0000","last_became_active":"2023-12-07T00:14:13.638806+0000","last_became_peered":"2023-12-07T00:14:13.638806+0000","last_unstale":"2023-12-07T00:14:19.889883+0000","last_undegraded":"2023-12-07T00:14:19.889883+0000","last_fullsized":"2023-12-07T00:14:19.889883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:17.694563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683306+0000","last_change":"2023-12-07T00:14:14.638446+0000","last_active":"2023-12-07T00:14:19.683306+0000","last_peered":"2023-12-07T00:14:19.683306+0000","last_clean":"2023-12-07T00:14:19.683306+0000","last_became_active":"2023-12-07T00:14:14.638158+0000","last_became_peered":"2023-12-07T00:14:14.638158+0000","last_unstale":"2023-12-07T00:14:19.683306+0000","last_undegraded":"2023-12-07T00:14:19.683306+0000","last_fullsized":"2023-12-07T00:14:19.683306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684589+0000","last_change":"2023-12-07T00:14:18.669676+0000","last_active":"2023-12-07T00:14:20.684589+0000","last_peered":"2023-12-07T00:14:20.684589+0000","last_clean":"2023-12-07T00:14:20.684589+0000","last_became_active":"2023-12-07T00:14:18.669279+0000","last_became_peered":"2023-12-07T00:14:18.669279+0000","last_unstale":"2023-12-07T00:14:20.684589+0000","last_undegraded":"2023-12-07T00:14:20.684589+0000","last_fullsized":"2023-12-07T00:14:20.684589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:31.897202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889817+0000","last_change":"2023-12-07T00:14:13.635829+0000","last_active":"2023-12-07T00:14:19.889817+0000","last_peered":"2023-12-07T00:14:19.889817+0000","last_clean":"2023-12-07T00:14:19.889817+0000","last_became_active":"2023-12-07T00:14:13.635554+0000","last_became_peered":"2023-12-07T00:14:13.635554+0000","last_unstale":"2023-12-07T00:14:19.889817+0000","last_undegraded":"2023-12-07T00:14:19.889817+0000","last_fullsized":"2023-12-07T00:14:19.889817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684138+0000","last_change":"2023-12-07T00:14:14.638063+0000","last_active":"2023-12-07T00:14:19.684138+0000","last_peered":"2023-12-07T00:14:19.684138+0000","last_clean":"2023-12-07T00:14:19.684138+0000","last_became_active":"2023-12-07T00:14:14.637766+0000","last_became_peered":"2023-12-07T00:14:14.637766+0000","last_unstale":"2023-12-07T00:14:19.684138+0000","last_undegraded":"2023-12-07T00:14:19.684138+0000","last_fullsized":"2023-12-07T00:14:19.684138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367970+0000","last_change":"2023-12-07T00:14:18.668124+0000","last_active":"2023-12-07T00:14:21.367970+0000","last_peered":"2023-12-07T00:14:21.367970+0000","last_clean":"2023-12-07T00:14:21.367970+0000","last_became_active":"2023-12-07T00:14:18.667677+0000","last_became_peered":"2023-12-07T00:14:18.667677+0000","last_unstale":"2023-12-07T00:14:21.367970+0000","last_undegraded":"2023-12-07T00:14:21.367970+0000","last_fullsized":"2023-12-07T00:14:21.367970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:29:46.330072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680292+0000","last_change":"2023-12-07T00:14:13.639589+0000","last_active":"2023-12-07T00:14:19.680292+0000","last_peered":"2023-12-07T00:14:19.680292+0000","last_clean":"2023-12-07T00:14:19.680292+0000","last_became_active":"2023-12-07T00:14:13.639315+0000","last_became_peered":"2023-12-07T00:14:13.639315+0000","last_unstale":"2023-12-07T00:14:19.680292+0000","last_undegraded":"2023-12-07T00:14:19.680292+0000","last_fullsized":"2023-12-07T00:14:19.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889199+0000","last_change":"2023-12-07T00:14:14.638371+0000","last_active":"2023-12-07T00:14:19.889199+0000","last_peered":"2023-12-07T00:14:19.889199+0000","last_clean":"2023-12-07T00:14:19.889199+0000","last_became_active":"2023-12-07T00:14:14.638090+0000","last_became_peered":"2023-12-07T00:14:14.638090+0000","last_unstale":"2023-12-07T00:14:19.889199+0000","last_undegraded":"2023-12-07T00:14:19.889199+0000","last_fullsized":"2023-12-07T00:14:19.889199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:02:05.622336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.681229+0000","last_change":"2023-12-07T00:14:18.667960+0000","last_active":"2023-12-07T00:14:20.681229+0000","last_peered":"2023-12-07T00:14:20.681229+0000","last_clean":"2023-12-07T00:14:20.681229+0000","last_became_active":"2023-12-07T00:14:18.667569+0000","last_became_peered":"2023-12-07T00:14:18.667569+0000","last_unstale":"2023-12-07T00:14:20.681229+0000","last_undegraded":"2023-12-07T00:14:20.681229+0000","last_fullsized":"2023-12-07T00:14:20.681229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:18.112203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683017+0000","last_change":"2023-12-07T00:14:13.637477+0000","last_active":"2023-12-07T00:14:19.683017+0000","last_peered":"2023-12-07T00:14:19.683017+0000","last_clean":"2023-12-07T00:14:19.683017+0000","last_became_active":"2023-12-07T00:14:13.637044+0000","last_became_peered":"2023-12-07T00:14:13.637044+0000","last_unstale":"2023-12-07T00:14:19.683017+0000","last_undegraded":"2023-12-07T00:14:19.683017+0000","last_fullsized":"2023-12-07T00:14:19.683017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888973+0000","last_change":"2023-12-07T00:14:14.648736+0000","last_active":"2023-12-07T00:14:19.888973+0000","last_peered":"2023-12-07T00:14:19.888973+0000","last_clean":"2023-12-07T00:14:19.888973+0000","last_became_active":"2023-12-07T00:14:14.648449+0000","last_became_peered":"2023-12-07T00:14:14.648449+0000","last_unstale":"2023-12-07T00:14:19.888973+0000","last_undegraded":"2023-12-07T00:14:19.888973+0000","last_fullsized":"2023-12-07T00:14:19.888973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.706104+0000","last_change":"2023-12-07T00:14:18.671310+0000","last_active":"2023-12-07T00:14:20.706104+0000","last_peered":"2023-12-07T00:14:20.706104+0000","last_clean":"2023-12-07T00:14:20.706104+0000","last_became_active":"2023-12-07T00:14:18.670905+0000","last_became_peered":"2023-12-07T00:14:18.670905+0000","last_unstale":"2023-12-07T00:14:20.706104+0000","last_undegraded":"2023-12-07T00:14:20.706104+0000","last_fullsized":"2023-12-07T00:14:20.706104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:36.812638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679983+0000","last_change":"2023-12-07T00:14:13.636864+0000","last_active":"2023-12-07T00:14:19.679983+0000","last_peered":"2023-12-07T00:14:19.679983+0000","last_clean":"2023-12-07T00:14:19.679983+0000","last_became_active":"2023-12-07T00:14:13.636497+0000","last_became_peered":"2023-12-07T00:14:13.636497+0000","last_unstale":"2023-12-07T00:14:19.679983+0000","last_undegraded":"2023-12-07T00:14:19.679983+0000","last_fullsized":"2023-12-07T00:14:19.679983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679793+0000","last_change":"2023-12-07T00:14:14.647211+0000","last_active":"2023-12-07T00:14:19.679793+0000","last_peered":"2023-12-07T00:14:19.679793+0000","last_clean":"2023-12-07T00:14:19.679793+0000","last_became_active":"2023-12-07T00:14:14.646890+0000","last_became_peered":"2023-12-07T00:14:14.646890+0000","last_unstale":"2023-12-07T00:14:19.679793+0000","last_undegraded":"2023-12-07T00:14:19.679793+0000","last_fullsized":"2023-12-07T00:14:19.679793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367712+0000","last_change":"2023-12-07T00:14:19.073249+0000","last_active":"2023-12-07T00:14:21.367712+0000","last_peered":"2023-12-07T00:14:21.367712+0000","last_clean":"2023-12-07T00:14:21.367712+0000","last_became_active":"2023-12-07T00:14:19.072757+0000","last_became_peered":"2023-12-07T00:14:19.072757+0000","last_unstale":"2023-12-07T00:14:21.367712+0000","last_undegraded":"2023-12-07T00:14:21.367712+0000","last_fullsized":"2023-12-07T00:14:21.367712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684347+0000","last_change":"2023-12-07T00:14:13.630879+0000","last_active":"2023-12-07T00:14:19.684347+0000","last_peered":"2023-12-07T00:14:19.684347+0000","last_clean":"2023-12-07T00:14:19.684347+0000","last_became_active":"2023-12-07T00:14:13.630299+0000","last_became_peered":"2023-12-07T00:14:13.630299+0000","last_unstale":"2023-12-07T00:14:19.684347+0000","last_undegraded":"2023-12-07T00:14:19.684347+0000","last_fullsized":"2023-12-07T00:14:19.684347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888694+0000","last_change":"2023-12-07T00:14:14.651244+0000","last_active":"2023-12-07T00:14:19.888694+0000","last_peered":"2023-12-07T00:14:19.888694+0000","last_clean":"2023-12-07T00:14:19.888694+0000","last_became_active":"2023-12-07T00:14:14.650996+0000","last_became_peered":"2023-12-07T00:14:14.650996+0000","last_unstale":"2023-12-07T00:14:19.888694+0000","last_undegraded":"2023-12-07T00:14:19.888694+0000","last_fullsized":"2023-12-07T00:14:19.888694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367059+0000","last_change":"2023-12-07T00:14:19.073306+0000","last_active":"2023-12-07T00:14:21.367059+0000","last_peered":"2023-12-07T00:14:21.367059+0000","last_clean":"2023-12-07T00:14:21.367059+0000","last_became_active":"2023-12-07T00:14:19.072870+0000","last_became_peered":"2023-12-07T00:14:19.072870+0000","last_unstale":"2023-12-07T00:14:21.367059+0000","last_undegraded":"2023-12-07T00:14:21.367059+0000","last_fullsized":"2023-12-07T00:14:21.367059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:02:29.749218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683882+0000","last_change":"2023-12-07T00:14:13.636919+0000","last_active":"2023-12-07T00:14:19.683882+0000","last_peered":"2023-12-07T00:14:19.683882+0000","last_clean":"2023-12-07T00:14:19.683882+0000","last_became_active":"2023-12-07T00:14:13.636581+0000","last_became_peered":"2023-12-07T00:14:13.636581+0000","last_unstale":"2023-12-07T00:14:19.683882+0000","last_undegraded":"2023-12-07T00:14:19.683882+0000","last_fullsized":"2023-12-07T00:14:19.683882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683788+0000","last_change":"2023-12-07T00:14:14.644313+0000","last_active":"2023-12-07T00:14:19.683788+0000","last_peered":"2023-12-07T00:14:19.683788+0000","last_clean":"2023-12-07T00:14:19.683788+0000","last_became_active":"2023-12-07T00:14:14.643846+0000","last_became_peered":"2023-12-07T00:14:14.643846+0000","last_unstale":"2023-12-07T00:14:19.683788+0000","last_undegraded":"2023-12-07T00:14:19.683788+0000","last_fullsized":"2023-12-07T00:14:19.683788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367087+0000","last_change":"2023-12-07T00:14:18.664942+0000","last_active":"2023-12-07T00:14:21.367087+0000","last_peered":"2023-12-07T00:14:21.367087+0000","last_clean":"2023-12-07T00:14:21.367087+0000","last_became_active":"2023-12-07T00:14:18.664530+0000","last_became_peered":"2023-12-07T00:14:18.664530+0000","last_unstale":"2023-12-07T00:14:21.367087+0000","last_undegraded":"2023-12-07T00:14:21.367087+0000","last_fullsized":"2023-12-07T00:14:21.367087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:50:31.696056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683699+0000","last_change":"2023-12-07T00:14:13.638292+0000","last_active":"2023-12-07T00:14:19.683699+0000","last_peered":"2023-12-07T00:14:19.683699+0000","last_clean":"2023-12-07T00:14:19.683699+0000","last_became_active":"2023-12-07T00:14:13.637982+0000","last_became_peered":"2023-12-07T00:14:13.637982+0000","last_unstale":"2023-12-07T00:14:19.683699+0000","last_undegraded":"2023-12-07T00:14:19.683699+0000","last_fullsized":"2023-12-07T00:14:19.683699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889880+0000","last_change":"2023-12-07T00:14:14.649013+0000","last_active":"2023-12-07T00:14:19.889880+0000","last_peered":"2023-12-07T00:14:19.889880+0000","last_clean":"2023-12-07T00:14:19.889880+0000","last_became_active":"2023-12-07T00:14:14.648768+0000","last_became_peered":"2023-12-07T00:14:14.648768+0000","last_unstale":"2023-12-07T00:14:19.889880+0000","last_undegraded":"2023-12-07T00:14:19.889880+0000","last_fullsized":"2023-12-07T00:14:19.889880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685363+0000","last_change":"2023-12-07T00:14:18.661970+0000","last_active":"2023-12-07T00:14:20.685363+0000","last_peered":"2023-12-07T00:14:20.685363+0000","last_clean":"2023-12-07T00:14:20.685363+0000","last_became_active":"2023-12-07T00:14:18.661509+0000","last_became_peered":"2023-12-07T00:14:18.661509+0000","last_unstale":"2023-12-07T00:14:20.685363+0000","last_undegraded":"2023-12-07T00:14:20.685363+0000","last_fullsized":"2023-12-07T00:14:20.685363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889467+0000","last_change":"2023-12-07T00:14:13.632679+0000","last_active":"2023-12-07T00:14:19.889467+0000","last_peered":"2023-12-07T00:14:19.889467+0000","last_clean":"2023-12-07T00:14:19.889467+0000","last_became_active":"2023-12-07T00:14:13.632414+0000","last_became_peered":"2023-12-07T00:14:13.632414+0000","last_unstale":"2023-12-07T00:14:19.889467+0000","last_undegraded":"2023-12-07T00:14:19.889467+0000","last_fullsized":"2023-12-07T00:14:19.889467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890001+0000","last_change":"2023-12-07T00:14:14.643589+0000","last_active":"2023-12-07T00:14:19.890001+0000","last_peered":"2023-12-07T00:14:19.890001+0000","last_clean":"2023-12-07T00:14:19.890001+0000","last_became_active":"2023-12-07T00:14:14.642709+0000","last_became_peered":"2023-12-07T00:14:14.642709+0000","last_unstale":"2023-12-07T00:14:19.890001+0000","last_undegraded":"2023-12-07T00:14:19.890001+0000","last_fullsized":"2023-12-07T00:14:19.890001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:25:52.844383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274940+0000","last_change":"2023-12-07T00:14:18.672498+0000","last_active":"2023-12-07T00:14:21.274940+0000","last_peered":"2023-12-07T00:14:21.274940+0000","last_clean":"2023-12-07T00:14:21.274940+0000","last_became_active":"2023-12-07T00:14:18.671937+0000","last_became_peered":"2023-12-07T00:14:18.671937+0000","last_unstale":"2023-12-07T00:14:21.274940+0000","last_undegraded":"2023-12-07T00:14:21.274940+0000","last_fullsized":"2023-12-07T00:14:21.274940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:24.753524+0000","last_change":"2023-12-07T00:14:13.637631+0000","last_active":"2023-12-07T00:14:24.753524+0000","last_peered":"2023-12-07T00:14:24.753524+0000","last_clean":"2023-12-07T00:14:24.753524+0000","last_became_active":"2023-12-07T00:14:13.637168+0000","last_became_peered":"2023-12-07T00:14:13.637168+0000","last_unstale":"2023-12-07T00:14:24.753524+0000","last_undegraded":"2023-12-07T00:14:24.753524+0000","last_fullsized":"2023-12-07T00:14:24.753524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:04.965261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890062+0000","last_change":"2023-12-07T00:14:14.650093+0000","last_active":"2023-12-07T00:14:19.890062+0000","last_peered":"2023-12-07T00:14:19.890062+0000","last_clean":"2023-12-07T00:14:19.890062+0000","last_became_active":"2023-12-07T00:14:14.649823+0000","last_became_peered":"2023-12-07T00:14:14.649823+0000","last_unstale":"2023-12-07T00:14:19.890062+0000","last_undegraded":"2023-12-07T00:14:19.890062+0000","last_fullsized":"2023-12-07T00:14:19.890062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367661+0000","last_change":"2023-12-07T00:14:19.071276+0000","last_active":"2023-12-07T00:14:21.367661+0000","last_peered":"2023-12-07T00:14:21.367661+0000","last_clean":"2023-12-07T00:14:21.367661+0000","last_became_active":"2023-12-07T00:14:19.070824+0000","last_became_peered":"2023-12-07T00:14:19.070824+0000","last_unstale":"2023-12-07T00:14:21.367661+0000","last_undegraded":"2023-12-07T00:14:21.367661+0000","last_fullsized":"2023-12-07T00:14:21.367661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:08.025637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888896+0000","last_change":"2023-12-07T00:14:13.631611+0000","last_active":"2023-12-07T00:14:19.888896+0000","last_peered":"2023-12-07T00:14:19.888896+0000","last_clean":"2023-12-07T00:14:19.888896+0000","last_became_active":"2023-12-07T00:14:13.631235+0000","last_became_peered":"2023-12-07T00:14:13.631235+0000","last_unstale":"2023-12-07T00:14:19.888896+0000","last_undegraded":"2023-12-07T00:14:19.888896+0000","last_fullsized":"2023-12-07T00:14:19.888896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:23.927140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889622+0000","last_change":"2023-12-07T00:14:14.644562+0000","last_active":"2023-12-07T00:14:19.889622+0000","last_peered":"2023-12-07T00:14:19.889622+0000","last_clean":"2023-12-07T00:14:19.889622+0000","last_became_active":"2023-12-07T00:14:14.644312+0000","last_became_peered":"2023-12-07T00:14:14.644312+0000","last_unstale":"2023-12-07T00:14:19.889622+0000","last_undegraded":"2023-12-07T00:14:19.889622+0000","last_fullsized":"2023-12-07T00:14:19.889622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:56.516763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367810+0000","last_change":"2023-12-07T00:14:19.070516+0000","last_active":"2023-12-07T00:14:21.367810+0000","last_peered":"2023-12-07T00:14:21.367810+0000","last_clean":"2023-12-07T00:14:21.367810+0000","last_became_active":"2023-12-07T00:14:19.069991+0000","last_became_peered":"2023-12-07T00:14:19.069991+0000","last_unstale":"2023-12-07T00:14:21.367810+0000","last_undegraded":"2023-12-07T00:14:21.367810+0000","last_fullsized":"2023-12-07T00:14:21.367810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:10:44.043162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682934+0000","last_change":"2023-12-07T00:14:13.633584+0000","last_active":"2023-12-07T00:14:19.682934+0000","last_peered":"2023-12-07T00:14:19.682934+0000","last_clean":"2023-12-07T00:14:19.682934+0000","last_became_active":"2023-12-07T00:14:13.633318+0000","last_became_peered":"2023-12-07T00:14:13.633318+0000","last_unstale":"2023-12-07T00:14:19.682934+0000","last_undegraded":"2023-12-07T00:14:19.682934+0000","last_fullsized":"2023-12-07T00:14:19.682934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:27.937653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889684+0000","last_change":"2023-12-07T00:14:14.646779+0000","last_active":"2023-12-07T00:14:19.889684+0000","last_peered":"2023-12-07T00:14:19.889684+0000","last_clean":"2023-12-07T00:14:19.889684+0000","last_became_active":"2023-12-07T00:14:14.646527+0000","last_became_peered":"2023-12-07T00:14:14.646527+0000","last_unstale":"2023-12-07T00:14:19.889684+0000","last_undegraded":"2023-12-07T00:14:19.889684+0000","last_fullsized":"2023-12-07T00:14:19.889684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:27.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367356+0000","last_change":"2023-12-07T00:14:19.073255+0000","last_active":"2023-12-07T00:14:21.367356+0000","last_peered":"2023-12-07T00:14:21.367356+0000","last_clean":"2023-12-07T00:14:21.367356+0000","last_became_active":"2023-12-07T00:14:19.072813+0000","last_became_peered":"2023-12-07T00:14:19.072813+0000","last_unstale":"2023-12-07T00:14:21.367356+0000","last_undegraded":"2023-12-07T00:14:21.367356+0000","last_fullsized":"2023-12-07T00:14:21.367356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:28:56.476351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683628+0000","last_change":"2023-12-07T00:14:13.637391+0000","last_active":"2023-12-07T00:14:19.683628+0000","last_peered":"2023-12-07T00:14:19.683628+0000","last_clean":"2023-12-07T00:14:19.683628+0000","last_became_active":"2023-12-07T00:14:13.636965+0000","last_became_peered":"2023-12-07T00:14:13.636965+0000","last_unstale":"2023-12-07T00:14:19.683628+0000","last_undegraded":"2023-12-07T00:14:19.683628+0000","last_fullsized":"2023-12-07T00:14:19.683628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683105+0000","last_change":"2023-12-07T00:14:14.644444+0000","last_active":"2023-12-07T00:14:19.683105+0000","last_peered":"2023-12-07T00:14:19.683105+0000","last_clean":"2023-12-07T00:14:19.683105+0000","last_became_active":"2023-12-07T00:14:14.644176+0000","last_became_peered":"2023-12-07T00:14:14.644176+0000","last_unstale":"2023-12-07T00:14:19.683105+0000","last_undegraded":"2023-12-07T00:14:19.683105+0000","last_fullsized":"2023-12-07T00:14:19.683105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367421+0000","last_change":"2023-12-07T00:14:18.674600+0000","last_active":"2023-12-07T00:14:21.367421+0000","last_peered":"2023-12-07T00:14:21.367421+0000","last_clean":"2023-12-07T00:14:21.367421+0000","last_became_active":"2023-12-07T00:14:18.674181+0000","last_became_peered":"2023-12-07T00:14:18.674181+0000","last_unstale":"2023-12-07T00:14:21.367421+0000","last_undegraded":"2023-12-07T00:14:21.367421+0000","last_fullsized":"2023-12-07T00:14:21.367421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888243+0000","last_change":"2023-12-07T00:14:13.624390+0000","last_active":"2023-12-07T00:14:19.888243+0000","last_peered":"2023-12-07T00:14:19.888243+0000","last_clean":"2023-12-07T00:14:19.888243+0000","last_became_active":"2023-12-07T00:14:13.624106+0000","last_became_peered":"2023-12-07T00:14:13.624106+0000","last_unstale":"2023-12-07T00:14:19.888243+0000","last_undegraded":"2023-12-07T00:14:19.888243+0000","last_fullsized":"2023-12-07T00:14:19.888243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:20:00.819376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889987+0000","last_change":"2023-12-07T00:14:14.653680+0000","last_active":"2023-12-07T00:14:19.889987+0000","last_peered":"2023-12-07T00:14:19.889987+0000","last_clean":"2023-12-07T00:14:19.889987+0000","last_became_active":"2023-12-07T00:14:14.653401+0000","last_became_peered":"2023-12-07T00:14:14.653401+0000","last_unstale":"2023-12-07T00:14:19.889987+0000","last_undegraded":"2023-12-07T00:14:19.889987+0000","last_fullsized":"2023-12-07T00:14:19.889987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685126+0000","last_change":"2023-12-07T00:14:18.675345+0000","last_active":"2023-12-07T00:14:20.685126+0000","last_peered":"2023-12-07T00:14:20.685126+0000","last_clean":"2023-12-07T00:14:20.685126+0000","last_became_active":"2023-12-07T00:14:18.674896+0000","last_became_peered":"2023-12-07T00:14:18.674896+0000","last_unstale":"2023-12-07T00:14:20.685126+0000","last_undegraded":"2023-12-07T00:14:20.685126+0000","last_fullsized":"2023-12-07T00:14:20.685126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889444+0000","last_change":"2023-12-07T00:14:13.631569+0000","last_active":"2023-12-07T00:14:19.889444+0000","last_peered":"2023-12-07T00:14:19.889444+0000","last_clean":"2023-12-07T00:14:19.889444+0000","last_became_active":"2023-12-07T00:14:13.631324+0000","last_became_peered":"2023-12-07T00:14:13.631324+0000","last_unstale":"2023-12-07T00:14:19.889444+0000","last_undegraded":"2023-12-07T00:14:19.889444+0000","last_fullsized":"2023-12-07T00:14:19.889444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:20.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889942+0000","last_change":"2023-12-07T00:14:14.654814+0000","last_active":"2023-12-07T00:14:19.889942+0000","last_peered":"2023-12-07T00:14:19.889942+0000","last_clean":"2023-12-07T00:14:19.889942+0000","last_became_active":"2023-12-07T00:14:14.654539+0000","last_became_peered":"2023-12-07T00:14:14.654539+0000","last_unstale":"2023-12-07T00:14:19.889942+0000","last_undegraded":"2023-12-07T00:14:19.889942+0000","last_fullsized":"2023-12-07T00:14:19.889942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:32.781991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274758+0000","last_change":"2023-12-07T00:14:18.672450+0000","last_active":"2023-12-07T00:14:21.274758+0000","last_peered":"2023-12-07T00:14:21.274758+0000","last_clean":"2023-12-07T00:14:21.274758+0000","last_became_active":"2023-12-07T00:14:18.671488+0000","last_became_peered":"2023-12-07T00:14:18.671488+0000","last_unstale":"2023-12-07T00:14:21.274758+0000","last_undegraded":"2023-12-07T00:14:21.274758+0000","last_fullsized":"2023-12-07T00:14:21.274758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889341+0000","last_change":"2023-12-07T00:14:13.628825+0000","last_active":"2023-12-07T00:14:19.889341+0000","last_peered":"2023-12-07T00:14:19.889341+0000","last_clean":"2023-12-07T00:14:19.889341+0000","last_became_active":"2023-12-07T00:14:13.628268+0000","last_became_peered":"2023-12-07T00:14:13.628268+0000","last_unstale":"2023-12-07T00:14:19.889341+0000","last_undegraded":"2023-12-07T00:14:19.889341+0000","last_fullsized":"2023-12-07T00:14:19.889341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684300+0000","last_change":"2023-12-07T00:14:14.648381+0000","last_active":"2023-12-07T00:14:19.684300+0000","last_peered":"2023-12-07T00:14:19.684300+0000","last_clean":"2023-12-07T00:14:19.684300+0000","last_became_active":"2023-12-07T00:14:14.647909+0000","last_became_peered":"2023-12-07T00:14:14.647909+0000","last_unstale":"2023-12-07T00:14:19.684300+0000","last_undegraded":"2023-12-07T00:14:19.684300+0000","last_fullsized":"2023-12-07T00:14:19.684300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:24.947977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274850+0000","last_change":"2023-12-07T00:14:18.672792+0000","last_active":"2023-12-07T00:14:21.274850+0000","last_peered":"2023-12-07T00:14:21.274850+0000","last_clean":"2023-12-07T00:14:21.274850+0000","last_became_active":"2023-12-07T00:14:18.672377+0000","last_became_peered":"2023-12-07T00:14:18.672377+0000","last_unstale":"2023-12-07T00:14:21.274850+0000","last_undegraded":"2023-12-07T00:14:21.274850+0000","last_fullsized":"2023-12-07T00:14:21.274850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682851+0000","last_change":"2023-12-07T00:14:13.630678+0000","last_active":"2023-12-07T00:14:19.682851+0000","last_peered":"2023-12-07T00:14:19.682851+0000","last_clean":"2023-12-07T00:14:19.682851+0000","last_became_active":"2023-12-07T00:14:13.630330+0000","last_became_peered":"2023-12-07T00:14:13.630330+0000","last_unstale":"2023-12-07T00:14:19.682851+0000","last_undegraded":"2023-12-07T00:14:19.682851+0000","last_fullsized":"2023-12-07T00:14:19.682851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:39.332777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889755+0000","last_change":"2023-12-07T00:14:14.645768+0000","last_active":"2023-12-07T00:14:19.889755+0000","last_peered":"2023-12-07T00:14:19.889755+0000","last_clean":"2023-12-07T00:14:19.889755+0000","last_became_active":"2023-12-07T00:14:14.645426+0000","last_became_peered":"2023-12-07T00:14:14.645426+0000","last_unstale":"2023-12-07T00:14:19.889755+0000","last_undegraded":"2023-12-07T00:14:19.889755+0000","last_fullsized":"2023-12-07T00:14:19.889755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:24.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.275200+0000","last_change":"2023-12-07T00:14:18.671276+0000","last_active":"2023-12-07T00:14:21.275200+0000","last_peered":"2023-12-07T00:14:21.275200+0000","last_clean":"2023-12-07T00:14:21.275200+0000","last_became_active":"2023-12-07T00:14:18.670847+0000","last_became_peered":"2023-12-07T00:14:18.670847+0000","last_unstale":"2023-12-07T00:14:21.275200+0000","last_undegraded":"2023-12-07T00:14:21.275200+0000","last_fullsized":"2023-12-07T00:14:21.275200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888363+0000","last_change":"2023-12-07T00:14:14.644465+0000","last_active":"2023-12-07T00:14:19.888363+0000","last_peered":"2023-12-07T00:14:19.888363+0000","last_clean":"2023-12-07T00:14:19.888363+0000","last_became_active":"2023-12-07T00:14:14.644158+0000","last_became_peered":"2023-12-07T00:14:14.644158+0000","last_unstale":"2023-12-07T00:14:19.888363+0000","last_undegraded":"2023-12-07T00:14:19.888363+0000","last_fullsized":"2023-12-07T00:14:19.888363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888598+0000","last_change":"2023-12-07T00:14:13.633388+0000","last_active":"2023-12-07T00:14:19.888598+0000","last_peered":"2023-12-07T00:14:19.888598+0000","last_clean":"2023-12-07T00:14:19.888598+0000","last_became_active":"2023-12-07T00:14:13.633091+0000","last_became_peered":"2023-12-07T00:14:13.633091+0000","last_unstale":"2023-12-07T00:14:19.888598+0000","last_undegraded":"2023-12-07T00:14:19.888598+0000","last_fullsized":"2023-12-07T00:14:19.888598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:24:13.479657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.706143+0000","last_change":"2023-12-07T00:14:19.071553+0000","last_active":"2023-12-07T00:14:20.706143+0000","last_peered":"2023-12-07T00:14:20.706143+0000","last_clean":"2023-12-07T00:14:20.706143+0000","last_became_active":"2023-12-07T00:14:19.071152+0000","last_became_peered":"2023-12-07T00:14:19.071152+0000","last_unstale":"2023-12-07T00:14:20.706143+0000","last_undegraded":"2023-12-07T00:14:20.706143+0000","last_fullsized":"2023-12-07T00:14:20.706143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680168+0000","last_change":"2023-12-07T00:14:14.652614+0000","last_active":"2023-12-07T00:14:19.680168+0000","last_peered":"2023-12-07T00:14:19.680168+0000","last_clean":"2023-12-07T00:14:19.680168+0000","last_became_active":"2023-12-07T00:14:14.652330+0000","last_became_peered":"2023-12-07T00:14:14.652330+0000","last_unstale":"2023-12-07T00:14:19.680168+0000","last_undegraded":"2023-12-07T00:14:19.680168+0000","last_fullsized":"2023-12-07T00:14:19.680168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683065+0000","last_change":"2023-12-07T00:14:13.632410+0000","last_active":"2023-12-07T00:14:19.683065+0000","last_peered":"2023-12-07T00:14:19.683065+0000","last_clean":"2023-12-07T00:14:19.683065+0000","last_became_active":"2023-12-07T00:14:13.632131+0000","last_became_peered":"2023-12-07T00:14:13.632131+0000","last_unstale":"2023-12-07T00:14:19.683065+0000","last_undegraded":"2023-12-07T00:14:19.683065+0000","last_fullsized":"2023-12-07T00:14:19.683065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:08.508036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890283+0000","last_change":"2023-12-07T00:14:04.636514+0000","last_active":"2023-12-07T00:14:19.890283+0000","last_peered":"2023-12-07T00:14:19.890283+0000","last_clean":"2023-12-07T00:14:19.890283+0000","last_became_active":"2023-12-07T00:14:04.635540+0000","last_became_peered":"2023-12-07T00:14:04.635540+0000","last_unstale":"2023-12-07T00:14:19.890283+0000","last_undegraded":"2023-12-07T00:14:19.890283+0000","last_fullsized":"2023-12-07T00:14:19.890283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_clean_scrub_stamp":"2023-12-07T00:14:03.541217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:08:01.012662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367559+0000","last_change":"2023-12-07T00:14:19.070256+0000","last_active":"2023-12-07T00:14:21.367559+0000","last_peered":"2023-12-07T00:14:21.367559+0000","last_clean":"2023-12-07T00:14:21.367559+0000","last_became_active":"2023-12-07T00:14:19.069857+0000","last_became_peered":"2023-12-07T00:14:19.069857+0000","last_unstale":"2023-12-07T00:14:21.367559+0000","last_undegraded":"2023-12-07T00:14:21.367559+0000","last_fullsized":"2023-12-07T00:14:21.367559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890041+0000","last_change":"2023-12-07T00:14:14.646599+0000","last_active":"2023-12-07T00:14:19.890041+0000","last_peered":"2023-12-07T00:14:19.890041+0000","last_clean":"2023-12-07T00:14:19.890041+0000","last_became_active":"2023-12-07T00:14:14.646211+0000","last_became_peered":"2023-12-07T00:14:14.646211+0000","last_unstale":"2023-12-07T00:14:19.890041+0000","last_undegraded":"2023-12-07T00:14:19.890041+0000","last_fullsized":"2023-12-07T00:14:19.890041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:05.969623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890386+0000","last_change":"2023-12-07T00:14:13.628132+0000","last_active":"2023-12-07T00:14:19.890386+0000","last_peered":"2023-12-07T00:14:19.890386+0000","last_clean":"2023-12-07T00:14:19.890386+0000","last_became_active":"2023-12-07T00:14:13.627883+0000","last_became_peered":"2023-12-07T00:14:13.627883+0000","last_unstale":"2023-12-07T00:14:19.890386+0000","last_undegraded":"2023-12-07T00:14:19.890386+0000","last_fullsized":"2023-12-07T00:14:19.890386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:08.508036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366914+0000","last_change":"2023-12-07T00:14:19.070287+0000","last_active":"2023-12-07T00:14:21.366914+0000","last_peered":"2023-12-07T00:14:21.366914+0000","last_clean":"2023-12-07T00:14:21.366914+0000","last_became_active":"2023-12-07T00:14:19.069931+0000","last_became_peered":"2023-12-07T00:14:19.069931+0000","last_unstale":"2023-12-07T00:14:21.366914+0000","last_undegraded":"2023-12-07T00:14:21.366914+0000","last_fullsized":"2023-12-07T00:14:21.366914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889775+0000","last_change":"2023-12-07T00:14:13.630867+0000","last_active":"2023-12-07T00:14:19.889775+0000","last_peered":"2023-12-07T00:14:19.889775+0000","last_clean":"2023-12-07T00:14:19.889775+0000","last_became_active":"2023-12-07T00:14:13.630542+0000","last_became_peered":"2023-12-07T00:14:13.630542+0000","last_unstale":"2023-12-07T00:14:19.889775+0000","last_undegraded":"2023-12-07T00:14:19.889775+0000","last_fullsized":"2023-12-07T00:14:19.889775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889492+0000","last_change":"2023-12-07T00:14:14.646636+0000","last_active":"2023-12-07T00:14:19.889492+0000","last_peered":"2023-12-07T00:14:19.889492+0000","last_clean":"2023-12-07T00:14:19.889492+0000","last_became_active":"2023-12-07T00:14:14.645841+0000","last_became_peered":"2023-12-07T00:14:14.645841+0000","last_unstale":"2023-12-07T00:14:19.889492+0000","last_undegraded":"2023-12-07T00:14:19.889492+0000","last_fullsized":"2023-12-07T00:14:19.889492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366975+0000","last_change":"2023-12-07T00:14:19.073292+0000","last_active":"2023-12-07T00:14:21.366975+0000","last_peered":"2023-12-07T00:14:21.366975+0000","last_clean":"2023-12-07T00:14:21.366975+0000","last_became_active":"2023-12-07T00:14:19.072850+0000","last_became_peered":"2023-12-07T00:14:19.072850+0000","last_unstale":"2023-12-07T00:14:21.366975+0000","last_undegraded":"2023-12-07T00:14:21.366975+0000","last_fullsized":"2023-12-07T00:14:21.366975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:35:28.448140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889274+0000","last_change":"2023-12-07T00:14:13.637981+0000","last_active":"2023-12-07T00:14:19.889274+0000","last_peered":"2023-12-07T00:14:19.889274+0000","last_clean":"2023-12-07T00:14:19.889274+0000","last_became_active":"2023-12-07T00:14:13.637648+0000","last_became_peered":"2023-12-07T00:14:13.637648+0000","last_unstale":"2023-12-07T00:14:19.889274+0000","last_undegraded":"2023-12-07T00:14:19.889274+0000","last_fullsized":"2023-12-07T00:14:19.889274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680868+0000","last_change":"2023-12-07T00:14:14.646947+0000","last_active":"2023-12-07T00:14:19.680868+0000","last_peered":"2023-12-07T00:14:19.680868+0000","last_clean":"2023-12-07T00:14:19.680868+0000","last_became_active":"2023-12-07T00:14:14.646649+0000","last_became_peered":"2023-12-07T00:14:14.646649+0000","last_unstale":"2023-12-07T00:14:19.680868+0000","last_undegraded":"2023-12-07T00:14:19.680868+0000","last_fullsized":"2023-12-07T00:14:19.680868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684472+0000","last_change":"2023-12-07T00:14:19.073479+0000","last_active":"2023-12-07T00:14:20.684472+0000","last_peered":"2023-12-07T00:14:20.684472+0000","last_clean":"2023-12-07T00:14:20.684472+0000","last_became_active":"2023-12-07T00:14:19.073084+0000","last_became_peered":"2023-12-07T00:14:19.073084+0000","last_unstale":"2023-12-07T00:14:20.684472+0000","last_undegraded":"2023-12-07T00:14:20.684472+0000","last_fullsized":"2023-12-07T00:14:20.684472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:40.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683778+0000","last_change":"2023-12-07T00:14:13.637916+0000","last_active":"2023-12-07T00:14:19.683778+0000","last_peered":"2023-12-07T00:14:19.683778+0000","last_clean":"2023-12-07T00:14:19.683778+0000","last_became_active":"2023-12-07T00:14:13.637538+0000","last_became_peered":"2023-12-07T00:14:13.637538+0000","last_unstale":"2023-12-07T00:14:19.683778+0000","last_undegraded":"2023-12-07T00:14:19.683778+0000","last_fullsized":"2023-12-07T00:14:19.683778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890503+0000","last_change":"2023-12-07T00:14:14.648223+0000","last_active":"2023-12-07T00:14:19.890503+0000","last_peered":"2023-12-07T00:14:19.890503+0000","last_clean":"2023-12-07T00:14:19.890503+0000","last_became_active":"2023-12-07T00:14:14.647966+0000","last_became_peered":"2023-12-07T00:14:14.647966+0000","last_unstale":"2023-12-07T00:14:19.890503+0000","last_undegraded":"2023-12-07T00:14:19.890503+0000","last_fullsized":"2023-12-07T00:14:19.890503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684860+0000","last_change":"2023-12-07T00:14:18.665311+0000","last_active":"2023-12-07T00:14:20.684860+0000","last_peered":"2023-12-07T00:14:20.684860+0000","last_clean":"2023-12-07T00:14:20.684860+0000","last_became_active":"2023-12-07T00:14:18.664892+0000","last_became_peered":"2023-12-07T00:14:18.664892+0000","last_unstale":"2023-12-07T00:14:20.684860+0000","last_undegraded":"2023-12-07T00:14:20.684860+0000","last_fullsized":"2023-12-07T00:14:20.684860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890458+0000","last_change":"2023-12-07T00:14:13.630986+0000","last_active":"2023-12-07T00:14:19.890458+0000","last_peered":"2023-12-07T00:14:19.890458+0000","last_clean":"2023-12-07T00:14:19.890458+0000","last_became_active":"2023-12-07T00:14:13.630609+0000","last_became_peered":"2023-12-07T00:14:13.630609+0000","last_unstale":"2023-12-07T00:14:19.890458+0000","last_undegraded":"2023-12-07T00:14:19.890458+0000","last_fullsized":"2023-12-07T00:14:19.890458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:53.916550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888978+0000","last_change":"2023-12-07T00:14:14.635608+0000","last_active":"2023-12-07T00:14:19.888978+0000","last_peered":"2023-12-07T00:14:19.888978+0000","last_clean":"2023-12-07T00:14:19.888978+0000","last_became_active":"2023-12-07T00:14:14.635340+0000","last_became_peered":"2023-12-07T00:14:14.635340+0000","last_unstale":"2023-12-07T00:14:19.888978+0000","last_undegraded":"2023-12-07T00:14:19.888978+0000","last_fullsized":"2023-12-07T00:14:19.888978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:54.920912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.275281+0000","last_change":"2023-12-07T00:14:19.071557+0000","last_active":"2023-12-07T00:14:21.275281+0000","last_peered":"2023-12-07T00:14:21.275281+0000","last_clean":"2023-12-07T00:14:21.275281+0000","last_became_active":"2023-12-07T00:14:19.071128+0000","last_became_peered":"2023-12-07T00:14:19.071128+0000","last_unstale":"2023-12-07T00:14:21.275281+0000","last_undegraded":"2023-12-07T00:14:21.275281+0000","last_fullsized":"2023-12-07T00:14:21.275281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:53:14.211329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888538+0000","last_change":"2023-12-07T00:14:13.629382+0000","last_active":"2023-12-07T00:14:19.888538+0000","last_peered":"2023-12-07T00:14:19.888538+0000","last_clean":"2023-12-07T00:14:19.888538+0000","last_became_active":"2023-12-07T00:14:13.629097+0000","last_became_peered":"2023-12-07T00:14:13.629097+0000","last_unstale":"2023-12-07T00:14:19.888538+0000","last_undegraded":"2023-12-07T00:14:19.888538+0000","last_fullsized":"2023-12-07T00:14:19.888538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:23.927140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679917+0000","last_change":"2023-12-07T00:14:14.655117+0000","last_active":"2023-12-07T00:14:19.679917+0000","last_peered":"2023-12-07T00:14:19.679917+0000","last_clean":"2023-12-07T00:14:19.679917+0000","last_became_active":"2023-12-07T00:14:14.652105+0000","last_became_peered":"2023-12-07T00:14:14.652105+0000","last_unstale":"2023-12-07T00:14:19.679917+0000","last_undegraded":"2023-12-07T00:14:19.679917+0000","last_fullsized":"2023-12-07T00:14:19.679917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685032+0000","last_change":"2023-12-07T00:14:18.665600+0000","last_active":"2023-12-07T00:14:20.685032+0000","last_peered":"2023-12-07T00:14:20.685032+0000","last_clean":"2023-12-07T00:14:20.685032+0000","last_became_active":"2023-12-07T00:14:18.664901+0000","last_became_peered":"2023-12-07T00:14:18.664901+0000","last_unstale":"2023-12-07T00:14:20.685032+0000","last_undegraded":"2023-12-07T00:14:20.685032+0000","last_fullsized":"2023-12-07T00:14:20.685032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889054+0000","last_change":"2023-12-07T00:14:13.633312+0000","last_active":"2023-12-07T00:14:19.889054+0000","last_peered":"2023-12-07T00:14:19.889054+0000","last_clean":"2023-12-07T00:14:19.889054+0000","last_became_active":"2023-12-07T00:14:13.633034+0000","last_became_peered":"2023-12-07T00:14:13.633034+0000","last_unstale":"2023-12-07T00:14:19.889054+0000","last_undegraded":"2023-12-07T00:14:19.889054+0000","last_fullsized":"2023-12-07T00:14:19.889054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:04.965261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680317+0000","last_change":"2023-12-07T00:14:14.655550+0000","last_active":"2023-12-07T00:14:19.680317+0000","last_peered":"2023-12-07T00:14:19.680317+0000","last_clean":"2023-12-07T00:14:19.680317+0000","last_became_active":"2023-12-07T00:14:14.651780+0000","last_became_peered":"2023-12-07T00:14:14.651780+0000","last_unstale":"2023-12-07T00:14:19.680317+0000","last_undegraded":"2023-12-07T00:14:19.680317+0000","last_fullsized":"2023-12-07T00:14:19.680317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685294+0000","last_change":"2023-12-07T00:14:18.669658+0000","last_active":"2023-12-07T00:14:20.685294+0000","last_peered":"2023-12-07T00:14:20.685294+0000","last_clean":"2023-12-07T00:14:20.685294+0000","last_became_active":"2023-12-07T00:14:18.669258+0000","last_became_peered":"2023-12-07T00:14:18.669258+0000","last_unstale":"2023-12-07T00:14:20.685294+0000","last_undegraded":"2023-12-07T00:14:20.685294+0000","last_fullsized":"2023-12-07T00:14:20.685294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890157+0000","last_change":"2023-12-07T00:14:13.634671+0000","last_active":"2023-12-07T00:14:19.890157+0000","last_peered":"2023-12-07T00:14:19.890157+0000","last_clean":"2023-12-07T00:14:19.890157+0000","last_became_active":"2023-12-07T00:14:13.634416+0000","last_became_peered":"2023-12-07T00:14:13.634416+0000","last_unstale":"2023-12-07T00:14:19.890157+0000","last_undegraded":"2023-12-07T00:14:19.890157+0000","last_fullsized":"2023-12-07T00:14:19.890157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:15.155566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683669+0000","last_change":"2023-12-07T00:14:14.646535+0000","last_active":"2023-12-07T00:14:19.683669+0000","last_peered":"2023-12-07T00:14:19.683669+0000","last_clean":"2023-12-07T00:14:19.683669+0000","last_became_active":"2023-12-07T00:14:14.646262+0000","last_became_peered":"2023-12-07T00:14:14.646262+0000","last_unstale":"2023-12-07T00:14:19.683669+0000","last_undegraded":"2023-12-07T00:14:19.683669+0000","last_fullsized":"2023-12-07T00:14:19.683669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.705879+0000","last_change":"2023-12-07T00:14:19.070666+0000","last_active":"2023-12-07T00:14:20.705879+0000","last_peered":"2023-12-07T00:14:20.705879+0000","last_clean":"2023-12-07T00:14:20.705879+0000","last_became_active":"2023-12-07T00:14:19.070102+0000","last_became_peered":"2023-12-07T00:14:19.070102+0000","last_unstale":"2023-12-07T00:14:20.705879+0000","last_undegraded":"2023-12-07T00:14:20.705879+0000","last_fullsized":"2023-12-07T00:14:20.705879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:40.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888826+0000","last_change":"2023-12-07T00:14:13.630742+0000","last_active":"2023-12-07T00:14:19.888826+0000","last_peered":"2023-12-07T00:14:19.888826+0000","last_clean":"2023-12-07T00:14:19.888826+0000","last_became_active":"2023-12-07T00:14:13.630467+0000","last_became_peered":"2023-12-07T00:14:13.630467+0000","last_unstale":"2023-12-07T00:14:19.888826+0000","last_undegraded":"2023-12-07T00:14:19.888826+0000","last_fullsized":"2023-12-07T00:14:19.888826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:53.916550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889980+0000","last_change":"2023-12-07T00:14:14.649293+0000","last_active":"2023-12-07T00:14:19.889980+0000","last_peered":"2023-12-07T00:14:19.889980+0000","last_clean":"2023-12-07T00:14:19.889980+0000","last_became_active":"2023-12-07T00:14:14.649021+0000","last_became_peered":"2023-12-07T00:14:14.649021+0000","last_unstale":"2023-12-07T00:14:19.889980+0000","last_undegraded":"2023-12-07T00:14:19.889980+0000","last_fullsized":"2023-12-07T00:14:19.889980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:16.080287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366749+0000","last_change":"2023-12-07T00:14:18.669575+0000","last_active":"2023-12-07T00:14:21.366749+0000","last_peered":"2023-12-07T00:14:21.366749+0000","last_clean":"2023-12-07T00:14:21.366749+0000","last_became_active":"2023-12-07T00:14:18.669100+0000","last_became_peered":"2023-12-07T00:14:18.669100+0000","last_unstale":"2023-12-07T00:14:21.366749+0000","last_undegraded":"2023-12-07T00:14:21.366749+0000","last_fullsized":"2023-12-07T00:14:21.366749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889422+0000","last_change":"2023-12-07T00:14:13.629136+0000","last_active":"2023-12-07T00:14:19.889422+0000","last_peered":"2023-12-07T00:14:19.889422+0000","last_clean":"2023-12-07T00:14:19.889422+0000","last_became_active":"2023-12-07T00:14:13.628827+0000","last_became_peered":"2023-12-07T00:14:13.628827+0000","last_unstale":"2023-12-07T00:14:19.889422+0000","last_undegraded":"2023-12-07T00:14:19.889422+0000","last_fullsized":"2023-12-07T00:14:19.889422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683381+0000","last_change":"2023-12-07T00:14:14.647552+0000","last_active":"2023-12-07T00:14:19.683381+0000","last_peered":"2023-12-07T00:14:19.683381+0000","last_clean":"2023-12-07T00:14:19.683381+0000","last_became_active":"2023-12-07T00:14:14.647247+0000","last_became_peered":"2023-12-07T00:14:14.647247+0000","last_unstale":"2023-12-07T00:14:19.683381+0000","last_undegraded":"2023-12-07T00:14:19.683381+0000","last_fullsized":"2023-12-07T00:14:19.683381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367215+0000","last_change":"2023-12-07T00:14:19.073305+0000","last_active":"2023-12-07T00:14:21.367215+0000","last_peered":"2023-12-07T00:14:21.367215+0000","last_clean":"2023-12-07T00:14:21.367215+0000","last_became_active":"2023-12-07T00:14:19.072907+0000","last_became_peered":"2023-12-07T00:14:19.072907+0000","last_unstale":"2023-12-07T00:14:21.367215+0000","last_undegraded":"2023-12-07T00:14:21.367215+0000","last_fullsized":"2023-12-07T00:14:21.367215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:53:14.211329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889029+0000","last_change":"2023-12-07T00:14:13.626391+0000","last_active":"2023-12-07T00:14:19.889029+0000","last_peered":"2023-12-07T00:14:19.889029+0000","last_clean":"2023-12-07T00:14:19.889029+0000","last_became_active":"2023-12-07T00:14:13.626017+0000","last_became_peered":"2023-12-07T00:14:13.626017+0000","last_unstale":"2023-12-07T00:14:19.889029+0000","last_undegraded":"2023-12-07T00:14:19.889029+0000","last_fullsized":"2023-12-07T00:14:19.889029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:02:04.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890256+0000","last_change":"2023-12-07T00:14:14.647419+0000","last_active":"2023-12-07T00:14:19.890256+0000","last_peered":"2023-12-07T00:14:19.890256+0000","last_clean":"2023-12-07T00:14:19.890256+0000","last_became_active":"2023-12-07T00:14:14.647169+0000","last_became_peered":"2023-12-07T00:14:14.647169+0000","last_unstale":"2023-12-07T00:14:19.890256+0000","last_undegraded":"2023-12-07T00:14:19.890256+0000","last_fullsized":"2023-12-07T00:14:19.890256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:36.710499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683191+0000","last_change":"2023-12-07T00:14:14.643376+0000","last_active":"2023-12-07T00:14:19.683191+0000","last_peered":"2023-12-07T00:14:19.683191+0000","last_clean":"2023-12-07T00:14:19.683191+0000","last_became_active":"2023-12-07T00:14:14.643090+0000","last_became_peered":"2023-12-07T00:14:14.643090+0000","last_unstale":"2023-12-07T00:14:19.683191+0000","last_undegraded":"2023-12-07T00:14:19.683191+0000","last_fullsized":"2023-12-07T00:14:19.683191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888376+0000","last_change":"2023-12-07T00:14:14.639433+0000","last_active":"2023-12-07T00:14:19.888376+0000","last_peered":"2023-12-07T00:14:19.888376+0000","last_clean":"2023-12-07T00:14:19.888376+0000","last_became_active":"2023-12-07T00:14:14.639177+0000","last_became_peered":"2023-12-07T00:14:14.639177+0000","last_unstale":"2023-12-07T00:14:19.888376+0000","last_undegraded":"2023-12-07T00:14:19.888376+0000","last_fullsized":"2023-12-07T00:14:19.888376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:09.512398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682993+0000","last_change":"2023-12-07T00:14:14.647105+0000","last_active":"2023-12-07T00:14:19.682993+0000","last_peered":"2023-12-07T00:14:19.682993+0000","last_clean":"2023-12-07T00:14:19.682993+0000","last_became_active":"2023-12-07T00:14:14.646811+0000","last_became_peered":"2023-12-07T00:14:14.646811+0000","last_unstale":"2023-12-07T00:14:19.682993+0000","last_undegraded":"2023-12-07T00:14:19.682993+0000","last_fullsized":"2023-12-07T00:14:19.682993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:27.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889051+0000","last_change":"2023-12-07T00:14:14.658213+0000","last_active":"2023-12-07T00:14:19.889051+0000","last_peered":"2023-12-07T00:14:19.889051+0000","last_clean":"2023-12-07T00:14:19.889051+0000","last_became_active":"2023-12-07T00:14:14.657944+0000","last_became_peered":"2023-12-07T00:14:14.657944+0000","last_unstale":"2023-12-07T00:14:19.889051+0000","last_undegraded":"2023-12-07T00:14:19.889051+0000","last_fullsized":"2023-12-07T00:14:19.889051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680455+0000","last_change":"2023-12-07T00:14:14.650342+0000","last_active":"2023-12-07T00:14:19.680455+0000","last_peered":"2023-12-07T00:14:19.680455+0000","last_clean":"2023-12-07T00:14:19.680455+0000","last_became_active":"2023-12-07T00:14:14.650042+0000","last_became_peered":"2023-12-07T00:14:14.650042+0000","last_unstale":"2023-12-07T00:14:19.680455+0000","last_undegraded":"2023-12-07T00:14:19.680455+0000","last_fullsized":"2023-12-07T00:14:19.680455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889376+0000","last_change":"2023-12-07T00:14:14.649194+0000","last_active":"2023-12-07T00:14:19.889376+0000","last_peered":"2023-12-07T00:14:19.889376+0000","last_clean":"2023-12-07T00:14:19.889376+0000","last_became_active":"2023-12-07T00:14:14.648929+0000","last_became_peered":"2023-12-07T00:14:14.648929+0000","last_unstale":"2023-12-07T00:14:19.889376+0000","last_undegraded":"2023-12-07T00:14:19.889376+0000","last_fullsized":"2023-12-07T00:14:19.889376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683509+0000","last_change":"2023-12-07T00:14:14.643466+0000","last_active":"2023-12-07T00:14:19.683509+0000","last_peered":"2023-12-07T00:14:19.683509+0000","last_clean":"2023-12-07T00:14:19.683509+0000","last_became_active":"2023-12-07T00:14:14.643195+0000","last_became_peered":"2023-12-07T00:14:14.643195+0000","last_unstale":"2023-12-07T00:14:19.683509+0000","last_undegraded":"2023-12-07T00:14:19.683509+0000","last_fullsized":"2023-12-07T00:14:19.683509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680917+0000","last_change":"2023-12-07T00:14:14.647201+0000","last_active":"2023-12-07T00:14:19.680917+0000","last_peered":"2023-12-07T00:14:19.680917+0000","last_clean":"2023-12-07T00:14:19.680917+0000","last_became_active":"2023-12-07T00:14:14.646844+0000","last_became_peered":"2023-12-07T00:14:14.646844+0000","last_unstale":"2023-12-07T00:14:19.680917+0000","last_undegraded":"2023-12-07T00:14:19.680917+0000","last_fullsized":"2023-12-07T00:14:19.680917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682760+0000","last_change":"2023-12-07T00:14:14.652468+0000","last_active":"2023-12-07T00:14:19.682760+0000","last_peered":"2023-12-07T00:14:19.682760+0000","last_clean":"2023-12-07T00:14:19.682760+0000","last_became_active":"2023-12-07T00:14:14.652125+0000","last_became_peered":"2023-12-07T00:14:14.652125+0000","last_unstale":"2023-12-07T00:14:19.682760+0000","last_undegraded":"2023-12-07T00:14:19.682760+0000","last_fullsized":"2023-12-07T00:14:19.682760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680075+0000","last_change":"2023-12-07T00:14:14.646216+0000","last_active":"2023-12-07T00:14:19.680075+0000","last_peered":"2023-12-07T00:14:19.680075+0000","last_clean":"2023-12-07T00:14:19.680075+0000","last_became_active":"2023-12-07T00:14:14.645667+0000","last_became_peered":"2023-12-07T00:14:14.645667+0000","last_unstale":"2023-12-07T00:14:19.680075+0000","last_undegraded":"2023-12-07T00:14:19.680075+0000","last_fullsized":"2023-12-07T00:14:19.680075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683019+0000","last_change":"2023-12-07T00:14:14.643268+0000","last_active":"2023-12-07T00:14:19.683019+0000","last_peered":"2023-12-07T00:14:19.683019+0000","last_clean":"2023-12-07T00:14:19.683019+0000","last_became_active":"2023-12-07T00:14:14.642911+0000","last_became_peered":"2023-12-07T00:14:14.642911+0000","last_unstale":"2023-12-07T00:14:19.683019+0000","last_undegraded":"2023-12-07T00:14:19.683019+0000","last_fullsized":"2023-12-07T00:14:19.683019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889125+0000","last_change":"2023-12-07T00:14:14.654077+0000","last_active":"2023-12-07T00:14:19.889125+0000","last_peered":"2023-12-07T00:14:19.889125+0000","last_clean":"2023-12-07T00:14:19.889125+0000","last_became_active":"2023-12-07T00:14:14.653784+0000","last_became_peered":"2023-12-07T00:14:14.653784+0000","last_unstale":"2023-12-07T00:14:19.889125+0000","last_undegraded":"2023-12-07T00:14:19.889125+0000","last_fullsized":"2023-12-07T00:14:19.889125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:14.081556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683657+0000","last_change":"2023-12-07T00:14:14.647010+0000","last_active":"2023-12-07T00:14:19.683657+0000","last_peered":"2023-12-07T00:14:19.683657+0000","last_clean":"2023-12-07T00:14:19.683657+0000","last_became_active":"2023-12-07T00:14:14.646731+0000","last_became_peered":"2023-12-07T00:14:14.646731+0000","last_unstale":"2023-12-07T00:14:19.683657+0000","last_undegraded":"2023-12-07T00:14:19.683657+0000","last_fullsized":"2023-12-07T00:14:19.683657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":707149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":116359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":897024,"data_stored":707205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":116325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":116289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T00:14:33.194 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T00:14:33.194 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-07T00:14:33.194 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-07T00:14:33.194 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-07T00:14:33.194 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-07T00:14:33.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.349+0000 7ff6c5a4b700 1 Processor -- start 2023-12-07T00:14:33.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.349+0000 7ff6c5a4b700 1 -- start start 2023-12-07T00:14:33.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6c5a4b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00d1090 0x7ff6c01624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6c5a4b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c0162a00 con 0x7ff6c015dd50 2023-12-07T00:14:33.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6c5a4b700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c00d1dc0 con 0x7ff6c015e130 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6c5a4b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00ce9f0 con 0x7ff6c00d1090 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6beffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff6c015dd50 0x7ff6c00d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46164/0 (socket says 172.21.15.179:46164) 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6beffd700 1 -- 172.21.15.179:0/3476555800 learned_addr learned my addr 172.21.15.179:0/3476555800 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6be7fc700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00d1090 0x7ff6c01624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065105567 0 0) 0x7ff6b0001110 con 0x7ff6c015dd50 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a80035b0 con 0x7ff6c015dd50 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1464012731 0 0) 0x7ff6a80035b0 con 0x7ff6c015dd50 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00d1090 msgr2=0x7ff6c01624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00d1090 0x7ff6c01624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 >> v1:172.21.15.190:6789/0 conn(0x7ff6c015e130 legacy=0x7ff6c00d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00cecd0 con 0x7ff6c015dd50 2023-12-07T00:14:33.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7ff6b0001800 con 0x7ff6c015dd50 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 >> v1:172.21.15.179:6789/0 conn(0x7ff6c015dd50 legacy=0x7ff6c00d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6a8003a30 0x7ff6a8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.350+0000 7ff6bdffb700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8004850 0x7ff6a8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6bdffb700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00d1090 0x7ff6a8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c00ce9f0 con 0x7ff6a8003a30 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a800bb50 con 0x7ff6a8004850 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a800bd10 con 0x7ff6c00d1090 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6beffd700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6a8003a30 0x7ff6a8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6be7fc700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8004850 0x7ff6a8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6bf7fe700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00d1090 0x7ff6a8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6beffd700 1 -- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00d1090 msgr2=0x7ff6a8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6beffd700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00d1090 0x7ff6a8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6beffd700 1 -- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8004850 msgr2=0x7ff6a8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6beffd700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8004850 0x7ff6a8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6beffd700 1 -- 172.21.15.179:0/3476555800 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80035b0 con 0x7ff6a8003a30 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6be7fc700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8004850 0x7ff6a8004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6beffd700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6a8003a30 0x7ff6a8003e50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000c210 tx=0x7ff6a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b8eba6880afb9f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0007db0 con 0x7ff6a8003a30 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b000cdd0 con 0x7ff6a8003a30 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.351+0000 7ff6bdffb700 1 -- 172.21.15.179:0/3476555800 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0005ba0 con 0x7ff6a8003a30 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.352+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3476555800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6a8003a30 msgr2=0x7ff6a8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.352+0000 7ff6c5a4b700 1 --2- 172.21.15.179:0/3476555800 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6a8003a30 0x7ff6a8003e50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff6b000c210 tx=0x7ff6a8005880 comp rx=0 tx=0).stop 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.352+0000 7ff6bf7fe700 1 -- 172.21.15.179:0/3476555800 reap_dead start 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.352+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3476555800 shutdown_connections 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.352+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3476555800 >> 172.21.15.179:0/3476555800 conn(0x7ff6c006c8e0 msgr2=0x7ff6c006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.352+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3476555800 shutdown_connections 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.352+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3476555800 wait complete. 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.353+0000 7ff6c5a4b700 1 Processor -- start 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.353+0000 7ff6c5a4b700 1 -- start start 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6c5a4b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8003a30 0x7ff6c01e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6c5a4b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00b1f30 0x7ff6c01ea8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6c5a4b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c01eae00 0x7ff6c01603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6c5a4b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01496b0 con 0x7ff6c01eae00 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6c5a4b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c01eb280 con 0x7ff6a8003a30 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6c5a4b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c0148aa0 con 0x7ff6c00b1f30 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c01eae00 0x7ff6c01603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c01eae00 0x7ff6c01603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39278/0 (socket says 172.21.15.179:39278) 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 -- 172.21.15.179:0/3934100445 learned_addr learned my addr 172.21.15.179:0/3934100445 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6beffd700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8003a30 0x7ff6c01e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6be7fc700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00b1f30 0x7ff6c01ea8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 -- 172.21.15.179:0/3934100445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00b1f30 msgr2=0x7ff6c01ea8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00b1f30 0x7ff6c01ea8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 -- 172.21.15.179:0/3934100445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8003a30 msgr2=0x7ff6c01e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8003a30 0x7ff6c01e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 -- 172.21.15.179:0/3934100445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0148d80 con 0x7ff6c01eae00 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.354+0000 7ff6bf7fe700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c01eae00 0x7ff6c01603d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6c015e510 tx=0x7ff6b800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.355+0000 7ff6a7fff700 1 -- 172.21.15.179:0/3934100445 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b800eee0 con 0x7ff6c01eae00 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.355+0000 7ff6a7fff700 1 -- 172.21.15.179:0/3934100445 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8003c10 con 0x7ff6c01eae00 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.355+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c0149060 con 0x7ff6c01eae00 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.355+0000 7ff6a7fff700 1 -- 172.21.15.179:0/3934100445 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80050d0 con 0x7ff6c01eae00 2023-12-07T00:14:33.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.355+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c00b23b0 con 0x7ff6c01eae00 2023-12-07T00:14:33.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.355+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0067ee0 con 0x7ff6c01eae00 2023-12-07T00:14:33.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.356+0000 7ff6a7fff700 1 -- 172.21.15.179:0/3934100445 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6b8005230 con 0x7ff6c01eae00 2023-12-07T00:14:33.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.357+0000 7ff6a7fff700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff6ac06af00 0x7ff6ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.357+0000 7ff6a7fff700 1 -- 172.21.15.179:0/3934100445 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff6b808a1e0 con 0x7ff6c01eae00 2023-12-07T00:14:33.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.357+0000 7ff6beffd700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff6ac06af00 0x7ff6ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.357+0000 7ff6beffd700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff6ac06af00 0x7ff6ac06d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0001ac0 tx=0x7ff6b0007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:33.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.361+0000 7ff6a7fff700 1 -- 172.21.15.179:0/3934100445 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6b8055080 con 0x7ff6c01eae00 2023-12-07T00:14:33.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.610+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff6c01497f0 con 0x7ff6c01eae00 2023-12-07T00:14:33.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.613+0000 7ff6a7fff700 1 -- 172.21.15.179:0/3934100445 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171039 (secure 0 0 0) 0x7ff6c01497f0 con 0x7ff6c01eae00 2023-12-07T00:14:33.614 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:33.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff6ac06af00 msgr2=0x7ff6ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff6ac06af00 0x7ff6ac06d3c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6b0001ac0 tx=0x7ff6b0007000 comp rx=0 tx=0).stop 2023-12-07T00:14:33.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c01eae00 msgr2=0x7ff6c01603d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c01eae00 0x7ff6c01603d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff6c015e510 tx=0x7ff6b800ed50 comp rx=0 tx=0).stop 2023-12-07T00:14:33.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 shutdown_connections 2023-12-07T00:14:33.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff6ac06af00 0x7ff6ac06d3c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff6c01eae00 0x7ff6c01603d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff6a8003a30 0x7ff6c01e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 --2- 172.21.15.179:0/3934100445 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff6c00b1f30 0x7ff6c01ea8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.615+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 >> 172.21.15.179:0/3934100445 conn(0x7ff6c006c8e0 msgr2=0x7ff6c006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:33.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.616+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 shutdown_connections 2023-12-07T00:14:33.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.616+0000 7ff6c5a4b700 1 -- 172.21.15.179:0/3934100445 wait complete. 2023-12-07T00:14:33.627 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":1592863421},{"type":"v1","addr":"172.21.15.179:6833","nonce":1592863421}]},"active_addr":"172.21.15.179:6833/1592863421","active_change":"2023-12-07T00:13:54.501966+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2133331344}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2413978163}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":1562038159}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.179:0","nonce":2273884524}]}]} 2023-12-07T00:14:33.630 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-07T00:14:33.630 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-07T00:14:33.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:33.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.753+0000 7f35a15b8700 1 Processor -- start 2023-12-07T00:14:33.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.753+0000 7f35a15b8700 1 -- start start 2023-12-07T00:14:33.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f35a15b8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f359c15e130 0x7f359c1624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f35a15b8700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c162a00 con 0x7f359c0d1090 2023-12-07T00:14:33.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f35a15b8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c0d1dc0 con 0x7f359c15dd50 2023-12-07T00:14:33.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f35a15b8700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0ce9f0 con 0x7f359c15e130 2023-12-07T00:14:33.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f359a7fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f359c0d1090 0x7f359c0d2250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46186/0 (socket says 172.21.15.179:46186) 2023-12-07T00:14:33.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f359a7fc700 1 -- 172.21.15.179:0/1561291465 learned_addr learned my addr 172.21.15.179:0/1561291465 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:33.755 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f359b7fe700 1 --2- 172.21.15.179:0/1561291465 >> v2:172.21.15.190:3300/0 conn(0x7f359c15e130 0x7f359c1624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522315801 0 0) 0x7f358c001110 con 0x7f359c0d1090 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35840035b0 con 0x7f359c0d1090 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 766862703 0 0) 0x7f35840035b0 con 0x7f359c0d1090 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 >> v2:172.21.15.190:3300/0 conn(0x7f359c15e130 msgr2=0x7f359c1624c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 --2- 172.21.15.179:0/1561291465 >> v2:172.21.15.190:3300/0 conn(0x7f359c15e130 0x7f359c1624c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 >> v1:172.21.15.190:6789/0 conn(0x7f359c15dd50 legacy=0x7f359c0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c0cecd0 con 0x7f359c0d1090 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f358c001800 con 0x7f359c0d1090 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 >> v1:172.21.15.179:6789/0 conn(0x7f359c0d1090 legacy=0x7f359c0d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3584003a00 0x7f3584003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584004850 0x7f3584004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f358400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0ce9f0 con 0x7f3584005210 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358400c0b0 con 0x7f3584004850 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.754+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358400c270 con 0x7f3584003a00 2023-12-07T00:14:33.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359b7fe700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f358400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359a7fc700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584004850 0x7f3584004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359affd700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3584003a00 0x7f3584003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359b7fe700 1 -- 172.21.15.179:0/1561291465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3584003a00 msgr2=0x7f3584003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:33.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359b7fe700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3584003a00 0x7f3584003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359b7fe700 1 -- 172.21.15.179:0/1561291465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584004850 msgr2=0x7f3584004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:33.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359b7fe700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3584004850 0x7f3584004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359b7fe700 1 -- 172.21.15.179:0/1561291465 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35840035b0 con 0x7f3584005210 2023-12-07T00:14:33.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359b7fe700 1 -- 172.21.15.179:0/1561291465 reap_dead start 2023-12-07T00:14:33.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f359b7fe700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f358400ba10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f359c0b6d90 tx=0x7f3584005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406d8853ac6d6b52 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:33.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594018070 con 0x7f3584005210 2023-12-07T00:14:33.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359400f040 con 0x7f3584005210 2023-12-07T00:14:33.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f3599ffb700 1 -- 172.21.15.179:0/1561291465 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359400ebd0 con 0x7f3584005210 2023-12-07T00:14:33.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f35a15b8700 1 -- 172.21.15.179:0/1561291465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 msgr2=0x7f358400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.755+0000 7f35a15b8700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f358400ba10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f359c0b6d90 tx=0x7f3584005880 comp rx=0 tx=0).stop 2023-12-07T00:14:33.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.756+0000 7f35a15b8700 1 -- 172.21.15.179:0/1561291465 shutdown_connections 2023-12-07T00:14:33.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.756+0000 7f35a15b8700 1 --2- 172.21.15.179:0/1561291465 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f358400ba10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.756+0000 7f35a15b8700 1 -- 172.21.15.179:0/1561291465 >> 172.21.15.179:0/1561291465 conn(0x7f359c06c8e0 msgr2=0x7f359c06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.756+0000 7f35a15b8700 1 -- 172.21.15.179:0/1561291465 shutdown_connections 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.756+0000 7f35a15b8700 1 -- 172.21.15.179:0/1561291465 wait complete. 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.757+0000 7f35a15b8700 1 Processor -- start 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.757+0000 7f35a15b8700 1 -- start start 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35a15b8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f359c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35a15b8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f359c159f60 0x7f359c0aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35a15b8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f359c0aab10 0x7f359c14c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35a15b8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0cbb70 con 0x7f3584005210 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35a15b8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c14adc0 con 0x7f359c159f60 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35a15b8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c14a1b0 con 0x7f359c0aab10 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f359c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f359c0cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39294/0 (socket says 172.21.15.179:39294) 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 -- 172.21.15.179:0/4167127167 learned_addr learned my addr 172.21.15.179:0/4167127167 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:33.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359b7fe700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f359c0aab10 0x7f359c14c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359a7fc700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f359c159f60 0x7f359c0aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 -- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f359c0aab10 msgr2=0x7f359c14c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f359c0aab10 0x7f359c14c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 -- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f359c159f60 msgr2=0x7f359c0aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f359c159f60 0x7f359c0aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 -- 172.21.15.179:0/4167127167 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c14a490 con 0x7f3584005210 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359a7fc700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f359c159f60 0x7f359c0aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f359affd700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f359c0cb630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f359000f820 tx=0x7f359000fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35837fe700 1 -- 172.21.15.179:0/4167127167 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35900052e0 con 0x7f3584005210 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35837fe700 1 -- 172.21.15.179:0/4167127167 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590005440 con 0x7f3584005210 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35837fe700 1 -- 172.21.15.179:0/4167127167 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35900038a0 con 0x7f3584005210 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c14a770 con 0x7f3584005210 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.758+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c15a3c0 con 0x7f3584005210 2023-12-07T00:14:33.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.759+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c067ee0 con 0x7f3584005210 2023-12-07T00:14:33.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.760+0000 7f35837fe700 1 -- 172.21.15.179:0/4167127167 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3590003a00 con 0x7f3584005210 2023-12-07T00:14:33.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.760+0000 7f35837fe700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f358806af00 0x7f358806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:33.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.760+0000 7f35837fe700 1 -- 172.21.15.179:0/4167127167 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3590089640 con 0x7f3584005210 2023-12-07T00:14:33.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.760+0000 7f359a7fc700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f358806af00 0x7f358806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:33.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.760+0000 7f359a7fc700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f358806af00 0x7f358806d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f358c001760 tx=0x7f358c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:33.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.765+0000 7f35837fe700 1 -- 172.21.15.179:0/4167127167 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3590054490 con 0x7f3584005210 2023-12-07T00:14:33.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.955+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f359c0b5810 con 0x7f3584005210 2023-12-07T00:14:33.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.956+0000 7f35837fe700 1 -- 172.21.15.179:0/4167127167 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f3590003cb0 con 0x7f3584005210 2023-12-07T00:14:33.955 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:33.955 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:33.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f358806af00 msgr2=0x7f358806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f358806af00 0x7f358806d3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f358c001760 tx=0x7f358c009040 comp rx=0 tx=0).stop 2023-12-07T00:14:33.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 msgr2=0x7f359c0cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:33.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f359c0cb630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f359000f820 tx=0x7f359000fbe0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 shutdown_connections 2023-12-07T00:14:33.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f358806af00 0x7f358806d3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f359c0aab10 0x7f359c14c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3584005210 0x7f359c0cb630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 --2- 172.21.15.179:0/4167127167 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f359c159f60 0x7f359c0aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:33.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 >> 172.21.15.179:0/4167127167 conn(0x7f359c06c8e0 msgr2=0x7f359c0b36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:33.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 shutdown_connections 2023-12-07T00:14:33.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:33.958+0000 7f35a15b8700 1 -- 172.21.15.179:0/4167127167 wait complete. 2023-12-07T00:14:33.970 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-07T00:14:33.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:34.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.091+0000 7f9d4fe0f700 1 Processor -- start 2023-12-07T00:14:34.090 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.091+0000 7f9d4fe0f700 1 -- start start 2023-12-07T00:14:34.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4fe0f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480d0070 0x7f9d480b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4fe0f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d480673b0 con 0x7f9d48066ef0 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4fe0f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4815e440 con 0x7f9d480ad0d0 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4fe0f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480b04a0 con 0x7f9d480d0070 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4d3aa700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9d48066ef0 0x7f9d480d0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46204/0 (socket says 172.21.15.179:46204) 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4d3aa700 1 -- 172.21.15.179:0/2743618889 learned_addr learned my addr 172.21.15.179:0/2743618889 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4dbab700 1 --2- 172.21.15.179:0/2743618889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480d0070 0x7f9d480b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4cba9700 1 -- 172.21.15.179:0/2743618889 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872978861 0 0) 0x7f9d480673b0 con 0x7f9d48066ef0 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4cba9700 1 -- 172.21.15.179:0/2743618889 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d340035b0 con 0x7f9d48066ef0 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4dbab700 1 -- 172.21.15.179:0/2743618889 >> v1:172.21.15.190:6789/0 conn(0x7f9d480ad0d0 legacy=0x7f9d480ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4cba9700 1 -- 172.21.15.179:0/2743618889 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451914211 0 0) 0x7f9d4815e440 con 0x7f9d480ad0d0 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4dbab700 1 -- 172.21.15.179:0/2743618889 >> v1:172.21.15.179:6789/0 conn(0x7f9d48066ef0 legacy=0x7f9d480d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.092+0000 7f9d4dbab700 1 -- 172.21.15.179:0/2743618889 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480afb00 con 0x7f9d480d0070 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4dbab700 1 --2- 172.21.15.179:0/2743618889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480d0070 0x7f9d480b3c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009870 tx=0x7f9d44009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c64ef6353ad3a639 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4cba9700 1 -- 172.21.15.179:0/2743618889 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44011830 con 0x7f9d480d0070 2023-12-07T00:14:34.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4cba9700 1 -- 172.21.15.179:0/2743618889 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d44011990 con 0x7f9d480d0070 2023-12-07T00:14:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4cba9700 1 -- 172.21.15.179:0/2743618889 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44011d20 con 0x7f9d480d0070 2023-12-07T00:14:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2743618889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480d0070 msgr2=0x7f9d480b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4fe0f700 1 --2- 172.21.15.179:0/2743618889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480d0070 0x7f9d480b3c50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d44009870 tx=0x7f9d44009b80 comp rx=0 tx=0).stop 2023-12-07T00:14:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2743618889 shutdown_connections 2023-12-07T00:14:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4fe0f700 1 --2- 172.21.15.179:0/2743618889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480d0070 0x7f9d480b3c50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2743618889 >> 172.21.15.179:0/2743618889 conn(0x7f9d48072660 msgr2=0x7f9d480b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2743618889 shutdown_connections 2023-12-07T00:14:34.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.093+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2743618889 wait complete. 2023-12-07T00:14:34.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.094+0000 7f9d4fe0f700 1 Processor -- start 2023-12-07T00:14:34.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4fe0f700 1 -- start start 2023-12-07T00:14:34.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4fe0f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d48066ef0 0x7f9d4814c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4fe0f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480ad0d0 0x7f9d480ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4fe0f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d480d0070 0x7f9d4815c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4fe0f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4814c810 con 0x7f9d48066ef0 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4fe0f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480ca910 con 0x7f9d480d0070 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4fe0f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d480cabf0 con 0x7f9d480ad0d0 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4dbab700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d48066ef0 0x7f9d4814c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4dbab700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d48066ef0 0x7f9d4814c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39308/0 (socket says 172.21.15.179:39308) 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4dbab700 1 -- 172.21.15.179:0/2345081054 learned_addr learned my addr 172.21.15.179:0/2345081054 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4d3aa700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480ad0d0 0x7f9d480ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.095+0000 7f9d4e3ac700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d480d0070 0x7f9d4815c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d4dbab700 1 -- 172.21.15.179:0/2345081054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480ad0d0 msgr2=0x7f9d480ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d4dbab700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480ad0d0 0x7f9d480ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d4dbab700 1 -- 172.21.15.179:0/2345081054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d480d0070 msgr2=0x7f9d4815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d4dbab700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d480d0070 0x7f9d4815c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d4dbab700 1 -- 172.21.15.179:0/2345081054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d440094a0 con 0x7f9d48066ef0 2023-12-07T00:14:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d4dbab700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d48066ef0 0x7f9d4814c2d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d44014040 tx=0x7f9d44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d3e7fc700 1 -- 172.21.15.179:0/2345081054 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4401a970 con 0x7f9d48066ef0 2023-12-07T00:14:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d3e7fc700 1 -- 172.21.15.179:0/2345081054 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4401aaf0 con 0x7f9d48066ef0 2023-12-07T00:14:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d480caed0 con 0x7f9d48066ef0 2023-12-07T00:14:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d3e7fc700 1 -- 172.21.15.179:0/2345081054 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4401aea0 con 0x7f9d48066ef0 2023-12-07T00:14:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.096+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d480cd030 con 0x7f9d48066ef0 2023-12-07T00:14:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.097+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d480685f0 con 0x7f9d48066ef0 2023-12-07T00:14:34.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.097+0000 7f9d3e7fc700 1 -- 172.21.15.179:0/2345081054 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d440243f0 con 0x7f9d48066ef0 2023-12-07T00:14:34.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.098+0000 7f9d3e7fc700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9d2c06aed0 0x7f9d2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.098+0000 7f9d3e7fc700 1 -- 172.21.15.179:0/2345081054 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d4408aa30 con 0x7f9d48066ef0 2023-12-07T00:14:34.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.098+0000 7f9d4d3aa700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9d2c06aed0 0x7f9d2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.098+0000 7f9d4d3aa700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9d2c06aed0 0x7f9d2c06d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d4815d600 tx=0x7f9d38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.102+0000 7f9d3e7fc700 1 -- 172.21.15.179:0/2345081054 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d440559a0 con 0x7f9d48066ef0 2023-12-07T00:14:34.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.292+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d480ae960 con 0x7f9d48066ef0 2023-12-07T00:14:34.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.293+0000 7f9d3e7fc700 1 -- 172.21.15.179:0/2345081054 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f9d44015020 con 0x7f9d48066ef0 2023-12-07T00:14:34.293 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:34.293 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:34.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9d2c06aed0 msgr2=0x7f9d2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9d2c06aed0 0x7f9d2c06d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9d4815d600 tx=0x7f9d38009040 comp rx=0 tx=0).stop 2023-12-07T00:14:34.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d48066ef0 msgr2=0x7f9d4814c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d48066ef0 0x7f9d4814c2d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d44014040 tx=0x7f9d44004750 comp rx=0 tx=0).stop 2023-12-07T00:14:34.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 shutdown_connections 2023-12-07T00:14:34.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9d2c06aed0 0x7f9d2c06d390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d480d0070 0x7f9d4815c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9d48066ef0 0x7f9d4814c2d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 --2- 172.21.15.179:0/2345081054 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d480ad0d0 0x7f9d480ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 >> 172.21.15.179:0/2345081054 conn(0x7f9d48072660 msgr2=0x7f9d481570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 shutdown_connections 2023-12-07T00:14:34.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.296+0000 7f9d4fe0f700 1 -- 172.21.15.179:0/2345081054 wait complete. 2023-12-07T00:14:34.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-07T00:14:34.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-07T00:14:34.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-07T00:14:34.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-07T00:14:34.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-07T00:14:34.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-07T00:14:34.310 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-07T00:14:34.310 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-07T00:14:34.517 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.517+0000 7f79621f4700 1 Processor -- start 2023-12-07T00:14:34.518 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.518+0000 7f79621f4700 1 -- start start 2023-12-07T00:14:34.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7fc5f484e700 1 Processor -- start 2023-12-07T00:14:34.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f79621f4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f795c06fb60 0x7f795c070010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f79621f4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c0b2d80 0x7f795c0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f79621f4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c06e1f0 con 0x7f795c1477c0 2023-12-07T00:14:34.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f79621f4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c070550 con 0x7f795c06fb60 2023-12-07T00:14:34.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f79621f4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c147ba0 con 0x7f795c0b2d80 2023-12-07T00:14:34.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7fc5f484e700 1 -- start start 2023-12-07T00:14:34.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f795affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f795c06fb60 0x7f795c070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f795affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f795c06fb60 0x7f795c070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39320/0 (socket says 172.21.15.179:39320) 2023-12-07T00:14:34.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f795affd700 1 -- 172.21.15.179:0/2849695277 learned_addr learned my addr 172.21.15.179:0/2849695277 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.520+0000 7f795bfff700 1 --2- 172.21.15.179:0/2849695277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c0b2d80 0x7f795c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795affd700 1 -- 172.21.15.179:0/2849695277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c0b2d80 msgr2=0x7f795c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795affd700 1 --2- 172.21.15.179:0/2849695277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c0b2d80 0x7f795c0b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795affd700 1 -- 172.21.15.179:0/2849695277 >> v1:172.21.15.179:6789/0 conn(0x7f795c1477c0 legacy=0x7f795c0aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795affd700 1 -- 172.21.15.179:0/2849695277 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c06e4d0 con 0x7f795c06fb60 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795bfff700 1 --2- 172.21.15.179:0/2849695277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c0b2d80 0x7f795c0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795affd700 1 --2- 172.21.15.179:0/2849695277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 0x7f795c070010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79500098f0 tx=0x7f7950009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7becae61efe1855 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795a7fc700 1 -- 172.21.15.179:0/2849695277 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950004230 con 0x7f795c06fb60 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795a7fc700 1 -- 172.21.15.179:0/2849695277 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7950004390 con 0x7f795c06fb60 2023-12-07T00:14:34.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7f795a7fc700 1 -- 172.21.15.179:0/2849695277 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500036a0 con 0x7f795c06fb60 2023-12-07T00:14:34.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7fc5f484e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc5f00b2f80 0x7fc5f015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7fc5f484e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f00ce000 con 0x7fc5f0143540 2023-12-07T00:14:34.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7fc5f484e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f015a770 con 0x7fc5f00723d0 2023-12-07T00:14:34.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.521+0000 7fc5f484e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f0143920 con 0x7fc5f00b2f80 2023-12-07T00:14:34.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ee59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc5f0143540 0x7fc5f0071cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46228/0 (socket says 172.21.15.179:46228) 2023-12-07T00:14:34.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ee59c700 1 -- 172.21.15.179:0/1246997517 learned_addr learned my addr 172.21.15.179:0/1246997517 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:34.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623108591 0 0) 0x7fc5f00ce000 con 0x7fc5f0143540 2023-12-07T00:14:34.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5d80035b0 con 0x7fc5f0143540 2023-12-07T00:14:34.523 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fce65c72700 1 Processor -- start 2023-12-07T00:14:34.523 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 525573754 0 0) 0x7fc5d80035b0 con 0x7fc5f0143540 2023-12-07T00:14:34.523 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 >> v2:172.21.15.190:3300/0 conn(0x7fc5f00b2f80 msgr2=0x7fc5f015e290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T00:14:34.523 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 --2- 172.21.15.179:0/1246997517 >> v2:172.21.15.190:3300/0 conn(0x7fc5f00b2f80 0x7fc5f015e290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.523 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 >> v1:172.21.15.190:6789/0 conn(0x7fc5f00723d0 legacy=0x7fc5f00ce530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T00:14:34.523 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f015aa50 con 0x7fc5f0143540 2023-12-07T00:14:34.523 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fc5e0001670 con 0x7fc5f0143540 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 >> v1:172.21.15.179:6789/0 conn(0x7fc5f0143540 legacy=0x7fc5f0071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d8003a00 0x7fc5d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5d8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5d8005330 0x7fc5d800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f0143920 con 0x7fc5d8004850 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d800c230 con 0x7fc5d8003a00 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d800c3f0 con 0x7fc5d8005330 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7f79621f4700 1 -- 172.21.15.179:0/2849695277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 msgr2=0x7f795c070010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.524 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7f79621f4700 1 --2- 172.21.15.179:0/2849695277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 0x7f795c070010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f79500098f0 tx=0x7f7950009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:34.525 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fc5edd9b700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5d8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.525 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fc5ee59c700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d8003a00 0x7fc5d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.525 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7f79621f4700 1 -- 172.21.15.179:0/2849695277 shutdown_connections 2023-12-07T00:14:34.525 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7f79621f4700 1 --2- 172.21.15.179:0/2849695277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c0b2d80 0x7f795c0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.525 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7f79621f4700 1 --2- 172.21.15.179:0/2849695277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 0x7f795c070010 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.525 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7f79621f4700 1 -- 172.21.15.179:0/2849695277 >> 172.21.15.179:0/2849695277 conn(0x7f795c0b1a80 msgr2=0x7f795c0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.525 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fc5edd9b700 1 -- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5d8005330 msgr2=0x7fc5d800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7f79621f4700 1 -- 172.21.15.179:0/2849695277 shutdown_connections 2023-12-07T00:14:34.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.522+0000 7fce65c72700 1 -- start start 2023-12-07T00:14:34.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fce65c72700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce60143540 0x7fce6015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fce65c72700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce600b2f80 0x7fce60071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fce65c72700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce600ce000 con 0x7fce6015a260 2023-12-07T00:14:34.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fce65c72700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce60143920 con 0x7fce600b2f80 2023-12-07T00:14:34.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fce65c72700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6015a770 con 0x7fce60143540 2023-12-07T00:14:34.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7fc5eed9d700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5d8005330 0x7fc5d800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fc5edd9b700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5d8005330 0x7fc5d800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fc5edd9b700 1 -- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d8003a00 msgr2=0x7fc5d8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fc5edd9b700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5d8003a00 0x7fc5d8003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fc5edd9b700 1 -- 172.21.15.179:0/1246997517 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f015aa50 con 0x7fc5d8004850 2023-12-07T00:14:34.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fc5eed9d700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5d8005330 0x7fc5d800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:34.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fc5eed9d700 1 -- 172.21.15.179:0/1246997517 reap_dead start 2023-12-07T00:14:34.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.523+0000 7f79621f4700 1 -- 172.21.15.179:0/2849695277 wait complete. 2023-12-07T00:14:34.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fc5edd9b700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5d8004cd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00b3360 tx=0x7fc5d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8f047d44a50d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7f79621f4700 1 Processor -- start 2023-12-07T00:14:34.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40092f0 con 0x7fc5d8004850 2023-12-07T00:14:34.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e4011620 con 0x7fc5d8004850 2023-12-07T00:14:34.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7fc5ed59a700 1 -- 172.21.15.179:0/1246997517 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e40119b0 con 0x7fc5d8004850 2023-12-07T00:14:34.531 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7ffa8e9c5700 1 Processor -- start 2023-12-07T00:14:34.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fc5f484e700 1 -- 172.21.15.179:0/1246997517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 msgr2=0x7fc5d8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fc5f484e700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5d8004cd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00b3360 tx=0x7fc5d8005880 comp rx=0 tx=0).stop 2023-12-07T00:14:34.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fc5f484e700 1 -- 172.21.15.179:0/1246997517 shutdown_connections 2023-12-07T00:14:34.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fc5f484e700 1 --2- 172.21.15.179:0/1246997517 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5d8004cd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fc5f484e700 1 -- 172.21.15.179:0/1246997517 >> 172.21.15.179:0/1246997517 conn(0x7fc5f006af70 msgr2=0x7fc5f006b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7f79621f4700 1 -- start start 2023-12-07T00:14:34.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f79621f4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 0x7f795c1f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f79621f4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f795c0b2d80 0x7f795c15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f79621f4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c1477c0 0x7f795c1f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f79621f4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c1f7b50 con 0x7f795c06fb60 2023-12-07T00:14:34.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f79621f4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c13d060 con 0x7f795c0b2d80 2023-12-07T00:14:34.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f79621f4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c1f84b0 con 0x7f795c1477c0 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fce5effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce600b2f80 0x7fce60071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fce5effd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fce600b2f80 0x7fce60071cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39334/0 (socket says 172.21.15.179:39334) 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fce5effd700 1 -- 172.21.15.179:0/1417446011 learned_addr learned my addr 172.21.15.179:0/1417446011 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fce5effd700 1 -- 172.21.15.179:0/1417446011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce60143540 msgr2=0x7fce6015e290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fce5effd700 1 --2- 172.21.15.179:0/1417446011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce60143540 0x7fce6015e290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fce5effd700 1 -- 172.21.15.179:0/1417446011 >> v1:172.21.15.179:6789/0 conn(0x7fce6015a260 legacy=0x7fce6006d6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.524+0000 7fce5effd700 1 -- 172.21.15.179:0/1417446011 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6015aa50 con 0x7fce600b2f80 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7fce5effd700 1 --2- 172.21.15.179:0/1417446011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 0x7fce60071cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fce5000a990 tx=0x7fce50009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da046ccf48f9129a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7fce5e7fc700 1 -- 172.21.15.179:0/1417446011 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50004030 con 0x7fce600b2f80 2023-12-07T00:14:34.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7fce5e7fc700 1 -- 172.21.15.179:0/1417446011 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce50004190 con 0x7fce600b2f80 2023-12-07T00:14:34.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7fce5e7fc700 1 -- 172.21.15.179:0/1417446011 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce50004520 con 0x7fce600b2f80 2023-12-07T00:14:34.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fce65c72700 1 -- 172.21.15.179:0/1417446011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 msgr2=0x7fce60071cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fce65c72700 1 --2- 172.21.15.179:0/1417446011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 0x7fce60071cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fce5000a990 tx=0x7fce50009520 comp rx=0 tx=0).stop 2023-12-07T00:14:34.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f795b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 0x7f795c1f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f795b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 0x7f795c1f7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39336/0 (socket says 172.21.15.179:39336) 2023-12-07T00:14:34.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7f795b7fe700 1 -- 172.21.15.179:0/3438485607 learned_addr learned my addr 172.21.15.179:0/3438485607 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fce65c72700 1 -- 172.21.15.179:0/1417446011 shutdown_connections 2023-12-07T00:14:34.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fce65c72700 1 --2- 172.21.15.179:0/1417446011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce60143540 0x7fce6015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.537 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fce65c72700 1 --2- 172.21.15.179:0/1417446011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 0x7fce60071cc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.538 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.526+0000 7fce65c72700 1 -- 172.21.15.179:0/1417446011 >> 172.21.15.179:0/1417446011 conn(0x7fce6006af70 msgr2=0x7fce6006b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7fc5f484e700 1 -- 172.21.15.179:0/1246997517 shutdown_connections 2023-12-07T00:14:34.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7fce65c72700 1 -- 172.21.15.179:0/1417446011 shutdown_connections 2023-12-07T00:14:34.539 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7f2c5d573700 1 Processor -- start 2023-12-07T00:14:34.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.525+0000 7ffa8e9c5700 1 -- start start 2023-12-07T00:14:34.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa8e9c5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa88143540 0x7ffa8815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa8e9c5700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffa880b2f80 0x7ffa88071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa8e9c5700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffa8815a260 0x7ffa88072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa8e9c5700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa88143920 con 0x7ffa8815a260 2023-12-07T00:14:34.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa8e9c5700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880ce000 con 0x7ffa880b2f80 2023-12-07T00:14:34.541 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa8e9c5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8815a770 con 0x7ffa88143540 2023-12-07T00:14:34.541 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa87fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa88143540 0x7ffa8815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa87fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa88143540 0x7ffa8815e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39756/0 (socket says 172.21.15.179:39756) 2023-12-07T00:14:34.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa87fff700 1 -- 172.21.15.179:0/2671694834 learned_addr learned my addr 172.21.15.179:0/2671694834 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7f2c5d573700 1 -- start start 2023-12-07T00:14:34.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7fc5f484e700 1 -- 172.21.15.179:0/1246997517 wait complete. 2023-12-07T00:14:34.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa87fff700 1 -- 172.21.15.179:0/2671694834 >> v2:172.21.15.190:3300/0 conn(0x7ffa880b2f80 msgr2=0x7ffa88071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa87fff700 1 --2- 172.21.15.179:0/2671694834 >> v2:172.21.15.190:3300/0 conn(0x7ffa880b2f80 0x7ffa88071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa87fff700 1 -- 172.21.15.179:0/2671694834 >> v2:172.21.15.179:3300/0 conn(0x7ffa8815a260 msgr2=0x7ffa88072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa87fff700 1 --2- 172.21.15.179:0/2671694834 >> v2:172.21.15.179:3300/0 conn(0x7ffa8815a260 0x7ffa88072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7ffa87fff700 1 -- 172.21.15.179:0/2671694834 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8815aa50 con 0x7ffa88143540 2023-12-07T00:14:34.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f2c5d573700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2c580b2f80 0x7f2c58143540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f2c5d573700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c580ce000 con 0x7f2c5806ba90 2023-12-07T00:14:34.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f2c5d573700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5815a770 con 0x7f2c580723d0 2023-12-07T00:14:34.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f2c5d573700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5815aa50 con 0x7f2c580b2f80 2023-12-07T00:14:34.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f2c567fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2c5806ba90 0x7f2c58071cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46252/0 (socket says 172.21.15.179:46252) 2023-12-07T00:14:34.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7f2c567fc700 1 -- 172.21.15.179:0/3427679662 learned_addr learned my addr 172.21.15.179:0/3427679662 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:34.547 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7f2c56ffd700 1 --2- 172.21.15.179:0/3427679662 >> v2:172.21.15.179:3300/0 conn(0x7f2c580b2f80 0x7f2c58143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.548 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7fc5f484e700 1 Processor -- start 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f795b7fe700 1 -- 172.21.15.179:0/3438485607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c1477c0 msgr2=0x7f795c1f6c50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f795b7fe700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f795c1477c0 0x7f795c1f6c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f795b7fe700 1 -- 172.21.15.179:0/3438485607 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f795c0b2d80 msgr2=0x7f795c15f0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f795b7fe700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f795c0b2d80 0x7f795c15f0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f795b7fe700 1 -- 172.21.15.179:0/3438485607 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950009550 con 0x7f795c06fb60 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f795b7fe700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 0x7f795c1f7f70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f795400ba50 tx=0x7f795400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795400cae0 con 0x7f795c06fb60 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795400cc60 con 0x7f795c06fb60 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954014440 con 0x7f795c06fb60 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c15f8e0 con 0x7f795c06fb60 2023-12-07T00:14:34.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c1f7770 con 0x7f795c06fb60 2023-12-07T00:14:34.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.527+0000 7fce65c72700 1 -- 172.21.15.179:0/1417446011 wait complete. 2023-12-07T00:14:34.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.528+0000 7fce65c72700 1 Processor -- start 2023-12-07T00:14:34.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7f2c56ffd700 1 -- 172.21.15.179:0/3427679662 >> v1:172.21.15.190:6789/0 conn(0x7f2c580723d0 legacy=0x7f2c580ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7f2c56ffd700 1 -- 172.21.15.179:0/3427679662 >> v1:172.21.15.179:6789/0 conn(0x7f2c5806ba90 legacy=0x7f2c58071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7f2c56ffd700 1 -- 172.21.15.179:0/3427679662 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5815ad30 con 0x7f2c580b2f80 2023-12-07T00:14:34.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7ffa87fff700 1 --2- 172.21.15.179:0/2671694834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa88143540 0x7ffa8815e290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa8806bf30 tx=0x7ffa8000d650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e90021f2eb6cea61 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7ffa86ffd700 1 -- 172.21.15.179:0/2671694834 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80010070 con 0x7ffa88143540 2023-12-07T00:14:34.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7ffa86ffd700 1 -- 172.21.15.179:0/2671694834 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000dce0 con 0x7ffa88143540 2023-12-07T00:14:34.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7ffa86ffd700 1 -- 172.21.15.179:0/2671694834 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80007d50 con 0x7ffa88143540 2023-12-07T00:14:34.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7f2c56ffd700 1 --2- 172.21.15.179:0/3427679662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c580b2f80 0x7f2c58143540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009d90 tx=0x7f2c5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78502dd5ced9a16 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/2671694834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa88143540 msgr2=0x7ffa8815e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7ffa8e9c5700 1 --2- 172.21.15.179:0/2671694834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa88143540 0x7ffa8815e290 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa8806bf30 tx=0x7ffa8000d650 comp rx=0 tx=0).stop 2023-12-07T00:14:34.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/2671694834 shutdown_connections 2023-12-07T00:14:34.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7ffa8e9c5700 1 --2- 172.21.15.179:0/2671694834 >> v2:172.21.15.179:3300/0 conn(0x7ffa8815a260 0x7ffa88072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7ffa8e9c5700 1 --2- 172.21.15.179:0/2671694834 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa88143540 0x7ffa8815e290 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7ffa8e9c5700 1 --2- 172.21.15.179:0/2671694834 >> v2:172.21.15.190:3300/0 conn(0x7ffa880b2f80 0x7ffa88071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/2671694834 >> 172.21.15.179:0/2671694834 conn(0x7ffa8806af70 msgr2=0x7ffa8806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7f2c55ffb700 1 -- 172.21.15.179:0/3427679662 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5000e070 con 0x7f2c580b2f80 2023-12-07T00:14:34.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7f2c55ffb700 1 -- 172.21.15.179:0/3427679662 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5000bbd0 con 0x7f2c580b2f80 2023-12-07T00:14:34.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7f2c55ffb700 1 -- 172.21.15.179:0/3427679662 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50003a20 con 0x7f2c580b2f80 2023-12-07T00:14:34.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/2671694834 shutdown_connections 2023-12-07T00:14:34.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7f2c5d573700 1 -- 172.21.15.179:0/3427679662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c580b2f80 msgr2=0x7f2c58143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7f2c5d573700 1 --2- 172.21.15.179:0/3427679662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c580b2f80 0x7f2c58143540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009d90 tx=0x7f2c5000b330 comp rx=0 tx=0).stop 2023-12-07T00:14:34.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7f2c5d573700 1 -- 172.21.15.179:0/3427679662 shutdown_connections 2023-12-07T00:14:34.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7f2c5d573700 1 --2- 172.21.15.179:0/3427679662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c580b2f80 0x7f2c58143540 secure :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009d90 tx=0x7f2c5000b330 comp rx=0 tx=0).stop 2023-12-07T00:14:34.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7f2c5d573700 1 -- 172.21.15.179:0/3427679662 >> 172.21.15.179:0/3427679662 conn(0x7f2c5806af70 msgr2=0x7f2c5806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.529+0000 7fce65c72700 1 -- start start 2023-12-07T00:14:34.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7fce65c72700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 0x7fce601507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7fce65c72700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce60143540 0x7fce601332f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7fce65c72700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6015a260 0x7fce60133830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7fce65c72700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce60132000 con 0x7fce600b2f80 2023-12-07T00:14:34.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7fce65c72700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce60132250 con 0x7fce6015a260 2023-12-07T00:14:34.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7fce65c72700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce60132530 con 0x7fce60143540 2023-12-07T00:14:34.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f793c000fb0 con 0x7f795c06fb60 2023-12-07T00:14:34.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7f2c5d573700 1 -- 172.21.15.179:0/3427679662 shutdown_connections 2023-12-07T00:14:34.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.530+0000 7fc5f484e700 1 -- start start 2023-12-07T00:14:34.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7fc5f484e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5f01555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7fc5f484e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5f0159b70 0x7fc5f0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fc5f484e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5f015a0d0 0x7fc5f0156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fc5f484e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f01548c0 con 0x7fc5d8004850 2023-12-07T00:14:34.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fc5f484e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f016a0f0 con 0x7fc5f0159b70 2023-12-07T00:14:34.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fc5f484e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f0154b10 con 0x7fc5f015a0d0 2023-12-07T00:14:34.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7954006d50 con 0x7f795c06fb60 2023-12-07T00:14:34.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7f2c5d573700 1 -- 172.21.15.179:0/3427679662 wait complete. 2023-12-07T00:14:34.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fc5ee59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5f01555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fc5ee59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5f01555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39356/0 (socket says 172.21.15.179:39356) 2023-12-07T00:14:34.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fc5ee59c700 1 -- 172.21.15.179:0/210412135 learned_addr learned my addr 172.21.15.179:0/210412135 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.531+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/2671694834 wait complete. 2023-12-07T00:14:34.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7f7943fff700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f794806afa0 0x7f794806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7ffa8e9c5700 1 Processor -- start 2023-12-07T00:14:34.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fce5f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 0x7fce601507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.532+0000 7fce5f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 0x7fce601507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39354/0 (socket says 172.21.15.179:39354) 2023-12-07T00:14:34.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce5f7fe700 1 -- 172.21.15.179:0/2175079727 learned_addr learned my addr 172.21.15.179:0/2175079727 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7ffa8e9c5700 1 -- start start 2023-12-07T00:14:34.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5ee59c700 1 -- 172.21.15.179:0/210412135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5f015a0d0 msgr2=0x7fc5f0156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5ee59c700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc5f015a0d0 0x7fc5f0156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5ee59c700 1 -- 172.21.15.179:0/210412135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5f0159b70 msgr2=0x7fc5f0155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5ee59c700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc5f0159b70 0x7fc5f0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5ee59c700 1 -- 172.21.15.179:0/210412135 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0154df0 con 0x7fc5d8004850 2023-12-07T00:14:34.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7954089490 con 0x7f795c06fb60 2023-12-07T00:14:34.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7f7943fff700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6824/61917950,v1:172.21.15.179:6825/61917950] conn(0x7f79480745e0 0x7f7948076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 --> [v2:172.21.15.179:6824/61917950,v1:172.21.15.179:6825/61917950] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79480770f0 con 0x7f79480745e0 2023-12-07T00:14:34.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f795408bab0 con 0x7f795c06fb60 2023-12-07T00:14:34.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5ee59c700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5f01555f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000db10 tx=0x7fc5e000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce5f7fe700 1 -- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce60143540 msgr2=0x7fce601332f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T00:14:34.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce5f7fe700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fce60143540 0x7fce601332f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce5f7fe700 1 -- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6015a260 msgr2=0x7fce60133830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T00:14:34.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce5f7fe700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fce6015a260 0x7fce60133830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce5f7fe700 1 -- 172.21.15.179:0/2175079727 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5000a5f0 con 0x7fce600b2f80 2023-12-07T00:14:34.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0004c80 con 0x7fc5d8004850 2023-12-07T00:14:34.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7f795bfff700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6824/61917950,v1:172.21.15.179:6825/61917950] conn(0x7f79480745e0 0x7f7948076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e0004de0 con 0x7fc5d8004850 2023-12-07T00:14:34.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e00072f0 con 0x7fc5d8004850 2023-12-07T00:14:34.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce5f7fe700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 0x7fce601507a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce5400b550 tx=0x7fce5400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54011830 con 0x7fce600b2f80 2023-12-07T00:14:34.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce540119b0 con 0x7fce600b2f80 2023-12-07T00:14:34.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.533+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54011d60 con 0x7fce600b2f80 2023-12-07T00:14:34.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce60132810 con 0x7fce600b2f80 2023-12-07T00:14:34.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce60132dd0 con 0x7fce600b2f80 2023-12-07T00:14:34.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7f795bfff700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6824/61917950,v1:172.21.15.179:6825/61917950] conn(0x7f79480745e0 0x7f7948076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7f2c5d573700 1 Processor -- start 2023-12-07T00:14:34.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f01550d0 con 0x7fc5d8004850 2023-12-07T00:14:34.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f006d920 con 0x7fc5d8004850 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7ffa8e9c5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa880b2f80 0x7ffa881f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7ffa8e9c5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88143540 0x7ffa881f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7ffa8e9c5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa8815a260 0x7ffa880b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7ffa8e9c5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88135c20 con 0x7ffa88143540 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7ffa8e9c5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881f0650 con 0x7ffa880b2f80 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7ffa8e9c5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8813aba0 con 0x7ffa8815a260 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa8cf62700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa8815a260 0x7ffa880b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa87fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa880b2f80 0x7ffa881f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa87fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa880b2f80 0x7ffa881f0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41618/0 (socket says 172.21.15.179:41618) 2023-12-07T00:14:34.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa87fff700 1 -- 172.21.15.179:0/1159034011 learned_addr learned my addr 172.21.15.179:0/1159034011 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce6015b010 con 0x7fce600b2f80 2023-12-07T00:14:34.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa877fe700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88143540 0x7ffa881f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa87fff700 1 -- 172.21.15.179:0/1159034011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa8815a260 msgr2=0x7ffa880b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa87fff700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa8815a260 0x7ffa880b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa87fff700 1 -- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88143540 msgr2=0x7ffa881f0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa87fff700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa88143540 0x7ffa881f0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7ffa87fff700 1 -- 172.21.15.179:0/1159034011 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8000d050 con 0x7ffa880b2f80 2023-12-07T00:14:34.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5f015b010 con 0x7fc5d8004850 2023-12-07T00:14:34.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7ffa87fff700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa880b2f80 0x7ffa881f0850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa80000f80 tx=0x7ffa80004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce5401a400 con 0x7fce600b2f80 2023-12-07T00:14:34.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 <== osd.3 v2:172.21.15.179:6824/61917950 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f79480770f0 con 0x7f79480745e0 2023-12-07T00:14:34.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.535+0000 7f795affd700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f794806afa0 0x7f794806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7f795affd700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f794806afa0 0x7f794806d460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b4970 tx=0x7f7950008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7f2c5d573700 1 -- start start 2023-12-07T00:14:34.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7f2c5d573700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5806ba90 0x7f2c58142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7f2c5d573700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c580723d0 0x7f2c5814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7f2c5d573700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c58135eb0 0x7f2c58134000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7f2c5d573700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c581363e0 con 0x7f2c580723d0 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7f2c5d573700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c581366c0 con 0x7f2c58135eb0 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7f2c5d573700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c581369a0 con 0x7f2c5806ba90 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5806ba90 0x7f2c58142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5806ba90 0x7f2c58142740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39796/0 (socket says 172.21.15.179:39796) 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 -- 172.21.15.179:0/113371585 learned_addr learned my addr 172.21.15.179:0/113371585 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c567fc700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c580723d0 0x7f2c5814fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 -- 172.21.15.179:0/113371585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c58135eb0 msgr2=0x7f2c58134000 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c58135eb0 0x7f2c58134000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 -- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c580723d0 msgr2=0x7f2c5814fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2c580723d0 0x7f2c5814fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 -- 172.21.15.179:0/113371585 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50009a70 con 0x7f2c5806ba90 2023-12-07T00:14:34.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7f2c56ffd700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5806ba90 0x7f2c58142740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c50004000 tx=0x7f2c50004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80004580 con 0x7ffa880b2f80 2023-12-07T00:14:34.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80004700 con 0x7ffa880b2f80 2023-12-07T00:14:34.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80008020 con 0x7ffa880b2f80 2023-12-07T00:14:34.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa8813ae80 con 0x7ffa880b2f80 2023-12-07T00:14:34.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa8813b440 con 0x7ffa880b2f80 2023-12-07T00:14:34.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7fce47fff700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fce4c06af20 0x7fce4c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce54089990 con 0x7fce600b2f80 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7fce47fff700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:6800/933466321,v1:172.21.15.190:6802/933466321] conn(0x7fce4c0744e0 0x7fce4c076920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 --> [v2:172.21.15.190:6800/933466321,v1:172.21.15.190:6802/933466321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce4c076ff0 con 0x7fce4c0744e0 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7fce5effd700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fce4c06af20 0x7fce4c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce54054730 con 0x7fce600b2f80 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fce5ffff700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:6800/933466321,v1:172.21.15.190:6802/933466321] conn(0x7fce4c0744e0 0x7fce4c076920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7faabc674700 1 Processor -- start 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.534+0000 7faabc674700 1 -- start start 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7faabc674700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faab414bb40 0x7faab4071b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7faabc674700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab4072070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.570 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7faabc674700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab414b910 con 0x7faab414b530 2023-12-07T00:14:34.571 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7faabc674700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab40cdd80 con 0x7faab414bb40 2023-12-07T00:14:34.571 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.536+0000 7faabc674700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab40ce060 con 0x7faab40b33c0 2023-12-07T00:14:34.571 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fce5effd700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fce4c06af20 0x7fce4c06d3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce600b3360 tx=0x7fce5001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.571 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5e0007450 con 0x7fc5d8004850 2023-12-07T00:14:34.571 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7fc5deffd700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc5d006afa0 0x7fc5d006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.571 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5e0089f50 con 0x7fc5d8004850 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fc5deffd700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6800/3231224349,v1:172.21.15.179:6801/3231224349] conn(0x7fc5d00745e0 0x7fc5d0076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 --> [v2:172.21.15.179:6800/3231224349,v1:172.21.15.179:6801/3231224349] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5d00770f0 con 0x7fc5d00745e0 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5e008a300 con 0x7fc5d8004850 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fc5eed9d700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6800/3231224349,v1:172.21.15.179:6801/3231224349] conn(0x7fc5d00745e0 0x7fc5d0076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fc5edd9b700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc5d006afa0 0x7fc5d006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7faabac11700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab4072070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7faabac11700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab4072070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39786/0 (socket says 172.21.15.179:39786) 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7faabac11700 1 -- 172.21.15.179:0/1558949430 learned_addr learned my addr 172.21.15.179:0/1558949430 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7faabac11700 1 -- 172.21.15.179:0/1558949430 >> v2:172.21.15.190:3300/0 conn(0x7faab414bb40 msgr2=0x7faab4071b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7faabac11700 1 --2- 172.21.15.179:0/1558949430 >> v2:172.21.15.190:3300/0 conn(0x7faab414bb40 0x7faab4071b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7faabac11700 1 -- 172.21.15.179:0/1558949430 >> v1:172.21.15.179:6789/0 conn(0x7faab414b530 legacy=0x7faab406d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.537+0000 7faabac11700 1 -- 172.21.15.179:0/1558949430 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab40ce340 con 0x7faab40b33c0 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7faabac11700 1 --2- 172.21.15.179:0/1558949430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab4072070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faaac009e50 tx=0x7faaac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ce040c6f9fe81b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7faab940e700 1 -- 172.21.15.179:0/1558949430 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac00e070 con 0x7faab40b33c0 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7faab940e700 1 -- 172.21.15.179:0/1558949430 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac003a20 con 0x7faab40b33c0 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.538+0000 7faab940e700 1 -- 172.21.15.179:0/1558949430 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac003dd0 con 0x7faab40b33c0 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7faabc674700 1 -- 172.21.15.179:0/1558949430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 msgr2=0x7faab4072070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7faabc674700 1 --2- 172.21.15.179:0/1558949430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab4072070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faaac009e50 tx=0x7faaac00b330 comp rx=0 tx=0).stop 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7fce5ffff700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:6800/933466321,v1:172.21.15.190:6802/933466321] conn(0x7fce4c0744e0 0x7fce4c076920 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7fc5eed9d700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6800/3231224349,v1:172.21.15.179:6801/3231224349] conn(0x7fc5d00745e0 0x7fc5d0076a20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7fc5edd9b700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc5d006afa0 0x7fc5d006d460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00b4300 tx=0x7fc5e4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa68000fb0 con 0x7ffa880b2f80 2023-12-07T00:14:34.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.539+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50012630 con 0x7f2c5806ba90 2023-12-07T00:14:34.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c50012790 con 0x7f2c5806ba90 2023-12-07T00:14:34.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c50012b40 con 0x7f2c5806ba90 2023-12-07T00:14:34.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c58133ae0 con 0x7f2c5806ba90 2023-12-07T00:14:34.575 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c58142c80 con 0x7f2c5806ba90 2023-12-07T00:14:34.575 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7faabc674700 1 -- 172.21.15.179:0/1558949430 shutdown_connections 2023-12-07T00:14:34.575 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7faabc674700 1 --2- 172.21.15.179:0/1558949430 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab4072070 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.575 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7faabc674700 1 --2- 172.21.15.179:0/1558949430 >> v2:172.21.15.190:3300/0 conn(0x7faab414bb40 0x7faab4071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.575 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7faabc674700 1 -- 172.21.15.179:0/1558949430 >> 172.21.15.179:0/1558949430 conn(0x7faab406af70 msgr2=0x7faab406b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.575 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.540+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 <== osd.4 v2:172.21.15.190:6800/933466321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fce4c076ff0 con 0x7fce4c0744e0 2023-12-07T00:14:34.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.541+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 <== osd.1 v2:172.21.15.179:6800/3231224349 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc5d00770f0 con 0x7fc5d00745e0 2023-12-07T00:14:34.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.541+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa80008180 con 0x7ffa880b2f80 2023-12-07T00:14:34.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.541+0000 7ffa84ff9700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa7406afa0 0x7ffa7406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.541+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa8008b4f0 con 0x7ffa880b2f80 2023-12-07T00:14:34.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.542+0000 7faabc674700 1 -- 172.21.15.179:0/1558949430 shutdown_connections 2023-12-07T00:14:34.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.541+0000 7ffa877fe700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa7406afa0 0x7ffa7406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.541+0000 7ffa84ff9700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6808/2894829420,v1:172.21.15.179:6809/2894829420] conn(0x7ffa740745e0 0x7ffa74076a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.542+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 --> [v2:172.21.15.179:6808/2894829420,v1:172.21.15.179:6809/2894829420] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa740770f0 con 0x7ffa740745e0 2023-12-07T00:14:34.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.542+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa8008db10 con 0x7ffa880b2f80 2023-12-07T00:14:34.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.542+0000 7ffa8cf62700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6808/2894829420,v1:172.21.15.179:6809/2894829420] conn(0x7ffa740745e0 0x7ffa74076a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.542+0000 7ffa877fe700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa7406afa0 0x7ffa7406d460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa880b3360 tx=0x7ffa7c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.542+0000 7ffa8cf62700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6808/2894829420,v1:172.21.15.179:6809/2894829420] conn(0x7ffa740745e0 0x7ffa74076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.542+0000 7faabc674700 1 -- 172.21.15.179:0/1558949430 wait complete. 2023-12-07T00:14:34.581 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.543+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 <== osd.2 v2:172.21.15.179:6808/2894829420 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffa740770f0 con 0x7ffa740745e0 2023-12-07T00:14:34.581 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.544+0000 7faabc674700 1 Processor -- start 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.544+0000 7faabc674700 1 -- start start 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faabc674700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab41601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faabc674700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faab414b530 0x7faab4164da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faabc674700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faab41638f0 0x7faab4163d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faabc674700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab41606f0 con 0x7faab414b530 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faabc674700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab4160ca0 con 0x7faab41638f0 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faabc674700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab4160f80 con 0x7faab40b33c0 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faab9c0f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faab414b530 0x7faab4164da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faaba410700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab41601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faab9c0f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faab414b530 0x7faab4164da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39396/0 (socket says 172.21.15.179:39396) 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.545+0000 7faab9c0f700 1 -- 172.21.15.179:0/1685474409 learned_addr learned my addr 172.21.15.179:0/1685474409 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.546+0000 7faabac11700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faab41638f0 0x7faab4163d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.546+0000 7faab9c0f700 1 -- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 msgr2=0x7faab41601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.546+0000 7faab9c0f700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faab40b33c0 0x7faab41601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.546+0000 7faab9c0f700 1 -- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faab41638f0 msgr2=0x7faab4163d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.546+0000 7faab9c0f700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faab41638f0 0x7faab4163d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.546+0000 7faab9c0f700 1 -- 172.21.15.179:0/1685474409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac009b30 con 0x7faab414b530 2023-12-07T00:14:34.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.546+0000 7faab9c0f700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faab414b530 0x7faab4164da0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faab000b4a0 tx=0x7faab000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.547+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c38000fb0 con 0x7f2c5806ba90 2023-12-07T00:14:34.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.546+0000 7fae491be700 1 Processor -- start 2023-12-07T00:14:34.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.547+0000 7fae491be700 1 -- start start 2023-12-07T00:14:34.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0011830 con 0x7faab414b530 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae491be700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440b29b0 0x7fae440b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae491be700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fae440aeba0 0x7fae440af030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae491be700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae440b4700 con 0x7fae440b3b30 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae491be700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae440b49e0 con 0x7fae440aeba0 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae491be700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae440b4cc0 con 0x7fae440b29b0 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae4259c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440b29b0 0x7fae440b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae4259c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440b29b0 0x7fae440b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39816/0 (socket says 172.21.15.179:39816) 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae4259c700 1 -- 172.21.15.179:0/1035376960 learned_addr learned my addr 172.21.15.179:0/1035376960 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae4259c700 1 -- 172.21.15.179:0/1035376960 >> v2:172.21.15.179:3300/0 conn(0x7fae440aeba0 msgr2=0x7fae440af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae4259c700 1 --2- 172.21.15.179:0/1035376960 >> v2:172.21.15.179:3300/0 conn(0x7fae440aeba0 0x7fae440af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7fae4259c700 1 -- 172.21.15.179:0/1035376960 >> v1:172.21.15.179:6789/0 conn(0x7fae440b3b30 legacy=0x7fae4406e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.549+0000 7fae4259c700 1 -- 172.21.15.179:0/1035376960 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae440ae3a0 con 0x7fae440b29b0 2023-12-07T00:14:34.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.549+0000 7fae4259c700 1 --2- 172.21.15.179:0/1035376960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440b29b0 0x7fae440b2e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae380098f0 tx=0x7fae38009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4275edea0ed6ce69 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab00119b0 con 0x7faab414b530 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.548+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0011d60 con 0x7faab414b530 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.549+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab4161260 con 0x7faab414b530 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.549+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab4161820 con 0x7faab414b530 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.550+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faab40cd830 con 0x7faab414b530 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.551+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faab001a400 con 0x7faab414b530 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.551+0000 7faaaaffd700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa9806aed0 0x7faa9806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.551+0000 7faaba410700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa9806aed0 0x7faa9806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.552+0000 7faaba410700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa9806aed0 0x7faa9806d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faab406f7e0 tx=0x7faaa40090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.552+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c5001d420 con 0x7f2c5806ba90 2023-12-07T00:14:34.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.552+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faab0057ba0 con 0x7faab414b530 2023-12-07T00:14:34.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.552+0000 7faaaaffd700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:6824/2894346431,v1:172.21.15.190:6825/2894346431] conn(0x7faa98074390 0x7faa980767d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.552+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 --> [v2:172.21.15.190:6824/2894346431,v1:172.21.15.190:6825/2894346431] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa98076ea0 con 0x7faa98074390 2023-12-07T00:14:34.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.552+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faab00537e0 con 0x7faab414b530 2023-12-07T00:14:34.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7f2c3f7fe700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2c4406af20 0x7f2c4406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7fae41d9b700 1 -- 172.21.15.179:0/1035376960 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38004230 con 0x7fae440b29b0 2023-12-07T00:14:34.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7fae41d9b700 1 -- 172.21.15.179:0/1035376960 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38004390 con 0x7fae440b29b0 2023-12-07T00:14:34.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7fae41d9b700 1 -- 172.21.15.179:0/1035376960 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380036a0 con 0x7fae440b29b0 2023-12-07T00:14:34.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2c5008bca0 con 0x7f2c5806ba90 2023-12-07T00:14:34.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7f2c3f7fe700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6816/2631454879,v1:172.21.15.179:6817/2631454879] conn(0x7f2c440744e0 0x7f2c44076920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 --> [v2:172.21.15.179:6816/2631454879,v1:172.21.15.179:6817/2631454879] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c44076ff0 con 0x7f2c440744e0 2023-12-07T00:14:34.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7f2c577fe700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6816/2631454879,v1:172.21.15.179:6817/2631454879] conn(0x7f2c440744e0 0x7f2c44076920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.553+0000 7f2c567fc700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2c4406af20 0x7f2c4406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7f2c577fe700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6816/2631454879,v1:172.21.15.179:6817/2631454879] conn(0x7f2c440744e0 0x7f2c44076920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7fae491be700 1 -- 172.21.15.179:0/1035376960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440b29b0 msgr2=0x7fae440b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7fae491be700 1 --2- 172.21.15.179:0/1035376960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440b29b0 0x7fae440b2e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae380098f0 tx=0x7fae38009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:34.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7fae491be700 1 -- 172.21.15.179:0/1035376960 shutdown_connections 2023-12-07T00:14:34.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7fae491be700 1 --2- 172.21.15.179:0/1035376960 >> v2:172.21.15.179:3300/0 conn(0x7fae440aeba0 0x7fae440af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7fae491be700 1 --2- 172.21.15.179:0/1035376960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440b29b0 0x7fae440b2e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7fae491be700 1 -- 172.21.15.179:0/1035376960 >> 172.21.15.179:0/1035376960 conn(0x7fae4406af70 msgr2=0x7fae4406b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7f2c567fc700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2c4406af20 0x7f2c4406d3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c58159830 tx=0x7f2c48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7fae491be700 1 -- 172.21.15.179:0/1035376960 shutdown_connections 2023-12-07T00:14:34.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.554+0000 7fae491be700 1 -- 172.21.15.179:0/1035376960 wait complete. 2023-12-07T00:14:34.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 <== osd.0 v2:172.21.15.179:6816/2631454879 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2c44076ff0 con 0x7f2c440744e0 2023-12-07T00:14:34.592 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7fae491be700 1 Processor -- start 2023-12-07T00:14:34.592 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7fae491be700 1 -- start start 2023-12-07T00:14:34.592 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7fae491be700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440aeba0 0x7fae44201130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.592 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7fae491be700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae440b29b0 0x7fae44200140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.592 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7fae491be700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae440b3b30 0x7fae4413e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.592 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7fae491be700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae442017b0 con 0x7fae440b29b0 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7fae491be700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae44201a90 con 0x7fae440b3b30 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.556+0000 7fae491be700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae44201d70 con 0x7fae440aeba0 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440aeba0 0x7fae44201130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440aeba0 0x7fae44201130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39828/0 (socket says 172.21.15.179:39828) 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 -- 172.21.15.179:0/2024869615 learned_addr learned my addr 172.21.15.179:0/2024869615 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae4359e700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae440b3b30 0x7fae4413e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 -- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae440b3b30 msgr2=0x7fae4413e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae440b3b30 0x7fae4413e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 -- 172.21.15.179:0/2024869615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae440b29b0 msgr2=0x7fae44200140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fae440b29b0 0x7fae44200140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 -- 172.21.15.179:0/2024869615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38009550 con 0x7fae440aeba0 2023-12-07T00:14:34.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.557+0000 7fae42d9d700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440aeba0 0x7fae44201130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae3400b470 tx=0x7fae3400b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.560+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c50056cf0 con 0x7f2c5806ba90 2023-12-07T00:14:34.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.560+0000 7faabac11700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:6824/2894346431,v1:172.21.15.190:6825/2894346431] conn(0x7faa98074390 0x7faa980767d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.560+0000 7faabac11700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:6824/2894346431,v1:172.21.15.190:6825/2894346431] conn(0x7faa98074390 0x7faa980767d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.562+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 <== osd.5 v2:172.21.15.190:6824/2894346431 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faa98076ea0 con 0x7faa98074390 2023-12-07T00:14:34.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.566+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34011830 con 0x7fae440aeba0 2023-12-07T00:14:34.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.566+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae340119b0 con 0x7fae440aeba0 2023-12-07T00:14:34.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.566+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae34011d60 con 0x7fae440aeba0 2023-12-07T00:14:34.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.569+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 --> [v2:172.21.15.179:6824/61917950,v1:172.21.15.179:6825/61917950] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f793c002d30 con 0x7f79480745e0 2023-12-07T00:14:34.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.570+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae44202050 con 0x7fae440aeba0 2023-12-07T00:14:34.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.570+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4413e780 con 0x7fae440aeba0 2023-12-07T00:14:34.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.570+0000 7f7943fff700 1 -- 172.21.15.179:0/3438485607 <== osd.3 v2:172.21.15.179:6824/61917950 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f793c002d30 con 0x7f79480745e0 2023-12-07T00:14:34.596 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.573+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6824/61917950,v1:172.21.15.179:6825/61917950] conn(0x7f79480745e0 msgr2=0x7f7948076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.596 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.573+0000 7f79621f4700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6824/61917950,v1:172.21.15.179:6825/61917950] conn(0x7f79480745e0 0x7f7948076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.596 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.573+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f794806afa0 msgr2=0x7f794806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.596 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.573+0000 7f79621f4700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f794806afa0 0x7f794806d460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b4970 tx=0x7f7950008030 comp rx=0 tx=0).stop 2023-12-07T00:14:34.596 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.573+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 msgr2=0x7f795c1f7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.596 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.573+0000 7f79621f4700 1 --2- 172.21.15.179:0/3438485607 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f795c06fb60 0x7f795c1f7f70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f795400ba50 tx=0x7f795400be10 comp rx=0 tx=0).stop 2023-12-07T00:14:34.596 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.573+0000 7f795bfff700 1 -- 172.21.15.179:0/3438485607 reap_dead start 2023-12-07T00:14:34.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.573+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae3401a400 con 0x7fae440aeba0 2023-12-07T00:14:34.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 shutdown_connections 2023-12-07T00:14:34.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 >> 172.21.15.179:0/3438485607 conn(0x7f795c0b1a80 msgr2=0x7f795c1618d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 shutdown_connections 2023-12-07T00:14:34.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fae2b7fe700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fae3006afa0 0x7fae3006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae34089860 con 0x7fae440aeba0 2023-12-07T00:14:34.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae440ae090 con 0x7fae440aeba0 2023-12-07T00:14:34.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7f79621f4700 1 -- 172.21.15.179:0/3438485607 wait complete. 2023-12-07T00:14:34.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 --> [v2:172.21.15.190:6800/933466321,v1:172.21.15.190:6802/933466321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fce60132ff0 con 0x7fce4c0744e0 2023-12-07T00:14:34.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 --> [v2:172.21.15.179:6800/3231224349,v1:172.21.15.179:6801/3231224349] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5f0067ee0 con 0x7fc5d00745e0 2023-12-07T00:14:34.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fae2b7fe700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:6816/751556601,v1:172.21.15.190:6817/751556601] conn(0x7fae30074560 0x7fae300769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 --> [v2:172.21.15.190:6816/751556601,v1:172.21.15.190:6817/751556601] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae30077070 con 0x7fae30074560 2023-12-07T00:14:34.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae340092c0 con 0x7fae440aeba0 2023-12-07T00:14:34.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fae4359e700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:6816/751556601,v1:172.21.15.190:6817/751556601] conn(0x7fae30074560 0x7fae300769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.600 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.574+0000 7fc5deffd700 1 -- 172.21.15.179:0/210412135 <== osd.1 v2:172.21.15.179:6800/3231224349 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc5f0067ee0 con 0x7fc5d00745e0 2023-12-07T00:14:34.600 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce47fff700 1 -- 172.21.15.179:0/2175079727 <== osd.4 v2:172.21.15.190:6800/933466321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fce60132ff0 con 0x7fce4c0744e0 2023-12-07T00:14:34.601 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fae4359e700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:6816/751556601,v1:172.21.15.190:6817/751556601] conn(0x7fae30074560 0x7fae300769a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.601 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 --> [v2:172.21.15.179:6808/2894829420,v1:172.21.15.179:6809/2894829420] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa68002d30 con 0x7ffa740745e0 2023-12-07T00:14:34.601 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7f7f1e81a700 1 Processor -- start 2023-12-07T00:14:34.601 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6800/3231224349,v1:172.21.15.179:6801/3231224349] conn(0x7fc5d00745e0 msgr2=0x7fc5d0076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fc5f484e700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6800/3231224349,v1:172.21.15.179:6801/3231224349] conn(0x7fc5d00745e0 0x7fc5d0076a20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:6800/933466321,v1:172.21.15.190:6802/933466321] conn(0x7fce4c0744e0 msgr2=0x7fce4c076920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.190:6800/933466321,v1:172.21.15.190:6802/933466321] conn(0x7fce4c0744e0 0x7fce4c076920 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fce4c06af20 msgr2=0x7fce4c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fce4c06af20 0x7fce4c06d3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce600b3360 tx=0x7fce5001a000 comp rx=0 tx=0).stop 2023-12-07T00:14:34.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 msgr2=0x7fce601507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 --2- 172.21.15.179:0/2175079727 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fce600b2f80 0x7fce601507a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce5400b550 tx=0x7fce5400b910 comp rx=0 tx=0).stop 2023-12-07T00:14:34.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce5ffff700 1 -- 172.21.15.179:0/2175079727 reap_dead start 2023-12-07T00:14:34.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 shutdown_connections 2023-12-07T00:14:34.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 >> 172.21.15.179:0/2175079727 conn(0x7fce6006af70 msgr2=0x7fce60071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 shutdown_connections 2023-12-07T00:14:34.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7fce65c72700 1 -- 172.21.15.179:0/2175079727 wait complete. 2023-12-07T00:14:34.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.576+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 <== osd.7 v2:172.21.15.190:6816/751556601 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fae30077070 con 0x7fae30074560 2023-12-07T00:14:34.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.576+0000 7fae4259c700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fae3006afa0 0x7fae3006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.575+0000 7f7f1e81a700 1 -- start start 2023-12-07T00:14:34.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc5d006afa0 msgr2=0x7fc5d006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7fc5f484e700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc5d006afa0 0x7fc5d006d460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc5f00b4300 tx=0x7fc5e4010000 comp rx=0 tx=0).stop 2023-12-07T00:14:34.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 msgr2=0x7fc5f01555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7fc5f484e700 1 --2- 172.21.15.179:0/210412135 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc5d8004850 0x7fc5f01555f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000db10 tx=0x7fc5e000ded0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7fae4259c700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fae3006afa0 0x7fae3006d460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae44147340 tx=0x7fae38010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f1e81a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f18143540 0x7f7f1815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f1e81a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7f180b2f80 0x7f7f18071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f1e81a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7f1815a260 0x7f7f18072200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f1e81a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f18143920 con 0x7f7f1815a260 2023-12-07T00:14:34.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f1e81a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f180ce000 con 0x7f7f180b2f80 2023-12-07T00:14:34.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f1e81a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1815a770 con 0x7f7f18143540 2023-12-07T00:14:34.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f17fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f18143540 0x7f7f1815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f17fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f18143540 0x7f7f1815e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39840/0 (socket says 172.21.15.179:39840) 2023-12-07T00:14:34.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7f7f17fff700 1 -- 172.21.15.179:0/3435382177 learned_addr learned my addr 172.21.15.179:0/3435382177 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.577+0000 7fc5eed9d700 1 -- 172.21.15.179:0/210412135 reap_dead start 2023-12-07T00:14:34.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f17fff700 1 -- 172.21.15.179:0/3435382177 >> v2:172.21.15.190:3300/0 conn(0x7f7f180b2f80 msgr2=0x7f7f18071cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T00:14:34.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f17fff700 1 --2- 172.21.15.179:0/3435382177 >> v2:172.21.15.190:3300/0 conn(0x7f7f180b2f80 0x7f7f18071cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f17fff700 1 -- 172.21.15.179:0/3435382177 >> v2:172.21.15.179:3300/0 conn(0x7f7f1815a260 msgr2=0x7f7f18072200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f17fff700 1 --2- 172.21.15.179:0/3435382177 >> v2:172.21.15.179:3300/0 conn(0x7f7f1815a260 0x7f7f18072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f17fff700 1 -- 172.21.15.179:0/3435382177 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1815aa50 con 0x7f7f18143540 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f17fff700 1 --2- 172.21.15.179:0/3435382177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f18143540 0x7f7f1815e290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f1806bf30 tx=0x7f7f0c00d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f59bfa1350121235 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f16ffd700 1 -- 172.21.15.179:0/3435382177 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c010070 con 0x7f7f18143540 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f16ffd700 1 -- 172.21.15.179:0/3435382177 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c00da80 con 0x7f7f18143540 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.578+0000 7f7f16ffd700 1 -- 172.21.15.179:0/3435382177 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00de10 con 0x7f7f18143540 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.579+0000 7f7f1e81a700 1 -- 172.21.15.179:0/3435382177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f18143540 msgr2=0x7f7f1815e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.579+0000 7f7f1e81a700 1 --2- 172.21.15.179:0/3435382177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f18143540 0x7f7f1815e290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f1806bf30 tx=0x7f7f0c00d330 comp rx=0 tx=0).stop 2023-12-07T00:14:34.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.579+0000 7f7f1e81a700 1 -- 172.21.15.179:0/3435382177 shutdown_connections 2023-12-07T00:14:34.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.579+0000 7f7f1e81a700 1 --2- 172.21.15.179:0/3435382177 >> v2:172.21.15.179:3300/0 conn(0x7f7f1815a260 0x7f7f18072200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.579+0000 7f7f1e81a700 1 --2- 172.21.15.179:0/3435382177 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f18143540 0x7f7f1815e290 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.579+0000 7f7f1e81a700 1 --2- 172.21.15.179:0/3435382177 >> v2:172.21.15.190:3300/0 conn(0x7f7f180b2f80 0x7f7f18071cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.579+0000 7f7f1e81a700 1 -- 172.21.15.179:0/3435382177 >> 172.21.15.179:0/3435382177 conn(0x7f7f1806af70 msgr2=0x7f7f1806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.579+0000 7f7f1e81a700 1 -- 172.21.15.179:0/3435382177 shutdown_connections 2023-12-07T00:14:34.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.580+0000 7f7f1e81a700 1 -- 172.21.15.179:0/3435382177 wait complete. 2023-12-07T00:14:34.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.582+0000 7ffa84ff9700 1 -- 172.21.15.179:0/1159034011 <== osd.2 v2:172.21.15.179:6808/2894829420 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa68002d30 con 0x7ffa740745e0 2023-12-07T00:14:34.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.582+0000 7f7f1e81a700 1 Processor -- start 2023-12-07T00:14:34.610 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.582+0000 7f7f1e81a700 1 -- start start 2023-12-07T00:14:34.610 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 --> [v2:172.21.15.179:6816/2631454879,v1:172.21.15.179:6817/2631454879] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c38002cf0 con 0x7f2c440744e0 2023-12-07T00:14:34.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6808/2894829420,v1:172.21.15.179:6809/2894829420] conn(0x7ffa740745e0 msgr2=0x7ffa74076a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7ffa8e9c5700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6808/2894829420,v1:172.21.15.179:6809/2894829420] conn(0x7ffa740745e0 0x7ffa74076a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7f7f1e81a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f180b2f80 0x7f7f1806e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa7406afa0 msgr2=0x7ffa7406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7ffa8e9c5700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa7406afa0 0x7ffa7406d460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa880b3360 tx=0x7ffa7c009190 comp rx=0 tx=0).stop 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa880b2f80 msgr2=0x7ffa881f0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7ffa8e9c5700 1 --2- 172.21.15.179:0/1159034011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa880b2f80 0x7ffa881f0850 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffa80000f80 tx=0x7ffa80004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7ffa8cf62700 1 -- 172.21.15.179:0/1159034011 reap_dead start 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 shutdown_connections 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 >> 172.21.15.179:0/1159034011 conn(0x7ffa8806af70 msgr2=0x7ffa88071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 shutdown_connections 2023-12-07T00:14:34.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7ffa8e9c5700 1 -- 172.21.15.179:0/1159034011 wait complete. 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7f7f1e81a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f18143540 0x7f7f1806e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7f7f1e81a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f1815a260 0x7f7f180b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7f7f1e81a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f181420b0 con 0x7f7f180b2f80 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7f7f1e81a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18142390 con 0x7f7f18143540 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.583+0000 7f7f1e81a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f18142670 con 0x7f7f1815a260 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7f7f17fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f180b2f80 0x7f7f1806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7f7f17fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f180b2f80 0x7f7f1806e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39430/0 (socket says 172.21.15.179:39430) 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7f7f17fff700 1 -- 172.21.15.179:0/2503800754 learned_addr learned my addr 172.21.15.179:0/2503800754 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7f7f177fe700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f18143540 0x7f7f1806e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7f2c3f7fe700 1 -- 172.21.15.179:0/113371585 <== osd.0 v2:172.21.15.179:6816/2631454879 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c38002cf0 con 0x7f2c440744e0 2023-12-07T00:14:34.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 shutdown_connections 2023-12-07T00:14:34.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 >> 172.21.15.179:0/210412135 conn(0x7fc5f006af70 msgr2=0x7fc5f0159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.584+0000 7f7f1cdb7700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f1815a260 0x7f7f180b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f177fe700 1 -- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f1815a260 msgr2=0x7f7f180b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f177fe700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f1815a260 0x7f7f180b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f177fe700 1 -- 172.21.15.179:0/2503800754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f180b2f80 msgr2=0x7f7f1806e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f177fe700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7f180b2f80 0x7f7f1806e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f177fe700 1 -- 172.21.15.179:0/2503800754 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c0085d0 con 0x7f7f18143540 2023-12-07T00:14:34.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f177fe700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f18143540 0x7f7f1806e5b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000bdf0 tx=0x7f7f10009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f14ff9700 1 -- 172.21.15.179:0/2503800754 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000cc90 con 0x7f7f18143540 2023-12-07T00:14:34.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f14ff9700 1 -- 172.21.15.179:0/2503800754 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000cdf0 con 0x7f7f18143540 2023-12-07T00:14:34.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f18142950 con 0x7f7f18143540 2023-12-07T00:14:34.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f14ff9700 1 -- 172.21.15.179:0/2503800754 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10014680 con 0x7f7f18143540 2023-12-07T00:14:34.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.585+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f180b0d90 con 0x7f7f18143540 2023-12-07T00:14:34.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.588+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 shutdown_connections 2023-12-07T00:14:34.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.588+0000 7fc5f484e700 1 -- 172.21.15.179:0/210412135 wait complete. 2023-12-07T00:14:34.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.588+0000 7f7f14ff9700 1 -- 172.21.15.179:0/2503800754 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f100147e0 con 0x7f7f18143540 2023-12-07T00:14:34.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.588+0000 7f7f14ff9700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7f0406afa0 0x7f7f0406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.588+0000 7f7f14ff9700 1 -- 172.21.15.179:0/2503800754 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f10089710 con 0x7f7f18143540 2023-12-07T00:14:34.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.589+0000 7f7f17fff700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7f0406afa0 0x7f7f0406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.589+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 --> [v2:172.21.15.190:6824/2894346431,v1:172.21.15.190:6825/2894346431] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faab40b3980 con 0x7faa98074390 2023-12-07T00:14:34.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.589+0000 7f7f17fff700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7f0406afa0 0x7f7f0406d460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c000c00 tx=0x7f7f0c00a040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.590+0000 7f7f1e81a700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:6801/3690769319,v1:172.21.15.190:6803/3690769319] conn(0x7f7ef80015d0 0x7f7ef8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.590+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 --> [v2:172.21.15.190:6801/3690769319,v1:172.21.15.190:6803/3690769319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ef8006bc0 con 0x7f7ef80015d0 2023-12-07T00:14:34.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.590+0000 7faaaaffd700 1 -- 172.21.15.179:0/1685474409 <== osd.5 v2:172.21.15.190:6824/2894346431 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faaac00b980 con 0x7faa98074390 2023-12-07T00:14:34.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.590+0000 7f7f1cdb7700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:6801/3690769319,v1:172.21.15.190:6803/3690769319] conn(0x7f7ef80015d0 0x7f7ef8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.590+0000 7f7f1cdb7700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:6801/3690769319,v1:172.21.15.190:6803/3690769319] conn(0x7f7ef80015d0 0x7f7ef8003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.591+0000 7f7f14ff9700 1 -- 172.21.15.179:0/2503800754 <== osd.6 v2:172.21.15.190:6801/3690769319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7ef8006bc0 con 0x7f7ef80015d0 2023-12-07T00:14:34.620 INFO:teuthology.orchestra.run.smithi179.stdout:55834574857 2023-12-07T00:14:34.621 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-07T00:14:34.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:6824/2894346431,v1:172.21.15.190:6825/2894346431] conn(0x7faa98074390 msgr2=0x7faa980767d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabc674700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.190:6824/2894346431,v1:172.21.15.190:6825/2894346431] conn(0x7faa98074390 0x7faa980767d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa9806aed0 msgr2=0x7faa9806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabc674700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa9806aed0 0x7faa9806d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faab406f7e0 tx=0x7faaa40090e0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faab414b530 msgr2=0x7faab4164da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabc674700 1 --2- 172.21.15.179:0/1685474409 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faab414b530 0x7faab4164da0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faab000b4a0 tx=0x7faab000b7b0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabac11700 1 -- 172.21.15.179:0/1685474409 reap_dead start 2023-12-07T00:14:34.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 shutdown_connections 2023-12-07T00:14:34.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.593+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 >> 172.21.15.179:0/1685474409 conn(0x7faab406af70 msgr2=0x7faab406da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.623 INFO:teuthology.orchestra.run.smithi179.stdout:55834574860 2023-12-07T00:14:34.624 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-07T00:14:34.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.598+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 shutdown_connections 2023-12-07T00:14:34.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.598+0000 7faabc674700 1 -- 172.21.15.179:0/1685474409 wait complete. 2023-12-07T00:14:34.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.601+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6816/2631454879,v1:172.21.15.179:6817/2631454879] conn(0x7f2c440744e0 msgr2=0x7f2c44076920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.601+0000 7f2c5d573700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6816/2631454879,v1:172.21.15.179:6817/2631454879] conn(0x7f2c440744e0 0x7f2c44076920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.601+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2c4406af20 msgr2=0x7f2c4406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.601+0000 7f2c5d573700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2c4406af20 0x7f2c4406d3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c58159830 tx=0x7f2c48009040 comp rx=0 tx=0).stop 2023-12-07T00:14:34.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.601+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5806ba90 msgr2=0x7f2c58142740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.601+0000 7f2c5d573700 1 --2- 172.21.15.179:0/113371585 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5806ba90 0x7f2c58142740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2c50004000 tx=0x7f2c50004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.601+0000 7f2c577fe700 1 -- 172.21.15.179:0/113371585 reap_dead start 2023-12-07T00:14:34.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.604+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 --> [v2:172.21.15.190:6816/751556601,v1:172.21.15.190:6817/751556601] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae44067ee0 con 0x7fae30074560 2023-12-07T00:14:34.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.604+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 shutdown_connections 2023-12-07T00:14:34.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.604+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 >> 172.21.15.179:0/113371585 conn(0x7f2c5806af70 msgr2=0x7f2c5815ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.626 INFO:teuthology.orchestra.run.smithi179.stdout:55834574859 2023-12-07T00:14:34.627 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-07T00:14:34.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.604+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 shutdown_connections 2023-12-07T00:14:34.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.604+0000 7f2c5d573700 1 -- 172.21.15.179:0/113371585 wait complete. 2023-12-07T00:14:34.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.604+0000 7fae2b7fe700 1 -- 172.21.15.179:0/2024869615 <== osd.7 v2:172.21.15.190:6816/751556601 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae44067ee0 con 0x7fae30074560 2023-12-07T00:14:34.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:6816/751556601,v1:172.21.15.190:6817/751556601] conn(0x7fae30074560 msgr2=0x7fae300769a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:6816/751556601,v1:172.21.15.190:6817/751556601] conn(0x7fae30074560 0x7fae300769a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fae3006afa0 msgr2=0x7fae3006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fae3006afa0 0x7fae3006d460 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fae44147340 tx=0x7fae38010000 comp rx=0 tx=0).stop 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440aeba0 msgr2=0x7fae44201130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 --2- 172.21.15.179:0/2024869615 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae440aeba0 0x7fae44201130 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fae3400b470 tx=0x7fae3400b780 comp rx=0 tx=0).stop 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae4359e700 1 -- 172.21.15.179:0/2024869615 reap_dead start 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 shutdown_connections 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 >> 172.21.15.179:0/2024869615 conn(0x7fae4406af70 msgr2=0x7fae4413cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 shutdown_connections 2023-12-07T00:14:34.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.605+0000 7fae491be700 1 -- 172.21.15.179:0/2024869615 wait complete. 2023-12-07T00:14:34.630 INFO:teuthology.orchestra.run.smithi179.stdout:55834574859 2023-12-07T00:14:34.631 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-07T00:14:34.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.613+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 --> [v2:172.21.15.190:6801/3690769319,v1:172.21.15.190:6803/3690769319] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ef8005ca0 con 0x7f7ef80015d0 2023-12-07T00:14:34.631 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:34.632 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-07T00:14:34.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f14ff9700 1 -- 172.21.15.179:0/2503800754 <== osd.6 v2:172.21.15.190:6801/3690769319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ef8005ca0 con 0x7f7ef80015d0 2023-12-07T00:14:34.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:6801/3690769319,v1:172.21.15.190:6803/3690769319] conn(0x7f7ef80015d0 msgr2=0x7f7ef8003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1e81a700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:6801/3690769319,v1:172.21.15.190:6803/3690769319] conn(0x7f7ef80015d0 0x7f7ef8003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7f0406afa0 msgr2=0x7f7f0406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1e81a700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7f0406afa0 0x7f7f0406d460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c000c00 tx=0x7f7f0c00a040 comp rx=0 tx=0).stop 2023-12-07T00:14:34.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f18143540 msgr2=0x7f7f1806e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1e81a700 1 --2- 172.21.15.179:0/2503800754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f18143540 0x7f7f1806e5b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000bdf0 tx=0x7f7f10009f70 comp rx=0 tx=0).stop 2023-12-07T00:14:34.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1cdb7700 1 -- 172.21.15.179:0/2503800754 reap_dead start 2023-12-07T00:14:34.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 shutdown_connections 2023-12-07T00:14:34.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.617+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 >> 172.21.15.179:0/2503800754 conn(0x7f7f1806af70 msgr2=0x7f7f18151320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.618+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 shutdown_connections 2023-12-07T00:14:34.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.618+0000 7f7f1e81a700 1 -- 172.21.15.179:0/2503800754 wait complete. 2023-12-07T00:14:34.635 INFO:teuthology.orchestra.run.smithi179.stdout:55834574857 2023-12-07T00:14:34.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-07T00:14:34.636 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:34.636 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-07T00:14:34.637 INFO:teuthology.orchestra.run.smithi179.stdout:55834574859 2023-12-07T00:14:34.637 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-07T00:14:34.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.883+0000 7fd8484ae700 1 Processor -- start 2023-12-07T00:14:34.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.883+0000 7fd8484ae700 1 -- start start 2023-12-07T00:14:34.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.884+0000 7fd8484ae700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8400b3b30 0x7fd84006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.884+0000 7fd8484ae700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd8400b29b0 0x7fd8400b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.884+0000 7fd8484ae700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84006e620 con 0x7fd8400aeba0 2023-12-07T00:14:34.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.884+0000 7fd8484ae700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8400b4700 con 0x7fd8400b29b0 2023-12-07T00:14:34.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.884+0000 7fd8484ae700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8400b49e0 con 0x7fd8400b3b30 2023-12-07T00:14:34.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7fd84624a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8400b3b30 0x7fd84006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7fd84624a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8400b3b30 0x7fd84006e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41694/0 (socket says 172.21.15.179:41694) 2023-12-07T00:14:34.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7fd84624a700 1 -- 172.21.15.179:0/1705136555 learned_addr learned my addr 172.21.15.179:0/1705136555 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7f11ad754700 1 Processor -- start 2023-12-07T00:14:34.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7ff9f650a700 1 Processor -- start 2023-12-07T00:14:34.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7ff9f650a700 1 -- start start 2023-12-07T00:14:34.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7f11ad754700 1 -- start start 2023-12-07T00:14:34.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7ffadff71700 1 Processor -- start 2023-12-07T00:14:34.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7ff9f650a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff9f00cdb70 0x7ff9f0161910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7ff9f650a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f0161e50 con 0x7ff9f0071950 2023-12-07T00:14:34.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7ff9f650a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9f016ea90 con 0x7ff9f00cc330 2023-12-07T00:14:34.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7ff9f650a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9f016ed70 con 0x7ff9f00cdb70 2023-12-07T00:14:34.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7fd84624a700 1 -- 172.21.15.179:0/1705136555 >> v2:172.21.15.179:3300/0 conn(0x7fd8400b29b0 msgr2=0x7fd8400b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7fd84624a700 1 --2- 172.21.15.179:0/1705136555 >> v2:172.21.15.179:3300/0 conn(0x7fd8400b29b0 0x7fd8400b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7fd84624a700 1 -- 172.21.15.179:0/1705136555 >> v1:172.21.15.190:6789/0 conn(0x7fd8400aeba0 legacy=0x7fd840071b90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T00:14:34.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.885+0000 7fd84624a700 1 -- 172.21.15.179:0/1705136555 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400b4cc0 con 0x7fd8400b3b30 2023-12-07T00:14:34.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7fd84624a700 1 --2- 172.21.15.179:0/1705136555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b3b30 0x7fd84006e0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd84006bd60 tx=0x7fd830009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa5251235b89f9d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ff9f4aa7700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff9f0071950 0x7ff9f008a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46350/0 (socket says 172.21.15.179:46350) 2023-12-07T00:14:34.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ff9f4aa7700 1 -- 172.21.15.179:0/1418491004 learned_addr learned my addr 172.21.15.179:0/1418491004 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:34.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7f11ad754700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f11a8071950 0x7f11a8071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7f11ad754700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a8166780 con 0x7f11a81633d0 2023-12-07T00:14:34.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7f11ad754700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a8166c10 con 0x7f11a80b29b0 2023-12-07T00:14:34.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7f11ad754700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a80b4ef0 con 0x7f11a8071950 2023-12-07T00:14:34.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ff9effff700 1 --2- 172.21.15.179:0/1418491004 >> v2:172.21.15.190:3300/0 conn(0x7ff9f00cdb70 0x7ff9f0161910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7fd845248700 1 -- 172.21.15.179:0/1705136555 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830004230 con 0x7fd8400b3b30 2023-12-07T00:14:34.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7fd845248700 1 -- 172.21.15.179:0/1705136555 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd830004390 con 0x7fd8400b3b30 2023-12-07T00:14:34.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7fd845248700 1 -- 172.21.15.179:0/1705136555 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8300036a0 con 0x7fd8400b3b30 2023-12-07T00:14:34.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f3cfa612700 1 Processor -- start 2023-12-07T00:14:34.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.886+0000 7ffadff71700 1 -- start start 2023-12-07T00:14:34.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ffadff71700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffad8143540 0x7ffad815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ffadff71700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad80ce000 con 0x7ffad80723d0 2023-12-07T00:14:34.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ffadff71700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad815a770 con 0x7ffad80b2f80 2023-12-07T00:14:34.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ffadff71700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad8143920 con 0x7ffad8143540 2023-12-07T00:14:34.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ff9eeffd700 1 -- 172.21.15.179:0/1418491004 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046792290 0 0) 0x7ff9e8001490 con 0x7ff9f0071950 2023-12-07T00:14:34.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.887+0000 7ff9eeffd700 1 -- 172.21.15.179:0/1418491004 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9d80035b0 con 0x7ff9f0071950 2023-12-07T00:14:34.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a77fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f11a80b29b0 0x7f11a80b2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:53036/0 (socket says 172.21.15.179:53036) 2023-12-07T00:14:34.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a77fe700 1 -- 172.21.15.179:0/372633796 learned_addr learned my addr 172.21.15.179:0/372633796 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:34.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7ffade50e700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ffad80723d0 0x7ffad80ce530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46360/0 (socket says 172.21.15.179:46360) 2023-12-07T00:14:34.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7ffade50e700 1 -- 172.21.15.179:0/2500081707 learned_addr learned my addr 172.21.15.179:0/2500081707 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:34.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a6ffd700 1 --2- 172.21.15.179:0/372633796 >> v2:172.21.15.179:3300/0 conn(0x7f11a8071950 0x7f11a8071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a5ffb700 1 -- 172.21.15.179:0/372633796 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174461203 0 0) 0x7f11a8166c10 con 0x7f11a80b29b0 2023-12-07T00:14:34.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a5ffb700 1 -- 172.21.15.179:0/372633796 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11900035b0 con 0x7f11a80b29b0 2023-12-07T00:14:34.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7fd8484ae700 1 -- 172.21.15.179:0/1705136555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b3b30 msgr2=0x7fd84006e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7fd8484ae700 1 --2- 172.21.15.179:0/1705136555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b3b30 0x7fd84006e0e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd84006bd60 tx=0x7fd830009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a5ffb700 1 -- 172.21.15.179:0/372633796 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528806845 0 0) 0x7f11a8166780 con 0x7f11a81633d0 2023-12-07T00:14:34.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a5ffb700 1 -- 172.21.15.179:0/372633796 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11a8166c10 con 0x7f11a81633d0 2023-12-07T00:14:34.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a6ffd700 1 -- 172.21.15.179:0/372633796 >> v1:172.21.15.190:6789/0 conn(0x7f11a80b29b0 legacy=0x7f11a80b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a6ffd700 1 -- 172.21.15.179:0/372633796 >> v1:172.21.15.179:6789/0 conn(0x7f11a81633d0 legacy=0x7f11a80b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f11a6ffd700 1 -- 172.21.15.179:0/372633796 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8072270 con 0x7f11a8071950 2023-12-07T00:14:34.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7fd8484ae700 1 -- 172.21.15.179:0/1705136555 shutdown_connections 2023-12-07T00:14:34.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7fd8484ae700 1 --2- 172.21.15.179:0/1705136555 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b3b30 0x7fd84006e0e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7fd8484ae700 1 --2- 172.21.15.179:0/1705136555 >> v2:172.21.15.179:3300/0 conn(0x7fd8400b29b0 0x7fd8400b2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7fd8484ae700 1 -- 172.21.15.179:0/1705136555 >> 172.21.15.179:0/1705136555 conn(0x7fd84006af70 msgr2=0x7fd84006b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f11a6ffd700 1 --2- 172.21.15.179:0/372633796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a8071950 0x7f11a8071d30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1198009840 tx=0x7f1198009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799ea6d9573f4c5e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7fd8484ae700 1 -- 172.21.15.179:0/1705136555 shutdown_connections 2023-12-07T00:14:34.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7fd8484ae700 1 -- 172.21.15.179:0/1705136555 wait complete. 2023-12-07T00:14:34.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7ff9eeffd700 1 -- 172.21.15.179:0/1418491004 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980680034 0 0) 0x7ff9f016ea90 con 0x7ff9f00cc330 2023-12-07T00:14:34.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7ff9eeffd700 1 -- 172.21.15.179:0/1418491004 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9e8001490 con 0x7ff9f00cc330 2023-12-07T00:14:34.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.888+0000 7f3cfa612700 1 -- start start 2023-12-07T00:14:34.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f3cfa612700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cf414ba10 0x7f3cf4071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f3cfa612700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf40724f0 con 0x7f3cf40b4b70 2023-12-07T00:14:34.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f3cfa612700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cf406d7e0 con 0x7f3cf40720d0 2023-12-07T00:14:34.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f3cfa612700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf406e420 con 0x7f3cf414ba10 2023-12-07T00:14:34.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cf414ba10 0x7f3cf4071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f11a5ffb700 1 -- 172.21.15.179:0/372633796 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198011830 con 0x7f11a8071950 2023-12-07T00:14:34.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7ffaddd0d700 1 --2- 172.21.15.179:0/2500081707 >> v2:172.21.15.179:3300/0 conn(0x7ffad8143540 0x7ffad815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282207336 0 0) 0x7ffad80ce000 con 0x7ffad80723d0 2023-12-07T00:14:34.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffac40079c0 con 0x7ffad80723d0 2023-12-07T00:14:34.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f3cf8baf700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3cf40b4b70 0x7f3cf40b2a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46370/0 (socket says 172.21.15.179:46370) 2023-12-07T00:14:34.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f3cf8baf700 1 -- 172.21.15.179:0/4044798782 learned_addr learned my addr 172.21.15.179:0/4044798782 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:34.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f3cf37fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f3cf40720d0 0x7f3cf40b4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:53046/0 (socket says 172.21.15.179:53046) 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914313215 0 0) 0x7ffac40079c0 con 0x7ffad80723d0 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 >> v2:172.21.15.179:3300/0 conn(0x7ffad8143540 msgr2=0x7ffad815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 --2- 172.21.15.179:0/2500081707 >> v2:172.21.15.179:3300/0 conn(0x7ffad8143540 0x7ffad815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 >> v1:172.21.15.190:6789/0 conn(0x7ffad80b2f80 legacy=0x7ffad8071cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad815aa50 con 0x7ffad80723d0 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7ffad00019f0 con 0x7ffad80723d0 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 >> v1:172.21.15.179:6789/0 conn(0x7ffad80723d0 legacy=0x7ffad80ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac4007e60 0x7ffac4008260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffac4008c60 0x7ffac40090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac4009670 0x7ffac400fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8143920 con 0x7ffac4009670 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40034d0 con 0x7ffac4007e60 2023-12-07T00:14:34.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4003690 con 0x7ffac4008c60 2023-12-07T00:14:34.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffade50e700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac4009670 0x7ffac400fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751869978 0 0) 0x7f3cf40724f0 con 0x7f3cf40b4b70 2023-12-07T00:14:34.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cdc0035b0 con 0x7f3cf40b4b70 2023-12-07T00:14:34.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f11a5ffb700 1 -- 172.21.15.179:0/372633796 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198011990 con 0x7f11a8071950 2023-12-07T00:14:34.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7f11a5ffb700 1 -- 172.21.15.179:0/372633796 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198011d20 con 0x7f11a8071950 2023-12-07T00:14:34.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7f11ad754700 1 -- 172.21.15.179:0/372633796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a8071950 msgr2=0x7f11a8071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7f11ad754700 1 --2- 172.21.15.179:0/372633796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a8071950 0x7f11a8071d30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1198009840 tx=0x7f1198009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:34.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffade50e700 1 -- 172.21.15.179:0/2500081707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffac4008c60 msgr2=0x7ffac40090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffade50e700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffac4008c60 0x7ffac40090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffade50e700 1 -- 172.21.15.179:0/2500081707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac4007e60 msgr2=0x7ffac4008260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffade50e700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac4007e60 0x7ffac4008260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffade50e700 1 -- 172.21.15.179:0/2500081707 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40079c0 con 0x7ffac4009670 2023-12-07T00:14:34.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.890+0000 7ffade50e700 1 -- 172.21.15.179:0/2500081707 reap_dead start 2023-12-07T00:14:34.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f11ad754700 1 -- 172.21.15.179:0/372633796 shutdown_connections 2023-12-07T00:14:34.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f11ad754700 1 --2- 172.21.15.179:0/372633796 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a8071950 0x7f11a8071d30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f11ad754700 1 -- 172.21.15.179:0/372633796 >> 172.21.15.179:0/372633796 conn(0x7f11a806af70 msgr2=0x7f11a806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7ff9effff700 1 -- 172.21.15.179:0/1418491004 >> v1:172.21.15.190:6789/0 conn(0x7ff9f00cc330 legacy=0x7ff9f016b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7ff9effff700 1 -- 172.21.15.179:0/1418491004 >> v1:172.21.15.179:6789/0 conn(0x7ff9f0071950 legacy=0x7ff9f008a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.889+0000 7ff9effff700 1 -- 172.21.15.179:0/1418491004 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f016f050 con 0x7ff9f00cdb70 2023-12-07T00:14:34.900 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7ffade50e700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac4009670 0x7ffac400fe20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffad000a780 tx=0x7ffac4009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd59c183a9fb4ba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.900 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7fd8484ae700 1 Processor -- start 2023-12-07T00:14:34.900 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069425669 0 0) 0x7f3cf406d7e0 con 0x7f3cf40720d0 2023-12-07T00:14:34.900 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cf40724f0 con 0x7f3cf40720d0 2023-12-07T00:14:34.900 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7fd8484ae700 1 -- start start 2023-12-07T00:14:34.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4253831842 0 0) 0x7f3cf40724f0 con 0x7f3cf40720d0 2023-12-07T00:14:34.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cf414ba10 msgr2=0x7f3cf4071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cf414ba10 0x7f3cf4071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 >> v1:172.21.15.179:6789/0 conn(0x7f3cf40b4b70 legacy=0x7f3cf40b2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf406da80 con 0x7f3cf40720d0 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f3ce8001670 con 0x7f3cf40720d0 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 >> v1:172.21.15.190:6789/0 conn(0x7f3cf40720d0 legacy=0x7f3cf40b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cdc003b90 0x7f3cdc003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cdc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cdc005210 0x7f3cdc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf406e420 con 0x7f3cdc005210 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc00c060 con 0x7f3cdc003b90 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc00c220 con 0x7f3cdc004850 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf37fe700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cdc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f3cf8baf700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cdc005210 0x7f3cdc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f11ad754700 1 -- 172.21.15.179:0/372633796 shutdown_connections 2023-12-07T00:14:34.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7f11ad754700 1 -- 172.21.15.179:0/372633796 wait complete. 2023-12-07T00:14:34.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad00072d0 con 0x7ffac4009670 2023-12-07T00:14:34.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad0007450 con 0x7ffac4009670 2023-12-07T00:14:34.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7ffadcd0b700 1 -- 172.21.15.179:0/2500081707 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0007800 con 0x7ffac4009670 2023-12-07T00:14:34.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.891+0000 7ff9effff700 1 --2- 172.21.15.179:0/1418491004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cdb70 0x7ff9f0161910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009840 tx=0x7ff9e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b797d5cdc4bfd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf37fe700 1 -- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cdc003b90 msgr2=0x7f3cdc003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf37fe700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cdc003b90 0x7f3cdc003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf37fe700 1 -- 172.21.15.179:0/4044798782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cdc005210 msgr2=0x7f3cdc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf37fe700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cdc005210 0x7f3cdc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf37fe700 1 -- 172.21.15.179:0/4044798782 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40724f0 con 0x7f3cdc004850 2023-12-07T00:14:34.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7ff9eeffd700 1 -- 172.21.15.179:0/1418491004 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4004230 con 0x7ff9f00cdb70 2023-12-07T00:14:34.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7ff9eeffd700 1 -- 172.21.15.179:0/1418491004 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e4004390 con 0x7ff9f00cdb70 2023-12-07T00:14:34.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7ff9eeffd700 1 -- 172.21.15.179:0/1418491004 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e40036c0 con 0x7ff9f00cdb70 2023-12-07T00:14:34.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd8484ae700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8400aeba0 0x7fd840136b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd8484ae700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b29b0 0x7fd8400aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd8484ae700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8400b3b30 0x7fd8400b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd8484ae700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400afcc0 con 0x7fd8400b3b30 2023-12-07T00:14:34.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd8484ae700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840137050 con 0x7fd8400b29b0 2023-12-07T00:14:34.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd8484ae700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400af9e0 con 0x7fd8400aeba0 2023-12-07T00:14:34.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf37fe700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cdc004cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c110 tx=0x7f3cdc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c9c3b37d7787dd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd845a49700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b29b0 0x7fd8400aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd845a49700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b29b0 0x7fd8400aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41734/0 (socket says 172.21.15.179:41734) 2023-12-07T00:14:34.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7fd845a49700 1 -- 172.21.15.179:0/3636171209 learned_addr learned my addr 172.21.15.179:0/3636171209 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce800cc50 con 0x7f3cdc004850 2023-12-07T00:14:34.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce800cdd0 con 0x7f3cdc004850 2023-12-07T00:14:34.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7f3cf2ffd700 1 -- 172.21.15.179:0/4044798782 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8005ae0 con 0x7f3cdc004850 2023-12-07T00:14:34.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7ffadff71700 1 -- 172.21.15.179:0/2500081707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac4009670 msgr2=0x7ffac400fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.892+0000 7ffadff71700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac4009670 0x7ffac400fe20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffad000a780 tx=0x7ffac4009c90 comp rx=0 tx=0).stop 2023-12-07T00:14:34.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd846a4b700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8400b3b30 0x7fd8400b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd84624a700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8400aeba0 0x7fd840136b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd845a49700 1 -- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8400aeba0 msgr2=0x7fd840136b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7f161d192700 1 Processor -- start 2023-12-07T00:14:34.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ffadff71700 1 -- 172.21.15.179:0/2500081707 shutdown_connections 2023-12-07T00:14:34.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ffadff71700 1 --2- 172.21.15.179:0/2500081707 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffac4009670 0x7ffac400fe20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ffadff71700 1 -- 172.21.15.179:0/2500081707 >> 172.21.15.179:0/2500081707 conn(0x7ffad806af70 msgr2=0x7ffad806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ff9f650a700 1 -- 172.21.15.179:0/1418491004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cdb70 msgr2=0x7ff9f0161910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ff9f650a700 1 --2- 172.21.15.179:0/1418491004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cdb70 0x7ff9f0161910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4009840 tx=0x7ff9e4009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ff9f650a700 1 -- 172.21.15.179:0/1418491004 shutdown_connections 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ff9f650a700 1 --2- 172.21.15.179:0/1418491004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cdb70 0x7ff9f0161910 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ff9f650a700 1 -- 172.21.15.179:0/1418491004 >> 172.21.15.179:0/1418491004 conn(0x7ff9f006af70 msgr2=0x7ff9f006b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd845a49700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8400aeba0 0x7fd840136b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd845a49700 1 -- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8400b3b30 msgr2=0x7fd8400b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd845a49700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8400b3b30 0x7fd8400b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd845a49700 1 -- 172.21.15.179:0/3636171209 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830009550 con 0x7fd8400b29b0 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd84624a700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8400aeba0 0x7fd840136b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:34.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd846a4b700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8400b3b30 0x7fd8400b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ffadff71700 1 -- 172.21.15.179:0/2500081707 shutdown_connections 2023-12-07T00:14:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7fd845a49700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b29b0 0x7fd8400aeff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd83800ba80 tx=0x7fd83800be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7f3cfa612700 1 -- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 msgr2=0x7f3cdc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7f3cfa612700 1 --2- 172.21.15.179:0/4044798782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cdc004cd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ce800c110 tx=0x7f3cdc005880 comp rx=0 tx=0).stop 2023-12-07T00:14:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7f3cf8baf700 1 -- 172.21.15.179:0/4044798782 reap_dead start 2023-12-07T00:14:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f3cfa612700 1 -- 172.21.15.179:0/4044798782 shutdown_connections 2023-12-07T00:14:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f3cfa612700 1 -- 172.21.15.179:0/4044798782 >> 172.21.15.179:0/4044798782 conn(0x7f3cf406b150 msgr2=0x7f3cf406b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f44edab4700 1 Processor -- start 2023-12-07T00:14:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7f11ad754700 1 Processor -- start 2023-12-07T00:14:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f11ad754700 1 -- start start 2023-12-07T00:14:34.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f3cfa612700 1 -- 172.21.15.179:0/4044798782 shutdown_connections 2023-12-07T00:14:34.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f44edab4700 1 -- start start 2023-12-07T00:14:34.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7f161d192700 1 -- start start 2023-12-07T00:14:34.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f161d192700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f16180b2f80 0x7f161815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f161d192700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180723d0 0x7f16180ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f161d192700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16180ce000 con 0x7f1618143540 2023-12-07T00:14:34.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f161d192700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1618143920 con 0x7f16180b2f80 2023-12-07T00:14:34.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f161d192700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161815a770 con 0x7f16180723d0 2023-12-07T00:14:34.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f3cfa612700 1 -- 172.21.15.179:0/4044798782 wait complete. 2023-12-07T00:14:34.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f1616d9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1618143540 0x7f1618071cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46390/0 (socket says 172.21.15.179:46390) 2023-12-07T00:14:34.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f1616d9d700 1 -- 172.21.15.179:0/2361335698 learned_addr learned my addr 172.21.15.179:0/2361335698 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:34.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.894+0000 7f161659c700 1 --2- 172.21.15.179:0/2361335698 >> v2:172.21.15.190:3300/0 conn(0x7f16180b2f80 0x7f161815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f161759e700 1 --2- 172.21.15.179:0/2361335698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180723d0 0x7f16180ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.893+0000 7ffadff71700 1 -- 172.21.15.179:0/2500081707 wait complete. 2023-12-07T00:14:34.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7ffadff71700 1 Processor -- start 2023-12-07T00:14:34.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f161659c700 1 -- 172.21.15.179:0/2361335698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180723d0 msgr2=0x7f16180ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f161659c700 1 --2- 172.21.15.179:0/2361335698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180723d0 0x7f16180ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f161659c700 1 -- 172.21.15.179:0/2361335698 >> v1:172.21.15.179:6789/0 conn(0x7f1618143540 legacy=0x7f1618071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f161659c700 1 -- 172.21.15.179:0/2361335698 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161815aa50 con 0x7f16180b2f80 2023-12-07T00:14:34.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f11ad754700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11a8071950 0x7f11a815d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f11ad754700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a80b29b0 0x7f11a814d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f11ad754700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a81633d0 0x7f11a81560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f11ad754700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a815af80 con 0x7f11a80b29b0 2023-12-07T00:14:34.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f11ad754700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a814e420 con 0x7f11a81633d0 2023-12-07T00:14:34.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f11ad754700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a815e090 con 0x7f11a8071950 2023-12-07T00:14:34.917 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7fd836ffd700 1 -- 172.21.15.179:0/3636171209 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800ca50 con 0x7fd8400b29b0 2023-12-07T00:14:34.917 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7fd836ffd700 1 -- 172.21.15.179:0/3636171209 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83800cbd0 con 0x7fd8400b29b0 2023-12-07T00:14:34.917 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84013c7d0 con 0x7fd8400b29b0 2023-12-07T00:14:34.917 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7fd836ffd700 1 -- 172.21.15.179:0/3636171209 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd838014440 con 0x7fd8400b29b0 2023-12-07T00:14:34.917 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84013cd90 con 0x7fd8400b29b0 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f44edab4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44e8143540 0x7f44e815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f44edab4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f44e80723d0 0x7f44e80ce530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f44edab4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e80ce000 con 0x7f44e80b2f80 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f44edab4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e8143920 con 0x7f44e80723d0 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f44edab4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e815a770 con 0x7f44e8143540 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f44e77fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44e8143540 0x7f44e815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f44e77fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f44e8143540 0x7f44e815e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41748/0 (socket says 172.21.15.179:41748) 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f44e77fe700 1 -- 172.21.15.179:0/219252006 learned_addr learned my addr 172.21.15.179:0/219252006 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f44e7fff700 1 --2- 172.21.15.179:0/219252006 >> v2:172.21.15.179:3300/0 conn(0x7f44e80723d0 0x7f44e80ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f44e7fff700 1 -- 172.21.15.179:0/219252006 >> v2:172.21.15.190:3300/0 conn(0x7f44e8143540 msgr2=0x7f44e815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f44e7fff700 1 --2- 172.21.15.179:0/219252006 >> v2:172.21.15.190:3300/0 conn(0x7f44e8143540 0x7f44e815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f44e7fff700 1 -- 172.21.15.179:0/219252006 >> v1:172.21.15.190:6789/0 conn(0x7f44e80b2f80 legacy=0x7f44e8071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f44e7fff700 1 -- 172.21.15.179:0/219252006 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e815aa50 con 0x7f44e80723d0 2023-12-07T00:14:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f44e77fe700 1 --2- 172.21.15.179:0/219252006 >> v2:172.21.15.190:3300/0 conn(0x7f44e8143540 0x7f44e815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f161659c700 1 --2- 172.21.15.179:0/2361335698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16180b2f80 0x7f161815e290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1608006b00 tx=0x7f160800ab40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54fef3a40860b730 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f1615d9b700 1 -- 172.21.15.179:0/2361335698 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608004230 con 0x7f16180b2f80 2023-12-07T00:14:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f1615d9b700 1 -- 172.21.15.179:0/2361335698 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160800d040 con 0x7f16180b2f80 2023-12-07T00:14:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f1615d9b700 1 -- 172.21.15.179:0/2361335698 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080036a0 con 0x7f16180b2f80 2023-12-07T00:14:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f3cfa612700 1 Processor -- start 2023-12-07T00:14:34.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f11a6ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11a8071950 0x7f11a815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7f11a77fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a81633d0 0x7f11a81560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f11a6ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11a8071950 0x7f11a815d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39908/0 (socket says 172.21.15.179:39908) 2023-12-07T00:14:34.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f11a6ffd700 1 -- 172.21.15.179:0/4147403100 learned_addr learned my addr 172.21.15.179:0/4147403100 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f11a67fc700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a80b29b0 0x7f11a814d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.895+0000 7ffadff71700 1 -- start start 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ffadff71700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac4009670 0x7ffad8152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ffadff71700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad8153b80 0x7ffad8151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ffadff71700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad81f2f50 0x7ffad80b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ffadff71700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8153070 con 0x7ffad8153b80 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ffadff71700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8156dc0 con 0x7ffac4009670 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ffadff71700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad8151860 con 0x7ffad81f2f50 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ffadd50c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad8153b80 0x7ffad8151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7ffadd50c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad8153b80 0x7ffad8151320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39506/0 (socket says 172.21.15.179:39506) 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7ffadd50c700 1 -- 172.21.15.179:0/901911165 learned_addr learned my addr 172.21.15.179:0/901911165 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ff9f650a700 1 -- 172.21.15.179:0/1418491004 shutdown_connections 2023-12-07T00:14:34.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7ff9f650a700 1 -- 172.21.15.179:0/1418491004 wait complete. 2023-12-07T00:14:34.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f161d192700 1 -- 172.21.15.179:0/2361335698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16180b2f80 msgr2=0x7f161815e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f161d192700 1 --2- 172.21.15.179:0/2361335698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16180b2f80 0x7f161815e290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1608006b00 tx=0x7f160800ab40 comp rx=0 tx=0).stop 2023-12-07T00:14:34.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f161d192700 1 -- 172.21.15.179:0/2361335698 shutdown_connections 2023-12-07T00:14:34.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f161d192700 1 --2- 172.21.15.179:0/2361335698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180723d0 0x7f16180ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f161d192700 1 --2- 172.21.15.179:0/2361335698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16180b2f80 0x7f161815e290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f161d192700 1 -- 172.21.15.179:0/2361335698 >> 172.21.15.179:0/2361335698 conn(0x7f161806af70 msgr2=0x7f161806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f161d192700 1 -- 172.21.15.179:0/2361335698 shutdown_connections 2023-12-07T00:14:34.923 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.896+0000 7f3cfa612700 1 -- start start 2023-12-07T00:14:34.923 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f11a67fc700 1 -- 172.21.15.179:0/4147403100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11a8071950 msgr2=0x7f11a815d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f11a67fc700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11a8071950 0x7f11a815d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f11a67fc700 1 -- 172.21.15.179:0/4147403100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a81633d0 msgr2=0x7f11a81560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f11a67fc700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a81633d0 0x7f11a81560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f11a67fc700 1 -- 172.21.15.179:0/4147403100 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980094a0 con 0x7f11a80b29b0 2023-12-07T00:14:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7ffade50e700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad81f2f50 0x7ffad80b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7ffadd50c700 1 -- 172.21.15.179:0/901911165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad81f2f50 msgr2=0x7ffad80b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7ffadd50c700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad81f2f50 0x7ffad80b17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7ffadd50c700 1 -- 172.21.15.179:0/901911165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac4009670 msgr2=0x7ffad8152b30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T00:14:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7ffadd50c700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac4009670 0x7ffad8152b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7ffadd50c700 1 -- 172.21.15.179:0/901911165 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad8151a90 con 0x7ffad8153b80 2023-12-07T00:14:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f3cfa612700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cf41486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7ff9f650a700 1 Processor -- start 2023-12-07T00:14:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cf41486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cfa612700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf413f420 0x7f3cf4162970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf3fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cf41486a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39924/0 (socket says 172.21.15.179:39924) 2023-12-07T00:14:34.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf3fff700 1 -- 172.21.15.179:0/3431573031 learned_addr learned my addr 172.21.15.179:0/3431573031 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7ffadd50c700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad8153b80 0x7ffad8151320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffac800b3a0 tx=0x7ffac800b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cfa612700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf4146950 0x7f3cf4164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf413bd10 con 0x7f3cf4146950 2023-12-07T00:14:34.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf4163fe0 con 0x7f3cf413f420 2023-12-07T00:14:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf4164280 con 0x7f3cdc004850 2023-12-07T00:14:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f44e7fff700 1 --2- 172.21.15.179:0/219252006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 0x7f44e80ce530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44e806bfd0 tx=0x7f44e000d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4fb16ca0d731f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.897+0000 7f161d192700 1 -- 172.21.15.179:0/2361335698 wait complete. 2023-12-07T00:14:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf8baf700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf4146950 0x7f3cf4164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7fd836ffd700 1 -- 172.21.15.179:0/3636171209 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd83801d3b0 con 0x7fd8400b29b0 2023-12-07T00:14:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7fd836ffd700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd82406af20 0x7fd82406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f44e67fc700 1 -- 172.21.15.179:0/219252006 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0010070 con 0x7f44e80723d0 2023-12-07T00:14:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f44e67fc700 1 -- 172.21.15.179:0/219252006 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e000dc70 con 0x7f44e80723d0 2023-12-07T00:14:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f44e67fc700 1 -- 172.21.15.179:0/219252006 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0007aa0 con 0x7f44e80723d0 2023-12-07T00:14:34.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf3fff700 1 -- 172.21.15.179:0/3431573031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf413f420 msgr2=0x7f3cf4162970 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T00:14:34.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf3fff700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf413f420 0x7f3cf4162970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf3fff700 1 -- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf4146950 msgr2=0x7f3cf4164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf3fff700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf4146950 0x7f3cf4164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f3cf3fff700 1 -- 172.21.15.179:0/3431573031 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf41631c0 con 0x7f3cdc004850 2023-12-07T00:14:34.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7f11a67fc700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a80b29b0 0x7f11a814d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f119c00c3c0 tx=0x7f119c00c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.898+0000 7fd84624a700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd82406af20 0x7fd82406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7fd836ffd700 1 -- 172.21.15.179:0/3636171209 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd838006e40 con 0x7fd8400b29b0 2023-12-07T00:14:34.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84013c630 con 0x7fd8400b29b0 2023-12-07T00:14:34.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7fd84624a700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd82406af20 0x7fd82406d3e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd830000c00 tx=0x7fd830008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f3cf3fff700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cf41486a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ce401f7e0 tx=0x7f3ce401fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f3cf0ff9700 1 -- 172.21.15.179:0/3431573031 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4024680 con 0x7f3cdc004850 2023-12-07T00:14:34.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f3cf0ff9700 1 -- 172.21.15.179:0/3431573031 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40247e0 con 0x7f3cdc004850 2023-12-07T00:14:34.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f3cf0ff9700 1 -- 172.21.15.179:0/3431573031 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4024b70 con 0x7f3cdc004850 2023-12-07T00:14:34.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f118f7fe700 1 -- 172.21.15.179:0/4147403100 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c0052d0 con 0x7f11a80b29b0 2023-12-07T00:14:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f118f7fe700 1 -- 172.21.15.179:0/4147403100 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c005450 con 0x7f11a80b29b0 2023-12-07T00:14:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f118f7fe700 1 -- 172.21.15.179:0/4147403100 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c0038c0 con 0x7f11a80b29b0 2023-12-07T00:14:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a815a8c0 con 0x7f11a80b29b0 2023-12-07T00:14:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a815e370 con 0x7f11a80b29b0 2023-12-07T00:14:34.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf41634a0 con 0x7f3cdc004850 2023-12-07T00:14:34.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf4162eb0 con 0x7f3cdc004850 2023-12-07T00:14:34.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7f44edab4700 1 -- 172.21.15.179:0/219252006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 msgr2=0x7f44e80ce530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7f44edab4700 1 --2- 172.21.15.179:0/219252006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 0x7f44e80ce530 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f44e806bfd0 tx=0x7f44e000d4c0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7f44edab4700 1 -- 172.21.15.179:0/219252006 shutdown_connections 2023-12-07T00:14:34.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7f44edab4700 1 --2- 172.21.15.179:0/219252006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 0x7f44e80ce530 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7f44edab4700 1 --2- 172.21.15.179:0/219252006 >> v2:172.21.15.190:3300/0 conn(0x7f44e8143540 0x7f44e815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7f44edab4700 1 -- 172.21.15.179:0/219252006 >> 172.21.15.179:0/219252006 conn(0x7f44e806af70 msgr2=0x7f44e806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7f161d192700 1 Processor -- start 2023-12-07T00:14:34.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7fface7fc700 1 -- 172.21.15.179:0/901911165 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8011830 con 0x7ffad8153b80 2023-12-07T00:14:34.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7fface7fc700 1 -- 172.21.15.179:0/901911165 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac80119d0 con 0x7ffad8153b80 2023-12-07T00:14:34.934 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.899+0000 7fface7fc700 1 -- 172.21.15.179:0/901911165 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8011d80 con 0x7ffad8153b80 2023-12-07T00:14:34.934 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad8151d70 con 0x7ffad8153b80 2023-12-07T00:14:34.934 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad8152330 con 0x7ffad8153b80 2023-12-07T00:14:34.934 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.900+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd40052e0 con 0x7f3cdc004850 2023-12-07T00:14:34.934 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.901+0000 7f44edab4700 1 -- 172.21.15.179:0/219252006 shutdown_connections 2023-12-07T00:14:34.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.901+0000 7f161d192700 1 -- start start 2023-12-07T00:14:34.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f161d192700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16180723d0 0x7f16180b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f161d192700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180b2f80 0x7f1618151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f161d192700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1618143540 0x7f16181518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f161d192700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16180b13a0 con 0x7f16180723d0 2023-12-07T00:14:34.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f161d192700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16180b1680 con 0x7f1618143540 2023-12-07T00:14:34.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f161d192700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16180b1960 con 0x7f16180b2f80 2023-12-07T00:14:34.935 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f3cf0ff9700 1 -- 172.21.15.179:0/3431573031 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ce4024cd0 con 0x7f3cdc004850 2023-12-07T00:14:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.901+0000 7f118f7fe700 1 -- 172.21.15.179:0/4147403100 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f119c003a20 con 0x7f11a80b29b0 2023-12-07T00:14:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.901+0000 7f118f7fe700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119406aed0 0x7f119406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f11a6ffd700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119406aed0 0x7f119406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11880052e0 con 0x7f11a80b29b0 2023-12-07T00:14:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad8067ee0 con 0x7ffad8153b80 2023-12-07T00:14:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7fface7fc700 1 -- 172.21.15.179:0/901911165 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffac801a400 con 0x7ffad8153b80 2023-12-07T00:14:34.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.901+0000 7ff9f650a700 1 -- start start 2023-12-07T00:14:34.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f11a6ffd700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119406aed0 0x7f119406d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1198009b90 tx=0x7f1198008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f118f7fe700 1 -- 172.21.15.179:0/4147403100 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f119c057ee0 con 0x7f11a80b29b0 2023-12-07T00:14:34.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7f3cf0ff9700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3ce006afa0 0x7f3ce006d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f3cf0ff9700 1 -- 172.21.15.179:0/3431573031 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ce409af40 con 0x7f3cdc004850 2023-12-07T00:14:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9f650a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f0071950 0x7ff9f016a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9f650a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cc330 0x7ff9f02082c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9f650a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f00cdb70 0x7ff9f0208800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9f650a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f0204630 con 0x7ff9f00cdb70 2023-12-07T00:14:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9f650a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f02039b0 con 0x7ff9f00cc330 2023-12-07T00:14:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9f650a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f0203c90 con 0x7ff9f0071950 2023-12-07T00:14:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9effff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f0071950 0x7ff9f016a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9ef7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cc330 0x7ff9f02082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.939 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f3cf37fe700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3ce006afa0 0x7f3ce006d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.939 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9effff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f0071950 0x7ff9f016a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39942/0 (socket says 172.21.15.179:39942) 2023-12-07T00:14:34.939 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ff9effff700 1 -- 172.21.15.179:0/1233824347 learned_addr learned my addr 172.21.15.179:0/1233824347 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.939 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f161659c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180b2f80 0x7f1618151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f161659c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180b2f80 0x7f1618151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39936/0 (socket says 172.21.15.179:39936) 2023-12-07T00:14:34.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f161659c700 1 -- 172.21.15.179:0/4015822434 learned_addr learned my addr 172.21.15.179:0/4015822434 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f161759e700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1618143540 0x7f16181518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.902+0000 7fb1d7d5b700 1 Processor -- start 2023-12-07T00:14:34.940 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f3cf37fe700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3ce006afa0 0x7f3ce006d460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3cf41f2ba0 tx=0x7f3ce800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7ff9ef7fe700 1 -- 172.21.15.179:0/1233824347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f0071950 msgr2=0x7ff9f016a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7ff9ef7fe700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f0071950 0x7ff9f016a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7ff9ef7fe700 1 -- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f00cdb70 msgr2=0x7ff9f0208800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7ff9ef7fe700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f00cdb70 0x7ff9f0208800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7ff9ef7fe700 1 -- 172.21.15.179:0/1233824347 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e40094a0 con 0x7ff9f00cc330 2023-12-07T00:14:34.941 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f1616d9d700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16180723d0 0x7f16180b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.901+0000 7f44edab4700 1 -- 172.21.15.179:0/219252006 wait complete. 2023-12-07T00:14:34.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7ff9ef7fe700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cc330 0x7ff9f02082c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c450 tx=0x7ff9e000c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f44edab4700 1 Processor -- start 2023-12-07T00:14:34.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7f44edab4700 1 -- start start 2023-12-07T00:14:34.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7fb1d7d5b700 1 -- start start 2023-12-07T00:14:34.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f1616d9d700 1 -- 172.21.15.179:0/4015822434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180b2f80 msgr2=0x7f1618151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f1616d9d700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180b2f80 0x7f1618151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f1616d9d700 1 -- 172.21.15.179:0/4015822434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1618143540 msgr2=0x7f16181518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f1616d9d700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1618143540 0x7f16181518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.943 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f1616d9d700 1 -- 172.21.15.179:0/4015822434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160800a4c0 con 0x7f16180723d0 2023-12-07T00:14:34.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f1616d9d700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16180723d0 0x7f16180b2160 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f160c00c700 tx=0x7f160c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7fface7fc700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffac406cc80 0x7ffac406f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7fface7fc700 1 -- 172.21.15.179:0/901911165 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffac8089820 con 0x7ffad8153b80 2023-12-07T00:14:34.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ffaddd0d700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffac406cc80 0x7ffac406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.903+0000 7ffaddd0d700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffac406cc80 0x7ffac406f140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffad4006fd0 tx=0x7ffad4006e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.904+0000 7f44edab4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 0x7f44e80b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44edab4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e80b2f80 0x7f44e8211830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44edab4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44e8143540 0x7f44e8211d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7ff9ecff9700 1 -- 172.21.15.179:0/1233824347 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00052d0 con 0x7ff9f00cc330 2023-12-07T00:14:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7ff9ecff9700 1 -- 172.21.15.179:0/1233824347 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0005430 con 0x7ff9f00cc330 2023-12-07T00:14:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7ff9ecff9700 1 -- 172.21.15.179:0/1233824347 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00038a0 con 0x7ff9f00cc330 2023-12-07T00:14:34.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f0203f70 con 0x7ff9f00cc330 2023-12-07T00:14:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44edab4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b1570 con 0x7f44e80723d0 2023-12-07T00:14:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44edab4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b1850 con 0x7f44e8143540 2023-12-07T00:14:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44edab4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80b1b30 con 0x7f44e80b2f80 2023-12-07T00:14:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d7d5b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d015ddf0 0x7fb1d01618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d7d5b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb1d00b9970 0x7fb1d00d09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f016a650 con 0x7ff9f00cc330 2023-12-07T00:14:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44e6ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e80b2f80 0x7f44e8211830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d7d5b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d015e1d0 con 0x7fb1d00d0f10 2023-12-07T00:14:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d7d5b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d00d2150 con 0x7fb1d00b9970 2023-12-07T00:14:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d7d5b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00d13c0 con 0x7fb1d015ddf0 2023-12-07T00:14:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44e6ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e80b2f80 0x7f44e8211830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39952/0 (socket says 172.21.15.179:39952) 2023-12-07T00:14:34.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44e6ffd700 1 -- 172.21.15.179:0/723901561 learned_addr learned my addr 172.21.15.179:0/723901561 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d5af7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d015ddf0 0x7fb1d01618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d5af7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d015ddf0 0x7fb1d01618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39956/0 (socket says 172.21.15.179:39956) 2023-12-07T00:14:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d5af7700 1 -- 172.21.15.179:0/1440359320 learned_addr learned my addr 172.21.15.179:0/1440359320 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44e7fff700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44e8143540 0x7f44e8211d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7f44e77fe700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 0x7f44e80b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fd836ffd700 1 -- 172.21.15.179:0/3636171209 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd84013c630 con 0x7fd8400b29b0 2023-12-07T00:14:34.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d5af7700 1 -- 172.21.15.179:0/1440359320 >> v2:172.21.15.179:3300/0 conn(0x7fb1d00b9970 msgr2=0x7fb1d00d09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d5af7700 1 --2- 172.21.15.179:0/1440359320 >> v2:172.21.15.179:3300/0 conn(0x7fb1d00b9970 0x7fb1d00d09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d5af7700 1 -- 172.21.15.179:0/1440359320 >> v1:172.21.15.179:6789/0 conn(0x7fb1d00d0f10 legacy=0x7fb1d00b5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:34.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.905+0000 7fb1d5af7700 1 -- 172.21.15.179:0/1440359320 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d0162820 con 0x7fb1d015ddf0 2023-12-07T00:14:34.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.906+0000 7fb1d5af7700 1 --2- 172.21.15.179:0/1440359320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d015ddf0 0x7fb1d01618f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0098f0 tx=0x7fb1cc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b9733f9b9500d59 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.906+0000 7f44e77fe700 1 -- 172.21.15.179:0/723901561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e80b2f80 msgr2=0x7f44e8211830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.906+0000 7f44e77fe700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e80b2f80 0x7f44e8211830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.906+0000 7f44e77fe700 1 -- 172.21.15.179:0/723901561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44e8143540 msgr2=0x7f44e8211d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.906+0000 7f44e77fe700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44e8143540 0x7f44e8211d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.906+0000 7f44e77fe700 1 -- 172.21.15.179:0/723901561 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0007910 con 0x7f44e80723d0 2023-12-07T00:14:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.906+0000 7f44e77fe700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 0x7f44e80b0540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00d800 tx=0x7f44dc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.906+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f0067ee0 con 0x7ff9f00cc330 2023-12-07T00:14:34.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.907+0000 7fb1d4af5700 1 -- 172.21.15.179:0/1440359320 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc004230 con 0x7fb1d015ddf0 2023-12-07T00:14:34.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.907+0000 7fb1d4af5700 1 -- 172.21.15.179:0/1440359320 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc004390 con 0x7fb1d015ddf0 2023-12-07T00:14:34.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.907+0000 7fb1d4af5700 1 -- 172.21.15.179:0/1440359320 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0036a0 con 0x7fb1d015ddf0 2023-12-07T00:14:34.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.907+0000 7f3cf0ff9700 1 -- 172.21.15.179:0/3431573031 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3ce4065ce0 con 0x7f3cdc004850 2023-12-07T00:14:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.907+0000 7ff9ecff9700 1 -- 172.21.15.179:0/1233824347 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9e0003a00 con 0x7ff9f00cc330 2023-12-07T00:14:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/1440359320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d015ddf0 msgr2=0x7fb1d01618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/1440359320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d015ddf0 0x7fb1d01618f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0098f0 tx=0x7fb1cc009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7ff9ecff9700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/1440359320 shutdown_connections 2023-12-07T00:14:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/1440359320 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d015ddf0 0x7fb1d01618f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/1440359320 >> v2:172.21.15.179:3300/0 conn(0x7fb1d00b9970 0x7fb1d00d09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/1440359320 >> 172.21.15.179:0/1440359320 conn(0x7fb1d006c970 msgr2=0x7fb1d006cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7ff9ecff9700 1 -- 172.21.15.179:0/1233824347 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff9e0088bc0 con 0x7ff9f00cc330 2023-12-07T00:14:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7ff9effff700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.908+0000 7ff9effff700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4004720 tx=0x7ff9e4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.909+0000 7fface7fc700 1 -- 172.21.15.179:0/901911165 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffac80545c0 con 0x7ffad8153b80 2023-12-07T00:14:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.912+0000 7ff9ecff9700 1 -- 172.21.15.179:0/1233824347 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9e0053a20 con 0x7ff9f00cc330 2023-12-07T00:14:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.913+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/1440359320 shutdown_connections 2023-12-07T00:14:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.913+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/1440359320 wait complete. 2023-12-07T00:14:34.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.914+0000 7f15ff7fe700 1 -- 172.21.15.179:0/4015822434 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00e8c0 con 0x7f16180723d0 2023-12-07T00:14:34.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.915+0000 7fb1d7d5b700 1 Processor -- start 2023-12-07T00:14:34.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.914+0000 7f118f7fe700 1 -- 172.21.15.179:0/4147403100 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f119c053b20 con 0x7f11a80b29b0 2023-12-07T00:14:34.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.916+0000 7f44cffff700 1 -- 172.21.15.179:0/723901561 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc004030 con 0x7f44e80723d0 2023-12-07T00:14:34.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.916+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e80b1e10 con 0x7f44e80723d0 2023-12-07T00:14:34.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.916+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e80af8e0 con 0x7f44e80723d0 2023-12-07T00:14:34.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.914+0000 7f15ff7fe700 1 -- 172.21.15.179:0/4015822434 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c00ea20 con 0x7f16180723d0 2023-12-07T00:14:34.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.914+0000 7f15ff7fe700 1 -- 172.21.15.179:0/4015822434 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00edd0 con 0x7f16180723d0 2023-12-07T00:14:34.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.914+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16180b1c40 con 0x7f16180723d0 2023-12-07T00:14:34.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.915+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1618151e10 con 0x7f16180723d0 2023-12-07T00:14:34.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.917+0000 7f44cffff700 1 -- 172.21.15.179:0/723901561 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc004190 con 0x7f44e80723d0 2023-12-07T00:14:34.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.917+0000 7f44cffff700 1 -- 172.21.15.179:0/723901561 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc004500 con 0x7f44e80723d0 2023-12-07T00:14:34.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.919+0000 7f44cffff700 1 -- 172.21.15.179:0/723901561 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44dc0036a0 con 0x7f44e80723d0 2023-12-07T00:14:34.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.916+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f80052e0 con 0x7f16180723d0 2023-12-07T00:14:34.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.918+0000 7f15ff7fe700 1 -- 172.21.15.179:0/4015822434 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f160c016420 con 0x7f16180723d0 2023-12-07T00:14:34.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.919+0000 7f15ff7fe700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406afa0 0x7f160406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.919+0000 7f15ff7fe700 1 -- 172.21.15.179:0/4015822434 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f160c012070 con 0x7f16180723d0 2023-12-07T00:14:34.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.919+0000 7f44cffff700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44d406aed0 0x7f44d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.920+0000 7f44e6ffd700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44d406aed0 0x7f44d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.920+0000 7f44e6ffd700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44d406aed0 0x7f44d406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44e8153f20 tx=0x7f44d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.924+0000 7fb1d7d5b700 1 -- start start 2023-12-07T00:14:34.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d7d5b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d00b9970 0x7fb1d01fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.958 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d7d5b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d00d0f10 0x7fb1d0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d7d5b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d015ddf0 0x7fb1d0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d7d5b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00cdb40 con 0x7fb1d015ddf0 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d7d5b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d0157790 con 0x7fb1d00d0f10 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d7d5b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d01fcb30 con 0x7fb1d00b9970 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d52f6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d00d0f10 0x7fb1d0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d52f6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d00d0f10 0x7fb1d0156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41808/0 (socket says 172.21.15.179:41808) 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.925+0000 7fb1d52f6700 1 -- 172.21.15.179:0/2764224540 learned_addr learned my addr 172.21.15.179:0/2764224540 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7f44cffff700 1 -- 172.21.15.179:0/723901561 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44dc058350 con 0x7f44e80723d0 2023-12-07T00:14:34.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.930+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c80052e0 con 0x7f44e80723d0 2023-12-07T00:14:34.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.927+0000 7f161659c700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406afa0 0x7f160406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.928+0000 7f15ff7fe700 1 -- 172.21.15.179:0/4015822434 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f160c054b80 con 0x7f16180723d0 2023-12-07T00:14:34.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1d52f6700 1 -- 172.21.15.179:0/2764224540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d00b9970 msgr2=0x7fb1d01fbf90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T00:14:34.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1d52f6700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d00b9970 0x7fb1d01fbf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1d52f6700 1 -- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d015ddf0 msgr2=0x7fb1d0157250 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T00:14:34.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1d52f6700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d015ddf0 0x7fb1d0157250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:34.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1d52f6700 1 -- 172.21.15.179:0/2764224540 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc009550 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1d52f6700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d00d0f10 0x7fb1d0156d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000b450 tx=0x7fb1c000b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1c67fc700 1 -- 172.21.15.179:0/2764224540 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0011830 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1c67fc700 1 -- 172.21.15.179:0/2764224540 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0011990 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.926+0000 7fb1c67fc700 1 -- 172.21.15.179:0/2764224540 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0011d40 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.927+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d00ccf00 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.927+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d00cd480 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.928+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d00d4b80 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.929+0000 7fb1c67fc700 1 -- 172.21.15.179:0/2764224540 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1c001a400 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.930+0000 7fb1c67fc700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1b406aed0 0x7fb1b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.930+0000 7fb1c67fc700 1 -- 172.21.15.179:0/2764224540 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1c0089840 con 0x7fb1d00d0f10 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.931+0000 7fb1d5af7700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1b406aed0 0x7fb1b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.931+0000 7fb1d5af7700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1b406aed0 0x7fb1b406d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc000c00 tx=0x7fb1cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.961 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.934+0000 7fb1c67fc700 1 -- 172.21.15.179:0/2764224540 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1c0054690 con 0x7fb1d00d0f10 2023-12-07T00:14:34.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.939+0000 7f161659c700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406afa0 0x7f160406d460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f16180b3f20 tx=0x7f160801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:34.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:34.940+0000 7f44cffff700 1 -- 172.21.15.179:0/723901561 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44dc019020 con 0x7f44e80723d0 2023-12-07T00:14:35.306 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.306+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1188005590 con 0x7f11a80b29b0 2023-12-07T00:14:35.306 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.306+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd84013c630 con 0x7fd8400b29b0 2023-12-07T00:14:35.307 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.307+0000 7f118f7fe700 1 -- 172.21.15.179:0/4147403100 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f119c017020 con 0x7f11a80b29b0 2023-12-07T00:14:35.307 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.307+0000 7fd836ffd700 1 -- 172.21.15.179:0/3636171209 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd84013c630 con 0x7fd8400b29b0 2023-12-07T00:14:35.308 INFO:teuthology.orchestra.run.smithi179.stdout:55834574856 2023-12-07T00:14:35.311 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:35.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119406aed0 msgr2=0x7f119406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119406aed0 0x7f119406d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1198009b90 tx=0x7f1198008030 comp rx=0 tx=0).stop 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a80b29b0 msgr2=0x7f11a814d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a80b29b0 0x7f11a814d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f119c00c3c0 tx=0x7f119c00c780 comp rx=0 tx=0).stop 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 shutdown_connections 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f119406aed0 0x7f119406d390 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1198009b90 tx=0x7f1198008030 comp rx=0 tx=0).stop 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f11a81633d0 0x7f11a81560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11a8071950 0x7f11a815d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 --2- 172.21.15.179:0/4147403100 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f11a80b29b0 0x7f11a814d390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 >> 172.21.15.179:0/4147403100 conn(0x7f11a806af70 msgr2=0x7f11a806b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:35.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd82406af20 msgr2=0x7fd82406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7fd8484ae700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd82406af20 0x7fd82406d3e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd830000c00 tx=0x7fd830008030 comp rx=0 tx=0).stop 2023-12-07T00:14:35.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b29b0 msgr2=0x7fd8400aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7fd8484ae700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b29b0 0x7fd8400aeff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd83800ba80 tx=0x7fd83800be40 comp rx=0 tx=0).stop 2023-12-07T00:14:35.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 shutdown_connections 2023-12-07T00:14:35.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.312+0000 7f11ad754700 1 -- 172.21.15.179:0/4147403100 wait complete. 2023-12-07T00:14:35.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.313+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 shutdown_connections 2023-12-07T00:14:35.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.313+0000 7fd8484ae700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd82406af20 0x7fd82406d3e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.313+0000 7fd8484ae700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8400b3b30 0x7fd8400b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.313+0000 7fd8484ae700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd8400aeba0 0x7fd840136b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.313+0000 7fd8484ae700 1 --2- 172.21.15.179:0/3636171209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8400b29b0 0x7fd8400aeff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.313+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 >> 172.21.15.179:0/3636171209 conn(0x7fd84006af70 msgr2=0x7fd84013ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:35.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.313+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 shutdown_connections 2023-12-07T00:14:35.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.313+0000 7fd8484ae700 1 -- 172.21.15.179:0/3636171209 wait complete. 2023-12-07T00:14:35.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.314+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3cd4005860 con 0x7f3cdc004850 2023-12-07T00:14:35.316 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.316+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ffad806e540 con 0x7ffad8153b80 2023-12-07T00:14:35.316 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.316+0000 7fface7fc700 1 -- 172.21.15.179:0/901911165 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffac8009200 con 0x7ffad8153b80 2023-12-07T00:14:35.316 INFO:teuthology.orchestra.run.smithi179.stdout:55834574857 2023-12-07T00:14:35.316 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.318+0000 7f3cf0ff9700 1 -- 172.21.15.179:0/3431573031 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ce4028090 con 0x7f3cdc004850 2023-12-07T00:14:35.317 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:35.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.321+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3ce006afa0 msgr2=0x7f3ce006d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.321+0000 7f3cfa612700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3ce006afa0 0x7f3ce006d460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3cf41f2ba0 tx=0x7f3ce800a000 comp rx=0 tx=0).stop 2023-12-07T00:14:35.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.321+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 msgr2=0x7f3cf41486a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.321+0000 7f3cfa612700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cf41486a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ce401f7e0 tx=0x7f3ce401fba0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.322+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f15f8005860 con 0x7f16180723d0 2023-12-07T00:14:35.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.322+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff9f00b4220 con 0x7ff9f00cc330 2023-12-07T00:14:35.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 shutdown_connections 2023-12-07T00:14:35.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7f3cfa612700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3ce006afa0 0x7f3ce006d460 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7f3cfa612700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3cf4146950 0x7f3cf4164710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7f3cfa612700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3cdc004850 0x7f3cf41486a0 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3ce401f7e0 tx=0x7f3ce401fba0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7f3cfa612700 1 --2- 172.21.15.179:0/3431573031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3cf413f420 0x7f3cf4162970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 >> 172.21.15.179:0/3431573031 conn(0x7f3cf406b150 msgr2=0x7f3cf40b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:35.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffac406cc80 msgr2=0x7ffac406f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffac406cc80 0x7ffac406f140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ffad4006fd0 tx=0x7ffad4006e80 comp rx=0 tx=0).stop 2023-12-07T00:14:35.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad8153b80 msgr2=0x7ffad8151320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad8153b80 0x7ffad8151320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffac800b3a0 tx=0x7ffac800b760 comp rx=0 tx=0).stop 2023-12-07T00:14:35.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ff9ecff9700 1 -- 172.21.15.179:0/1233824347 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9e0017090 con 0x7ff9f00cc330 2023-12-07T00:14:35.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7f15ff7fe700 1 -- 172.21.15.179:0/4015822434 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f160c0581a0 con 0x7f16180723d0 2023-12-07T00:14:35.324 INFO:teuthology.orchestra.run.smithi179.stdout:55834574856 2023-12-07T00:14:35.324 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:35.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 shutdown_connections 2023-12-07T00:14:35.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffac406cc80 0x7ffac406f140 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad81f2f50 0x7ffad80b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac4009670 0x7ffad8152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 --2- 172.21.15.179:0/901911165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffad8153b80 0x7ffad8151320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 >> 172.21.15.179:0/901911165 conn(0x7ffad806af70 msgr2=0x7ffad815d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:35.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.323+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 shutdown_connections 2023-12-07T00:14:35.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.324+0000 7ffadff71700 1 -- 172.21.15.179:0/901911165 wait complete. 2023-12-07T00:14:35.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 shutdown_connections 2023-12-07T00:14:35.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 msgr2=0x7ff9dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4004720 tx=0x7ff9e4010000 comp rx=0 tx=0).stop 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cc330 msgr2=0x7ff9f02082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cc330 0x7ff9f02082c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c450 tx=0x7ff9e000c760 comp rx=0 tx=0).stop 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 shutdown_connections 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff9dc06aed0 0x7ff9dc06d390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff9f00cdb70 0x7ff9f0208800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9f0071950 0x7ff9f016a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 --2- 172.21.15.179:0/1233824347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff9f00cc330 0x7ff9f02082c0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000c450 tx=0x7ff9e000c760 comp rx=0 tx=0).stop 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 >> 172.21.15.179:0/1233824347 conn(0x7ff9f006af70 msgr2=0x7ff9f016cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 shutdown_connections 2023-12-07T00:14:35.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.327+0000 7ff9f650a700 1 -- 172.21.15.179:0/1233824347 wait complete. 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406afa0 msgr2=0x7f160406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406afa0 0x7f160406d460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f16180b3f20 tx=0x7f160801c040 comp rx=0 tx=0).stop 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16180723d0 msgr2=0x7f16180b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16180723d0 0x7f16180b2160 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f160c00c700 tx=0x7f160c00ca10 comp rx=0 tx=0).stop 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 shutdown_connections 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406afa0 0x7f160406d460 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f16180b3f20 tx=0x7f160801c040 comp rx=0 tx=0).stop 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1618143540 0x7f16181518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f16180723d0 0x7f16180b2160 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.332 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 --2- 172.21.15.179:0/4015822434 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16180b2f80 0x7f1618151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.333+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 >> 172.21.15.179:0/4015822434 conn(0x7f161806af70 msgr2=0x7f161806d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:35.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.335+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 shutdown_connections 2023-12-07T00:14:35.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.335+0000 7f3cfa612700 1 -- 172.21.15.179:0/3431573031 wait complete. 2023-12-07T00:14:35.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-12-07T00:14:35.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.337+0000 7f161d192700 1 -- 172.21.15.179:0/4015822434 wait complete. 2023-12-07T00:14:35.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-12-07T00:14:35.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.338+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f44c8005860 con 0x7f44e80723d0 2023-12-07T00:14:35.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.339+0000 7f44cffff700 1 -- 172.21.15.179:0/723901561 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44dc053f90 con 0x7f44e80723d0 2023-12-07T00:14:35.339 INFO:teuthology.orchestra.run.smithi179.stdout:55834574857 2023-12-07T00:14:35.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.342+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb1d00685f0 con 0x7fb1d00d0f10 2023-12-07T00:14:35.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.342+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44d406aed0 msgr2=0x7f44d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.342+0000 7f44edab4700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44d406aed0 0x7f44d406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f44e8153f20 tx=0x7f44d8009040 comp rx=0 tx=0).stop 2023-12-07T00:14:35.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.342+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 msgr2=0x7f44e80b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.342+0000 7f44edab4700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 0x7f44e80b0540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00d800 tx=0x7f44dc00db10 comp rx=0 tx=0).stop 2023-12-07T00:14:35.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.342+0000 7fb1c67fc700 1 -- 172.21.15.179:0/2764224540 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1c0015090 con 0x7fb1d00d0f10 2023-12-07T00:14:35.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.343+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 shutdown_connections 2023-12-07T00:14:35.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.343+0000 7f44edab4700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f44d406aed0 0x7f44d406d390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.343+0000 7f44edab4700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44e8143540 0x7f44e8211d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.343+0000 7f44edab4700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f44e80723d0 0x7f44e80b0540 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.343+0000 7f44edab4700 1 --2- 172.21.15.179:0/723901561 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f44e80b2f80 0x7f44e8211830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.343+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 >> 172.21.15.179:0/723901561 conn(0x7f44e806af70 msgr2=0x7f44e81593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:35.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.343+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 shutdown_connections 2023-12-07T00:14:35.345 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.343+0000 7f44edab4700 1 -- 172.21.15.179:0/723901561 wait complete. 2023-12-07T00:14:35.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-12-07T00:14:35.346 INFO:teuthology.orchestra.run.smithi179.stdout:55834574859 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.347+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1b406aed0 msgr2=0x7fb1b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.347+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1b406aed0 0x7fb1b406d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc000c00 tx=0x7fb1cc008030 comp rx=0 tx=0).stop 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.347+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d00d0f10 msgr2=0x7fb1d0156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.347+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d00d0f10 0x7fb1d0156d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000b450 tx=0x7fb1c000b810 comp rx=0 tx=0).stop 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.348+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 shutdown_connections 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.348+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1b406aed0 0x7fb1b406d390 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc000c00 tx=0x7fb1cc008030 comp rx=0 tx=0).stop 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.348+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1d015ddf0 0x7fb1d0157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.348+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1d00b9970 0x7fb1d01fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.348+0000 7fb1d7d5b700 1 --2- 172.21.15.179:0/2764224540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1d00d0f10 0x7fb1d0156d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:35.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.348+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 >> 172.21.15.179:0/2764224540 conn(0x7fb1d006c970 msgr2=0x7fb1d00d4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:35.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.350+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 shutdown_connections 2023-12-07T00:14:35.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:35.350+0000 7fb1d7d5b700 1 -- 172.21.15.179:0/2764224540 wait complete. 2023-12-07T00:14:35.350 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2023-12-07T00:14:35.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-12-07T00:14:35.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-12-07T00:14:35.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-12-07T00:14:35.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2023-12-07T00:14:36.338 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-07T00:14:36.339 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-07T00:14:36.346 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-07T00:14:36.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-07T00:14:36.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-07T00:14:36.359 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-07T00:14:36.368 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-07T00:14:36.369 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-07T00:14:36.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.541+0000 7f4dc1835700 1 Processor -- start 2023-12-07T00:14:36.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.541+0000 7f4dc1835700 1 -- start start 2023-12-07T00:14:36.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.542+0000 7f4dc1835700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14b530 0x7f4dbc06d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.542+0000 7f4dc1835700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4dbc14bb40 0x7f4dbc071b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.542+0000 7f4dc1835700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc06dc10 con 0x7f4dbc0b33c0 2023-12-07T00:14:36.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.542+0000 7f4dc1835700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc14b910 con 0x7f4dbc14bb40 2023-12-07T00:14:36.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.542+0000 7f4dc1835700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0cdd80 con 0x7f4dbc14b530 2023-12-07T00:14:36.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.543+0000 7f4dbaffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14b530 0x7f4dbc06d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.544 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.543+0000 7f4dbaffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14b530 0x7f4dbc06d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:39974/0 (socket says 172.21.15.179:39974) 2023-12-07T00:14:36.544 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.543+0000 7f4dbaffd700 1 -- 172.21.15.179:0/4247905798 learned_addr learned my addr 172.21.15.179:0/4247905798 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.544 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.544+0000 7f4dbaffd700 1 -- 172.21.15.179:0/4247905798 >> v2:172.21.15.179:3300/0 conn(0x7f4dbc14bb40 msgr2=0x7f4dbc071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.544 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.544+0000 7f4dbaffd700 1 --2- 172.21.15.179:0/4247905798 >> v2:172.21.15.179:3300/0 conn(0x7f4dbc14bb40 0x7f4dbc071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.544 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.544+0000 7f4dbaffd700 1 -- 172.21.15.179:0/4247905798 >> v1:172.21.15.179:6789/0 conn(0x7f4dbc0b33c0 legacy=0x7f4dbc0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.544+0000 7f4dbaffd700 1 -- 172.21.15.179:0/4247905798 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc0ce060 con 0x7f4dbc14b530 2023-12-07T00:14:36.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.545+0000 7f4dbaffd700 1 --2- 172.21.15.179:0/4247905798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14b530 0x7f4dbc06d6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009e50 tx=0x7f4db400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b7d5eb8f9baf7a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.545 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.545+0000 7f4db9ffb700 1 -- 172.21.15.179:0/4247905798 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400e070 con 0x7f4dbc14b530 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.545+0000 7f4db9ffb700 1 -- 172.21.15.179:0/4247905798 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4003a20 con 0x7f4dbc14b530 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.545+0000 7f4db9ffb700 1 -- 172.21.15.179:0/4247905798 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4003dd0 con 0x7f4dbc14b530 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.546+0000 7f4dc1835700 1 -- 172.21.15.179:0/4247905798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14b530 msgr2=0x7f4dbc06d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.546+0000 7f4dc1835700 1 --2- 172.21.15.179:0/4247905798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14b530 0x7f4dbc06d6d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009e50 tx=0x7f4db400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.547+0000 7f4dc1835700 1 -- 172.21.15.179:0/4247905798 shutdown_connections 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.547+0000 7f4dc1835700 1 --2- 172.21.15.179:0/4247905798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14b530 0x7f4dbc06d6d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.547+0000 7f4dc1835700 1 --2- 172.21.15.179:0/4247905798 >> v2:172.21.15.179:3300/0 conn(0x7f4dbc14bb40 0x7f4dbc071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.547+0000 7f4dc1835700 1 -- 172.21.15.179:0/4247905798 >> 172.21.15.179:0/4247905798 conn(0x7f4dbc06af70 msgr2=0x7f4dbc06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.546 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.547+0000 7f4dc1835700 1 -- 172.21.15.179:0/4247905798 shutdown_connections 2023-12-07T00:14:36.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.547+0000 7f4dc1835700 1 -- 172.21.15.179:0/4247905798 wait complete. 2023-12-07T00:14:36.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.549+0000 7f4dc1835700 1 Processor -- start 2023-12-07T00:14:36.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.547+0000 7fe080b0c700 1 Processor -- start 2023-12-07T00:14:36.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.547+0000 7fe080b0c700 1 -- start start 2023-12-07T00:14:36.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.549+0000 7fe080b0c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe07c0722a0 0x7fe07c0b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.549+0000 7fe080b0c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c0b49a0 0x7fe07c0b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.549+0000 7fe080b0c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c06d7e0 con 0x7fe07c14ba10 2023-12-07T00:14:36.549 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.549+0000 7fe080b0c700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c06e420 con 0x7fe07c0722a0 2023-12-07T00:14:36.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.549+0000 7fe080b0c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c06da80 con 0x7fe07c0b49a0 2023-12-07T00:14:36.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.549+0000 7fe07a59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe07c14ba10 0x7fe07c071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46468/0 (socket says 172.21.15.179:46468) 2023-12-07T00:14:36.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.549+0000 7fe07a59c700 1 -- 172.21.15.179:0/2955345543 learned_addr learned my addr 172.21.15.179:0/2955345543 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:36.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.550+0000 7fe07ad9d700 1 --2- 172.21.15.179:0/2955345543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c0b49a0 0x7fe07c0b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.550 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.550+0000 7f4dc1835700 1 -- start start 2023-12-07T00:14:36.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.550+0000 7fe079d9b700 1 --2- 172.21.15.179:0/2955345543 >> v2:172.21.15.179:3300/0 conn(0x7fe07c0722a0 0x7fe07c0b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7fe07ad9d700 1 -- 172.21.15.179:0/2955345543 >> v2:172.21.15.179:3300/0 conn(0x7fe07c0722a0 msgr2=0x7fe07c0b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7fe07ad9d700 1 --2- 172.21.15.179:0/2955345543 >> v2:172.21.15.179:3300/0 conn(0x7fe07c0722a0 0x7fe07c0b4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7fe07ad9d700 1 -- 172.21.15.179:0/2955345543 >> v1:172.21.15.179:6789/0 conn(0x7fe07c14ba10 legacy=0x7fe07c071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7fe07ad9d700 1 -- 172.21.15.179:0/2955345543 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c06dd60 con 0x7fe07c0b49a0 2023-12-07T00:14:36.551 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7fe07ad9d700 1 --2- 172.21.15.179:0/2955345543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c0b49a0 0x7fe07c0b2a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009840 tx=0x7fe06c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f1a93c8976336f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7f4dc1835700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dbc0b33c0 0x7f4dbc1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7f4dc1835700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc14b530 0x7f4dbc1390f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7f4dc1835700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14bb40 0x7f4dbc130100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7f4dc1835700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc148c20 con 0x7f4dbc14b530 2023-12-07T00:14:36.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7f4dc1835700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc1627e0 con 0x7f4dbc0b33c0 2023-12-07T00:14:36.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.551+0000 7f4dc1835700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc162a80 con 0x7f4dbc14bb40 2023-12-07T00:14:36.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbaffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dbc0b33c0 0x7f4dbc1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.552 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7fe07959a700 1 -- 172.21.15.179:0/2955345543 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c004230 con 0x7fe07c0b49a0 2023-12-07T00:14:36.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7fe07959a700 1 -- 172.21.15.179:0/2955345543 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c004390 con 0x7fe07c0b49a0 2023-12-07T00:14:36.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7fe07959a700 1 -- 172.21.15.179:0/2955345543 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0036a0 con 0x7fe07c0b49a0 2023-12-07T00:14:36.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbaffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dbc0b33c0 0x7f4dbc1486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41826/0 (socket says 172.21.15.179:41826) 2023-12-07T00:14:36.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbaffd700 1 -- 172.21.15.179:0/2425622402 learned_addr learned my addr 172.21.15.179:0/2425622402 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbb7fe700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14bb40 0x7f4dbc130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dba7fc700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc14b530 0x7f4dbc1390f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbb7fe700 1 -- 172.21.15.179:0/2425622402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dbc0b33c0 msgr2=0x7f4dbc1486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbb7fe700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dbc0b33c0 0x7f4dbc1486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbb7fe700 1 -- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc14b530 msgr2=0x7f4dbc1390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbb7fe700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc14b530 0x7f4dbc1390f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.552+0000 7f4dbb7fe700 1 -- 172.21.15.179:0/2425622402 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009b30 con 0x7f4dbc14bb40 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.553+0000 7f4dbb7fe700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14bb40 0x7f4dbc130100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00b410 tx=0x7f4dac00b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.554+0000 7fe080b0c700 1 -- 172.21.15.179:0/2955345543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c0b49a0 msgr2=0x7fe07c0b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.554+0000 7fe080b0c700 1 --2- 172.21.15.179:0/2955345543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c0b49a0 0x7fe07c0b2a40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe06c009840 tx=0x7fe06c009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:36.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.553+0000 7f4da3fff700 1 -- 172.21.15.179:0/2425622402 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac011830 con 0x7f4dbc14bb40 2023-12-07T00:14:36.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.553+0000 7f4da3fff700 1 -- 172.21.15.179:0/2425622402 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac0119b0 con 0x7f4dbc14bb40 2023-12-07T00:14:36.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.553+0000 7f4da3fff700 1 -- 172.21.15.179:0/2425622402 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac011d60 con 0x7f4dbc14bb40 2023-12-07T00:14:36.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.553+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc162d60 con 0x7f4dbc14bb40 2023-12-07T00:14:36.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.553+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc12fbe0 con 0x7f4dbc14bb40 2023-12-07T00:14:36.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.554+0000 7fe080b0c700 1 -- 172.21.15.179:0/2955345543 shutdown_connections 2023-12-07T00:14:36.555 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.555+0000 7fe080b0c700 1 --2- 172.21.15.179:0/2955345543 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c0b49a0 0x7fe07c0b2a40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.555+0000 7fe080b0c700 1 --2- 172.21.15.179:0/2955345543 >> v2:172.21.15.179:3300/0 conn(0x7fe07c0722a0 0x7fe07c0b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.555+0000 7fe080b0c700 1 -- 172.21.15.179:0/2955345543 >> 172.21.15.179:0/2955345543 conn(0x7fe07c06b150 msgr2=0x7fe07c06b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.555+0000 7fe080b0c700 1 -- 172.21.15.179:0/2955345543 shutdown_connections 2023-12-07T00:14:36.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.555+0000 7fe080b0c700 1 -- 172.21.15.179:0/2955345543 wait complete. 2023-12-07T00:14:36.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.557+0000 7fe080b0c700 1 Processor -- start 2023-12-07T00:14:36.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.557+0000 7fe080b0c700 1 -- start start 2023-12-07T00:14:36.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.558+0000 7fe080b0c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe07c0722a0 0x7fe07c165390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.558+0000 7fe080b0c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe07c0b49a0 0x7fe07c163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.558+0000 7fe080b0c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c14ba10 0x7fe07c0ce880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.558+0000 7fe080b0c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c15fa40 con 0x7fe07c0b49a0 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.558+0000 7fe080b0c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c139a40 con 0x7fe07c0722a0 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.558+0000 7fe080b0c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c138ec0 con 0x7fe07c14ba10 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe079d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe07c0b49a0 0x7fe07c163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe079d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe07c0b49a0 0x7fe07c163790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39580/0 (socket says 172.21.15.179:39580) 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe079d9b700 1 -- 172.21.15.179:0/3613223907 learned_addr learned my addr 172.21.15.179:0/3613223907 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe07ad9d700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c14ba10 0x7fe07c0ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe07ad9d700 1 -- 172.21.15.179:0/3613223907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe07c0722a0 msgr2=0x7fe07c165390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe07ad9d700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe07c0722a0 0x7fe07c165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe07ad9d700 1 -- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe07c0b49a0 msgr2=0x7fe07c163790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe07ad9d700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe07c0b49a0 0x7fe07c163790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe07ad9d700 1 -- 172.21.15.179:0/3613223907 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c0094a0 con 0x7fe07c14ba10 2023-12-07T00:14:36.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.559+0000 7fe079d9b700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe07c0b49a0 0x7fe07c163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:36.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.560+0000 7fe07ad9d700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c14ba10 0x7fe07c0ce880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe06c015000 tx=0x7fe06c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.560+0000 7fe06affd700 1 -- 172.21.15.179:0/3613223907 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c003c80 con 0x7fe07c14ba10 2023-12-07T00:14:36.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.560+0000 7fe06affd700 1 -- 172.21.15.179:0/3613223907 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c020070 con 0x7fe07c14ba10 2023-12-07T00:14:36.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.560+0000 7fe06affd700 1 -- 172.21.15.179:0/3613223907 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c011630 con 0x7fe07c14ba10 2023-12-07T00:14:36.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.561+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c1391a0 con 0x7fe07c14ba10 2023-12-07T00:14:36.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.561+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c139760 con 0x7fe07c14ba10 2023-12-07T00:14:36.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.564+0000 7fe06affd700 1 -- 172.21.15.179:0/3613223907 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe06c022030 con 0x7fe07c14ba10 2023-12-07T00:14:36.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.564+0000 7fe06affd700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe05c06afa0 0x7fe05c06d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.565+0000 7fe06affd700 1 -- 172.21.15.179:0/3613223907 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe06c08afd0 con 0x7fe07c14ba10 2023-12-07T00:14:36.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.560+0000 7f4da3fff700 1 -- 172.21.15.179:0/2425622402 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4dac01a400 con 0x7f4dbc14bb40 2023-12-07T00:14:36.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.560+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d9c0052e0 con 0x7f4dbc14bb40 2023-12-07T00:14:36.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.561+0000 7f4da3fff700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4da806af20 0x7f4da806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.561+0000 7f4da3fff700 1 -- 172.21.15.179:0/2425622402 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4dac089530 con 0x7f4dbc14bb40 2023-12-07T00:14:36.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.564+0000 7f4dbaffd700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4da806af20 0x7f4da806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.565+0000 7f4dbaffd700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4da806af20 0x7f4da806d3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4db400b370 tx=0x7f4db4009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.565+0000 7fe07a59c700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe05c06afa0 0x7fe05c06d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.566+0000 7fe07a59c700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe05c06afa0 0x7fe05c06d460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe0740012e0 tx=0x7fe074001780 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.567+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0600052e0 con 0x7fe07c14ba10 2023-12-07T00:14:36.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.567+0000 7f4da3fff700 1 -- 172.21.15.179:0/2425622402 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4dac054460 con 0x7f4dbc14bb40 2023-12-07T00:14:36.571 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.572+0000 7fe06affd700 1 -- 172.21.15.179:0/3613223907 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe06c055e00 con 0x7fe07c14ba10 2023-12-07T00:14:36.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.598+0000 7f709e53e700 1 Processor -- start 2023-12-07T00:14:36.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.598+0000 7f709e53e700 1 -- start start 2023-12-07T00:14:36.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.599+0000 7f709e53e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f709806ba90 0x7f7098143540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.599+0000 7f709e53e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709806e4f0 con 0x7f709815a260 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.599+0000 7f709e53e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70980ce000 con 0x7f70980b2f80 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.599+0000 7f709e53e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709815a770 con 0x7f709806ba90 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.600+0000 7f70977fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f709806ba90 0x7f7098143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.600+0000 7f70977fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f709806ba90 0x7f7098143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41840/0 (socket says 172.21.15.179:41840) 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.600+0000 7f70977fe700 1 -- 172.21.15.179:0/2643627846 learned_addr learned my addr 172.21.15.179:0/2643627846 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.600+0000 7f70977fe700 1 -- 172.21.15.179:0/2643627846 >> v1:172.21.15.190:6789/0 conn(0x7f70980b2f80 legacy=0x7f709806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.600+0000 7f70977fe700 1 -- 172.21.15.179:0/2643627846 >> v1:172.21.15.179:6789/0 conn(0x7f709815a260 legacy=0x7f709806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.600+0000 7f70977fe700 1 -- 172.21.15.179:0/2643627846 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709815aa50 con 0x7f709806ba90 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.601+0000 7f70977fe700 1 --2- 172.21.15.179:0/2643627846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709806ba90 0x7f7098143540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f708800bb90 tx=0x7f708800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f96fb372432c912 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.601+0000 7f7096ffd700 1 -- 172.21.15.179:0/2643627846 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708800dc00 con 0x7f709806ba90 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.601+0000 7f7096ffd700 1 -- 172.21.15.179:0/2643627846 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708800dd60 con 0x7f709806ba90 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.601+0000 7f7096ffd700 1 -- 172.21.15.179:0/2643627846 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088004270 con 0x7f709806ba90 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.602+0000 7f709e53e700 1 -- 172.21.15.179:0/2643627846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709806ba90 msgr2=0x7f7098143540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.602+0000 7f709e53e700 1 --2- 172.21.15.179:0/2643627846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709806ba90 0x7f7098143540 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f708800bb90 tx=0x7f708800bea0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.602+0000 7f709e53e700 1 -- 172.21.15.179:0/2643627846 shutdown_connections 2023-12-07T00:14:36.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.602+0000 7f709e53e700 1 --2- 172.21.15.179:0/2643627846 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f709806ba90 0x7f7098143540 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.602+0000 7f709e53e700 1 -- 172.21.15.179:0/2643627846 >> 172.21.15.179:0/2643627846 conn(0x7f709806af70 msgr2=0x7f709806b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.602+0000 7f709e53e700 1 -- 172.21.15.179:0/2643627846 shutdown_connections 2023-12-07T00:14:36.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.602+0000 7f709e53e700 1 -- 172.21.15.179:0/2643627846 wait complete. 2023-12-07T00:14:36.606 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.604+0000 7f709e53e700 1 Processor -- start 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.604+0000 7f709e53e700 1 -- start start 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709e53e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f709806ba90 0x7f7098135dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709e53e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70980b2f80 0x7f70980721d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709e53e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f709815a260 0x7f7098155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709e53e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7098154e60 con 0x7f709815a260 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709e53e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70981548a0 con 0x7f70980b2f80 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709e53e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7098154b80 con 0x7f709806ba90 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f70977fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70980b2f80 0x7f70980721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709cadb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f709815a260 0x7f7098155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709cadb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f709815a260 0x7f7098155640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39594/0 (socket says 172.21.15.179:39594) 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.606+0000 7f709cadb700 1 -- 172.21.15.179:0/2209617095 learned_addr learned my addr 172.21.15.179:0/2209617095 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f7097fff700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f709806ba90 0x7f7098135dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f709cadb700 1 -- 172.21.15.179:0/2209617095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f709806ba90 msgr2=0x7f7098135dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f709cadb700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f709806ba90 0x7f7098135dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.607 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f709cadb700 1 -- 172.21.15.179:0/2209617095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70980b2f80 msgr2=0x7f70980721d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f709cadb700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70980b2f80 0x7f70980721d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f709cadb700 1 -- 172.21.15.179:0/2209617095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708800b7f0 con 0x7f709815a260 2023-12-07T00:14:36.608 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.608+0000 7fd1e3c65700 1 Processor -- start 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7fd1e3c65700 1 -- start start 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7fd1e3c65700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1dc099a40 0x7fd1dc0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7fd1e3c65700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc162880 con 0x7fd1dc1624a0 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7fd1e3c65700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc06bbe0 con 0x7fd1dc0b3c50 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7fd1e3c65700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0d0fa0 con 0x7fd1dc099a40 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f709cadb700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f709815a260 0x7f7098155640 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f709000b990 tx=0x7f709000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f7094ff9700 1 -- 172.21.15.179:0/2209617095 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709000c930 con 0x7f709815a260 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f7094ff9700 1 -- 172.21.15.179:0/2209617095 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709000ca90 con 0x7f709815a260 2023-12-07T00:14:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f7094ff9700 1 -- 172.21.15.179:0/2209617095 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709000ce40 con 0x7f709815a260 2023-12-07T00:14:36.610 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7fd1e1200700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd1dc0b3c50 0x7fd1dc0ad040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:53184/0 (socket says 172.21.15.179:53184) 2023-12-07T00:14:36.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7fd1e1200700 1 -- 172.21.15.179:0/773541230 learned_addr learned my addr 172.21.15.179:0/773541230 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:36.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e2202700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1dc099a40 0x7fd1dc0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946690776 0 0) 0x7fd1dc06bbe0 con 0x7fd1dc0b3c50 2023-12-07T00:14:36.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c80035b0 con 0x7fd1dc0b3c50 2023-12-07T00:14:36.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70981507a0 con 0x7f709815a260 2023-12-07T00:14:36.611 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7098157710 con 0x7f709815a260 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2737246576 0 0) 0x7fd1c80035b0 con 0x7fd1dc0b3c50 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1dc099a40 msgr2=0x7fd1dc0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1dc099a40 0x7fd1dc0afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 >> v1:172.21.15.179:6789/0 conn(0x7fd1dc1624a0 legacy=0x7fd1dc06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc099ef0 con 0x7fd1dc0b3c50 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fd1d80016b0 con 0x7fd1dc0b3c50 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 >> v1:172.21.15.190:6789/0 conn(0x7fd1dc0b3c50 legacy=0x7fd1dc0ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8003a00 0x7fd1c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1c8004850 0x7fd1c8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1c8005210 0x7fd1c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0d0fa0 con 0x7fd1c8003a00 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800c030 con 0x7fd1c8004850 2023-12-07T00:14:36.612 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c800c1f0 con 0x7fd1c8005210 2023-12-07T00:14:36.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f5365bc9700 1 Processor -- start 2023-12-07T00:14:36.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.607+0000 7f5365bc9700 1 -- start start 2023-12-07T00:14:36.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f5365bc9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360072240 0x7f53600ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f5365bc9700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536014b910 con 0x7f536014bb40 2023-12-07T00:14:36.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f5365bc9700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53600cdd80 con 0x7f536014b530 2023-12-07T00:14:36.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f5365bc9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53600ce060 con 0x7f5360072240 2023-12-07T00:14:36.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f535f7fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f536014b530 0x7f536006d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:53180/0 (socket says 172.21.15.179:53180) 2023-12-07T00:14:36.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.609+0000 7f535f7fe700 1 -- 172.21.15.179:0/3732209126 learned_addr learned my addr 172.21.15.179:0/3732209126 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856735941 0 0) 0x7f536014b910 con 0x7f536014bb40 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f534c0035b0 con 0x7f536014bb40 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2780541593 0 0) 0x7f534c0035b0 con 0x7f536014bb40 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360072240 msgr2=0x7f53600ceb40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360072240 0x7f53600ceb40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 >> v1:172.21.15.190:6789/0 conn(0x7f536014b530 legacy=0x7f536006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600ce340 con 0x7f536014bb40 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f5348001670 con 0x7f536014bb40 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 >> v1:172.21.15.179:6789/0 conn(0x7f536014bb40 legacy=0x7f5360071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f534c003a30 0x7f534c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f534c004850 0x7f534c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f534c0052e0 0x7f534c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600ce060 con 0x7f534c0052e0 2023-12-07T00:14:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.610+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c02e210 con 0x7f534c004850 2023-12-07T00:14:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c02e3d0 con 0x7f534c003a30 2023-12-07T00:14:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7f5356ffd700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f534c004850 0x7f534c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7f535f7fe700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f534c003a30 0x7f534c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.611+0000 7fd1e1200700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1c8004850 0x7fd1c8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7fd1e1a01700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8003a00 0x7fd1c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7f5356ffd700 1 -- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f534c003a30 msgr2=0x7f534c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7f5356ffd700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f534c003a30 0x7f534c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7f5356ffd700 1 -- 172.21.15.179:0/3732209126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f534c0052e0 msgr2=0x7f534c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7f5356ffd700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f534c0052e0 0x7f534c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7f5356ffd700 1 -- 172.21.15.179:0/3732209126 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c0035b0 con 0x7f534c004850 2023-12-07T00:14:36.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.612+0000 7f5356ffd700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f534c004850 0x7f534c004cd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5348007fc0 tx=0x7f534c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c381f2ee05acc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534800cc50 con 0x7f534c004850 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534800cdb0 con 0x7f534c004850 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7f535effd700 1 -- 172.21.15.179:0/3732209126 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5348012660 con 0x7f534c004850 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7fd1e2202700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1c8005210 0x7fd1c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7fd1e1200700 1 -- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1c8005210 msgr2=0x7fd1c800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7fd1e1200700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1c8005210 0x7fd1c800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7fd1e1200700 1 -- 172.21.15.179:0/773541230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8003a00 msgr2=0x7fd1c8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7fd1e1200700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8003a00 0x7fd1c8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7fd1e1200700 1 -- 172.21.15.179:0/773541230 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc099ef0 con 0x7fd1c8004850 2023-12-07T00:14:36.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7fd1e1200700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1c8004850 0x7fd1c8004cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c2f0 tx=0x7fd1c8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b78abaa10baf127 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7f5365bc9700 1 -- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f534c004850 msgr2=0x7f534c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7f5365bc9700 1 --2- 172.21.15.179:0/3732209126 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f534c004850 0x7f534c004cd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5348007fc0 tx=0x7f534c005880 comp rx=0 tx=0).stop 2023-12-07T00:14:36.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7f535ffff700 1 -- 172.21.15.179:0/3732209126 reap_dead start 2023-12-07T00:14:36.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7f5365bc9700 1 -- 172.21.15.179:0/3732209126 shutdown_connections 2023-12-07T00:14:36.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7f5365bc9700 1 -- 172.21.15.179:0/3732209126 >> 172.21.15.179:0/3732209126 conn(0x7f536006af70 msgr2=0x7f536006b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d800cdf0 con 0x7fd1c8004850 2023-12-07T00:14:36.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d8005960 con 0x7fd1c8004850 2023-12-07T00:14:36.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7fd1e09ff700 1 -- 172.21.15.179:0/773541230 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8005d10 con 0x7fd1c8004850 2023-12-07T00:14:36.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7f5365bc9700 1 -- 172.21.15.179:0/3732209126 shutdown_connections 2023-12-07T00:14:36.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7f7094ff9700 1 -- 172.21.15.179:0/2209617095 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7090006d50 con 0x7f709815a260 2023-12-07T00:14:36.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.614+0000 7f5365bc9700 1 -- 172.21.15.179:0/3732209126 wait complete. 2023-12-07T00:14:36.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7f7094ff9700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f708406af20 0x7f708406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7f7094ff9700 1 -- 172.21.15.179:0/2209617095 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7090089320 con 0x7f709815a260 2023-12-07T00:14:36.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7fd1e3c65700 1 -- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1c8004850 msgr2=0x7fd1c8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7fd1e3c65700 1 --2- 172.21.15.179:0/773541230 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1c8004850 0x7fd1c8004cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c2f0 tx=0x7fd1c8005880 comp rx=0 tx=0).stop 2023-12-07T00:14:36.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7fd1e2202700 1 -- 172.21.15.179:0/773541230 reap_dead start 2023-12-07T00:14:36.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7fd1e3c65700 1 -- 172.21.15.179:0/773541230 shutdown_connections 2023-12-07T00:14:36.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7fd1e3c65700 1 -- 172.21.15.179:0/773541230 >> 172.21.15.179:0/773541230 conn(0x7fd1dc072660 msgr2=0x7fd1dc0b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7fd1e3c65700 1 -- 172.21.15.179:0/773541230 shutdown_connections 2023-12-07T00:14:36.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7f5365bc9700 1 Processor -- start 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7f5365bc9700 1 -- start start 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f5365bc9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53601601b0 0x7f536013fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f5365bc9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360160590 0x7f536014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f5365bc9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5360160990 0x7f5360160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f5365bc9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360161380 con 0x7f53601601b0 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f5365bc9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5360140390 con 0x7f5360160990 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f5365bc9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536013edb0 con 0x7f5360160590 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f535f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53601601b0 0x7f536013fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f535f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53601601b0 0x7f536013fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39632/0 (socket says 172.21.15.179:39632) 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f535f7fe700 1 -- 172.21.15.179:0/1753191759 learned_addr learned my addr 172.21.15.179:0/1753191759 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f5356ffd700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360160590 0x7f536014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7fd1e3c65700 1 -- 172.21.15.179:0/773541230 wait complete. 2023-12-07T00:14:36.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7fd1e3c65700 1 Processor -- start 2023-12-07T00:14:36.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.618+0000 7fd1e3c65700 1 -- start start 2023-12-07T00:14:36.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.618+0000 7f535f7fe700 1 -- 172.21.15.179:0/1753191759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360160590 msgr2=0x7f536014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.618+0000 7f535f7fe700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360160590 0x7f536014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.618+0000 7f535f7fe700 1 -- 172.21.15.179:0/1753191759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5360160990 msgr2=0x7f5360160e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T00:14:36.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.618+0000 7f535f7fe700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5360160990 0x7f5360160e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.618+0000 7f535f7fe700 1 -- 172.21.15.179:0/1753191759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536013f090 con 0x7f53601601b0 2023-12-07T00:14:36.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.618+0000 7f5356ffd700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360160590 0x7f536014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:36.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.618+0000 7f535f7fe700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53601601b0 0x7f536013fe50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f535000f4b0 tx=0x7f535000f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e3c65700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8004850 0x7fd1dc1f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e3c65700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1dc14cf10 0x7fd1dc162e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e3c65700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1dc1633b0 0x7fd1dc163830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e3c65700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc1f7910 con 0x7fd1c8004850 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e3c65700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc15ac20 con 0x7fd1dc14cf10 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e3c65700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc15af00 con 0x7fd1dc1633b0 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1a01700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8004850 0x7fd1dc1f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1a01700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8004850 0x7fd1dc1f73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39636/0 (socket says 172.21.15.179:39636) 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1a01700 1 -- 172.21.15.179:0/1285793290 learned_addr learned my addr 172.21.15.179:0/1285793290 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1200700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1dc14cf10 0x7fd1dc162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1a01700 1 -- 172.21.15.179:0/1285793290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1dc1633b0 msgr2=0x7fd1dc163830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1a01700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1dc1633b0 0x7fd1dc163830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1a01700 1 -- 172.21.15.179:0/1285793290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1dc14cf10 msgr2=0x7fd1dc162e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1a01700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1dc14cf10 0x7fd1dc162e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7098067ee0 con 0x7f709815a260 2023-12-07T00:14:36.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.619+0000 7fd1e1a01700 1 -- 172.21.15.179:0/1285793290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc15d040 con 0x7fd1c8004850 2023-12-07T00:14:36.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.620+0000 7fd1e1a01700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8004850 0x7fd1dc1f73d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000f820 tx=0x7fd1d000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.620+0000 7f535cff9700 1 -- 172.21.15.179:0/1753191759 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350012350 con 0x7f53601601b0 2023-12-07T00:14:36.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.620+0000 7f535cff9700 1 -- 172.21.15.179:0/1753191759 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53500124b0 con 0x7f53601601b0 2023-12-07T00:14:36.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.620+0000 7f535cff9700 1 -- 172.21.15.179:0/1753191759 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5350012860 con 0x7f53601601b0 2023-12-07T00:14:36.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.613+0000 7f42cbd32700 1 Processor -- start 2023-12-07T00:14:36.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.615+0000 7f42cbd32700 1 -- start start 2023-12-07T00:14:36.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7f42cbd32700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42c4161910 0x7f42c40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7f42cbd32700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c416ef70 con 0x7f42c416bb90 2023-12-07T00:14:36.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7f42cbd32700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c416f400 con 0x7f42c4072060 2023-12-07T00:14:36.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7f42cbd32700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40b4ef0 con 0x7f42c4161910 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7f42c9ace700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42c4161910 0x7f42c40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.616+0000 7f42c9ace700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42c4161910 0x7f42c40b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39624/0 (socket says 172.21.15.179:39624) 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.617+0000 7f42c9ace700 1 -- 172.21.15.179:0/4119713401 learned_addr learned my addr 172.21.15.179:0/4119713401 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.620+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773006939 0 0) 0x7f42c416ef70 con 0x7f42c416bb90 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.620+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42b0003590 con 0x7f42c416bb90 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.620+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906652448 0 0) 0x7f42c416f400 con 0x7f42c4072060 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.620+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42c416ef70 con 0x7f42c4072060 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280203939 0 0) 0x7f42c416ef70 con 0x7f42c4072060 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 >> v2:172.21.15.179:3300/0 conn(0x7f42c4161910 msgr2=0x7f42c40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 --2- 172.21.15.179:0/4119713401 >> v2:172.21.15.179:3300/0 conn(0x7f42c4161910 0x7f42c40b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 >> v1:172.21.15.179:6789/0 conn(0x7f42c416bb90 legacy=0x7f42c4071950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c416e640 con 0x7f42c4072060 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f42bc0018a0 con 0x7f42c4072060 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 >> v1:172.21.15.190:6789/0 conn(0x7f42c4072060 legacy=0x7f42c40cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b0003d60 0x7f42b0004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b00046a0 0x7f42b000d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b000d9e0 0x7f42b000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40b4ef0 con 0x7f42b000d9e0 2023-12-07T00:14:36.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b0010640 con 0x7f42b0003d60 2023-12-07T00:14:36.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b0010800 con 0x7f42b00046a0 2023-12-07T00:14:36.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c9ace700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b0003d60 0x7f42b0004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42ca2cf700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b000d9e0 0x7f42b000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.621+0000 7f42c92cd700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b00046a0 0x7f42b000d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f42ca2cf700 1 -- 172.21.15.179:0/4119713401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b00046a0 msgr2=0x7f42b000d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f42ca2cf700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b00046a0 0x7f42b000d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f42ca2cf700 1 -- 172.21.15.179:0/4119713401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b0003d60 msgr2=0x7f42b0004160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f42ca2cf700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42b0003d60 0x7f42b0004160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f42ca2cf700 1 -- 172.21.15.179:0/4119713401 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c416e640 con 0x7f42b000d9e0 2023-12-07T00:14:36.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f7097fff700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f708406af20 0x7f708406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f42ca2cf700 1 -- 172.21.15.179:0/4119713401 reap_dead start 2023-12-07T00:14:36.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f42ca2cf700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b000d9e0 0x7f42b000fdd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00a740 tx=0x7f42b0004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b6377f9b172d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536013f370 con 0x7f53601601b0 2023-12-07T00:14:36.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536013f930 con 0x7f53601601b0 2023-12-07T00:14:36.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.622+0000 7f7097fff700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f708406af20 0x7f708406d3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f708c000f60 tx=0x7f708c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.623+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536013fb20 con 0x7f53601601b0 2023-12-07T00:14:36.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.626+0000 7f3242621700 1 Processor -- start 2023-12-07T00:14:36.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.626+0000 7f3242621700 1 -- start start 2023-12-07T00:14:36.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3242621700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c15de40 0x7f323c0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3242621700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f323c0b2c70 0x7f323c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3242621700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c15f330 con 0x7f323c15e220 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3242621700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c0d1820 con 0x7f323c0b2c70 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3242621700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c15e720 con 0x7f323c15de40 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f323b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f323c15e220 0x7f323c0b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46552/0 (socket says 172.21.15.179:46552) 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f323b7fe700 1 -- 172.21.15.179:0/2838980518 learned_addr learned my addr 172.21.15.179:0/2838980518 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f323bfff700 1 --2- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c15de40 0x7f323c0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3240bbe700 1 --2- 172.21.15.179:0/2838980518 >> v2:172.21.15.190:3300/0 conn(0x7f323c0b2c70 0x7f323c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3240bbe700 1 -- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c15de40 msgr2=0x7f323c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3240bbe700 1 --2- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c15de40 0x7f323c0b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3240bbe700 1 -- 172.21.15.179:0/2838980518 >> v1:172.21.15.179:6789/0 conn(0x7f323c15e220 legacy=0x7f323c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.627+0000 7f3240bbe700 1 -- 172.21.15.179:0/2838980518 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c15ea00 con 0x7f323c0b2c70 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.628+0000 7f323bfff700 1 --2- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c15de40 0x7f323c0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.628+0000 7f3240bbe700 1 --2- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c0b2c70 0x7f323c15f870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3234009d90 tx=0x7f323400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=782336d4bf3eddc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.628+0000 7f323affd700 1 -- 172.21.15.179:0/2838980518 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323400e070 con 0x7f323c0b2c70 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.628+0000 7f323affd700 1 -- 172.21.15.179:0/2838980518 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323400bb20 con 0x7f323c0b2c70 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.628+0000 7f323affd700 1 -- 172.21.15.179:0/2838980518 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234012430 con 0x7f323c0b2c70 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.628+0000 7f3242621700 1 -- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c0b2c70 msgr2=0x7f323c15f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.628+0000 7f3242621700 1 --2- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c0b2c70 0x7f323c15f870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3234009d90 tx=0x7f323400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.629+0000 7f3242621700 1 -- 172.21.15.179:0/2838980518 shutdown_connections 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.629+0000 7f3242621700 1 --2- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c0b2c70 0x7f323c15f870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.629+0000 7f3242621700 1 --2- 172.21.15.179:0/2838980518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c15de40 0x7f323c0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.629+0000 7f3242621700 1 -- 172.21.15.179:0/2838980518 >> 172.21.15.179:0/2838980518 conn(0x7f323c072970 msgr2=0x7f323c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.629+0000 7f3242621700 1 -- 172.21.15.179:0/2838980518 shutdown_connections 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.629+0000 7f3242621700 1 -- 172.21.15.179:0/2838980518 wait complete. 2023-12-07T00:14:36.638 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.629+0000 7f7094ff9700 1 -- 172.21.15.179:0/2209617095 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7090054170 con 0x7f709815a260 2023-12-07T00:14:36.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.631+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc016070 con 0x7f42b000d9e0 2023-12-07T00:14:36.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.631+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc012440 con 0x7f42b000d9e0 2023-12-07T00:14:36.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.631+0000 7f42c8acc700 1 -- 172.21.15.179:0/4119713401 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0127f0 con 0x7f42b000d9e0 2023-12-07T00:14:36.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.630+0000 7f3242621700 1 Processor -- start 2023-12-07T00:14:36.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.631+0000 7f535cff9700 1 -- 172.21.15.179:0/1753191759 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53500129c0 con 0x7f53601601b0 2023-12-07T00:14:36.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.631+0000 7f535cff9700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f534006af20 0x7f534006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.631+0000 7f535cff9700 1 -- 172.21.15.179:0/1753191759 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f535008a040 con 0x7f53601601b0 2023-12-07T00:14:36.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.631+0000 7f3242621700 1 -- start start 2023-12-07T00:14:36.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f3242621700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c0b2c70 0x7f323c1e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f3242621700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f323c15de40 0x7f323c0d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f3242621700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c15e220 0x7f323c14a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f3242621700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1e6680 con 0x7f323c15de40 2023-12-07T00:14:36.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f3242621700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1e6960 con 0x7f323c15e220 2023-12-07T00:14:36.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f3242621700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1e6c40 con 0x7f323c0b2c70 2023-12-07T00:14:36.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f42cbd32700 1 -- 172.21.15.179:0/4119713401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b000d9e0 msgr2=0x7f42b000fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f42cbd32700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b000d9e0 0x7f42b000fdd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00a740 tx=0x7f42b0004de0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7fd1ce7fc700 1 -- 172.21.15.179:0/1285793290 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00052e0 con 0x7fd1c8004850 2023-12-07T00:14:36.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7fd1ce7fc700 1 -- 172.21.15.179:0/1285793290 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0005440 con 0x7fd1c8004850 2023-12-07T00:14:36.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7fd1ce7fc700 1 -- 172.21.15.179:0/1285793290 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00038c0 con 0x7fd1c8004850 2023-12-07T00:14:36.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f42cbd32700 1 -- 172.21.15.179:0/4119713401 shutdown_connections 2023-12-07T00:14:36.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f42cbd32700 1 --2- 172.21.15.179:0/4119713401 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42b000d9e0 0x7f42b000fdd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f42cbd32700 1 -- 172.21.15.179:0/4119713401 >> 172.21.15.179:0/4119713401 conn(0x7f42c406af70 msgr2=0x7f42c406b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f42cbd32700 1 -- 172.21.15.179:0/4119713401 shutdown_connections 2023-12-07T00:14:36.643 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.633+0000 7f323bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c0b2c70 0x7f323c1e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.643 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.633+0000 7f5356ffd700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f534006af20 0x7f534006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.643 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.633+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc15d320 con 0x7fd1c8004850 2023-12-07T00:14:36.643 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.633+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc1580f0 con 0x7fd1c8004850 2023-12-07T00:14:36.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.632+0000 7f42cbd32700 1 -- 172.21.15.179:0/4119713401 wait complete. 2023-12-07T00:14:36.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.634+0000 7f42cbd32700 1 Processor -- start 2023-12-07T00:14:36.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.634+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc15d4b0 con 0x7fd1c8004850 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.634+0000 7f3240bbe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c15e220 0x7f323c14a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.634+0000 7f3240bbe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c15e220 0x7f323c14a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41912/0 (socket says 172.21.15.179:41912) 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.634+0000 7f3240bbe700 1 -- 172.21.15.179:0/3596460657 learned_addr learned my addr 172.21.15.179:0/3596460657 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3240bbe700 1 -- 172.21.15.179:0/3596460657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c0b2c70 msgr2=0x7f323c1e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3240bbe700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c0b2c70 0x7f323c1e7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3240bbe700 1 -- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f323c15de40 msgr2=0x7f323c0d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3240bbe700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f323c15de40 0x7f323c0d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3240bbe700 1 -- 172.21.15.179:0/3596460657 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0094a0 con 0x7f323c15e220 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3240bbe700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c15e220 0x7f323c14a250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3234014040 tx=0x7f3234004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3238ff9700 1 -- 172.21.15.179:0/3596460657 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234012430 con 0x7f323c15e220 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3238ff9700 1 -- 172.21.15.179:0/3596460657 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3234020070 con 0x7f323c15e220 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3234009a70 con 0x7f323c15e220 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c1e7200 con 0x7f323c15e220 2023-12-07T00:14:36.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f3238ff9700 1 -- 172.21.15.179:0/3596460657 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234003ea0 con 0x7f323c15e220 2023-12-07T00:14:36.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.634+0000 7f42cbd32700 1 -- start start 2023-12-07T00:14:36.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f42cbd32700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b000d9e0 0x7f42c4206fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f42cbd32700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42c4205110 0x7f42c415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f42cbd32700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c4205590 0x7f42c415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f42cbd32700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4206c00 con 0x7f42c4205590 2023-12-07T00:14:36.646 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f42cbd32700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4205b60 con 0x7f42c4205110 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.635+0000 7f42cbd32700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4205e40 con 0x7f42b000d9e0 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c92cd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42c4205110 0x7f42c415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c92cd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42c4205110 0x7f42c415e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41914/0 (socket says 172.21.15.179:41914) 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c92cd700 1 -- 172.21.15.179:0/863594610 learned_addr learned my addr 172.21.15.179:0/863594610 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c9ace700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b000d9e0 0x7f42c4206fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42ca2cf700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c4205590 0x7f42c415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c9ace700 1 -- 172.21.15.179:0/863594610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42c4205110 msgr2=0x7f42c415e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c9ace700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42c4205110 0x7f42c415e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c9ace700 1 -- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c4205590 msgr2=0x7f42c415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c9ace700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c4205590 0x7f42c415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.647 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.636+0000 7f42c9ace700 1 -- 172.21.15.179:0/863594610 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4206120 con 0x7f42b000d9e0 2023-12-07T00:14:36.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.637+0000 7f3238ff9700 1 -- 172.21.15.179:0/3596460657 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3234004280 con 0x7f323c15e220 2023-12-07T00:14:36.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.637+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321c0052e0 con 0x7f323c15e220 2023-12-07T00:14:36.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.637+0000 7f3238ff9700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f322806aed0 0x7f322806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.637+0000 7f3238ff9700 1 -- 172.21.15.179:0/3596460657 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3234022070 con 0x7f323c15e220 2023-12-07T00:14:36.648 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.638+0000 7f42c9ace700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b000d9e0 0x7f42c4206fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42c406bd10 tx=0x7f42c00098b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.638+0000 7f42ba7fc700 1 -- 172.21.15.179:0/863594610 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c00147f0 con 0x7f42b000d9e0 2023-12-07T00:14:36.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.638+0000 7f42ba7fc700 1 -- 172.21.15.179:0/863594610 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c000f040 con 0x7f42b000d9e0 2023-12-07T00:14:36.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.638+0000 7f42ba7fc700 1 -- 172.21.15.179:0/863594610 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c0014b90 con 0x7f42b000d9e0 2023-12-07T00:14:36.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.638+0000 7f323bfff700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f322806aed0 0x7f322806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.638+0000 7f323bfff700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f322806aed0 0x7f322806d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f322c009c40 tx=0x7f322c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.639+0000 7f535cff9700 1 -- 172.21.15.179:0/1753191759 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5350054ee0 con 0x7f53601601b0 2023-12-07T00:14:36.650 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.638+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4206400 con 0x7f42b000d9e0 2023-12-07T00:14:36.650 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.638+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c415f420 con 0x7f42b000d9e0 2023-12-07T00:14:36.650 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.639+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4067ee0 con 0x7f42b000d9e0 2023-12-07T00:14:36.650 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.640+0000 7f5356ffd700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f534006af20 0x7f534006d3e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5360069ad0 tx=0x7f5348005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.651 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.641+0000 7f42ba7fc700 1 -- 172.21.15.179:0/863594610 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42c0014cf0 con 0x7f42b000d9e0 2023-12-07T00:14:36.651 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.642+0000 7f42ba7fc700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f42a806aed0 0x7f42a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.651 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.642+0000 7f42ba7fc700 1 -- 172.21.15.179:0/863594610 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42c008a670 con 0x7f42b000d9e0 2023-12-07T00:14:36.651 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.644+0000 7f42c92cd700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f42a806aed0 0x7f42a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.651 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.644+0000 7f42c92cd700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f42a806aed0 0x7f42a806d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42b40055f0 tx=0x7f42b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.641+0000 7fd1ce7fc700 1 -- 172.21.15.179:0/1285793290 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1d0003a20 con 0x7fd1c8004850 2023-12-07T00:14:36.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.641+0000 7fd1ce7fc700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd1c006af20 0x7fd1c006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.642+0000 7fd1ce7fc700 1 -- 172.21.15.179:0/1285793290 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1d0089ea0 con 0x7fd1c8004850 2023-12-07T00:14:36.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.642+0000 7fd1e1200700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd1c006af20 0x7fd1c006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.646+0000 7f3238ff9700 1 -- 172.21.15.179:0/3596460657 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3234056830 con 0x7f323c15e220 2023-12-07T00:14:36.652 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.647+0000 7f42ba7fc700 1 -- 172.21.15.179:0/863594610 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42c00554d0 con 0x7f42b000d9e0 2023-12-07T00:14:36.653 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.649+0000 7fd1ce7fc700 1 -- 172.21.15.179:0/1285793290 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1d0054c40 con 0x7fd1c8004850 2023-12-07T00:14:36.653 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.649+0000 7fd1e1200700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd1c006af20 0x7fd1c006d3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8015040 tx=0x7fd1d8007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.655 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.656+0000 7fabc3d21700 1 Processor -- start 2023-12-07T00:14:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.656+0000 7fabc3d21700 1 -- start start 2023-12-07T00:14:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.657+0000 7fabc3d21700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fabbc0b2f80 0x7fabbc15e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.657+0000 7fabc3d21700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc0ce000 con 0x7fabbc0723d0 2023-12-07T00:14:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.657+0000 7fabc3d21700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc15a770 con 0x7fabbc143540 2023-12-07T00:14:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.657+0000 7fabc3d21700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc143920 con 0x7fabbc0b2f80 2023-12-07T00:14:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.658+0000 7fabc12bc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fabbc0b2f80 0x7fabbc15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.658+0000 7fabc12bc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fabbc0b2f80 0x7fabbc15e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41926/0 (socket says 172.21.15.179:41926) 2023-12-07T00:14:36.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.658+0000 7fabc12bc700 1 -- 172.21.15.179:0/3460910574 learned_addr learned my addr 172.21.15.179:0/3460910574 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947024089 0 0) 0x7fabbc0ce000 con 0x7fabbc0723d0 2023-12-07T00:14:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faba80035b0 con 0x7fabbc0723d0 2023-12-07T00:14:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2476750232 0 0) 0x7faba80035b0 con 0x7fabbc0723d0 2023-12-07T00:14:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 >> v2:172.21.15.190:3300/0 conn(0x7fabbc0b2f80 msgr2=0x7fabbc15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 --2- 172.21.15.179:0/3460910574 >> v2:172.21.15.190:3300/0 conn(0x7fabbc0b2f80 0x7fabbc15e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.658 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 >> v1:172.21.15.190:6789/0 conn(0x7fabbc143540 legacy=0x7fabbc071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc15aa50 con 0x7fabbc0723d0 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fabb8001670 con 0x7fabbc0723d0 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 >> v1:172.21.15.179:6789/0 conn(0x7fabbc0723d0 legacy=0x7fabbc0ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 --2- 172.21.15.179:0/3460910574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba8003a00 0x7faba8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 --2- 172.21.15.179:0/3460910574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faba8004850 0x7faba8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 --2- 172.21.15.179:0/3460910574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba8009a00 0x7faba80052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc143920 con 0x7faba8003a00 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8014960 con 0x7faba8009a00 2023-12-07T00:14:36.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.659+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba8014b20 con 0x7faba8004850 2023-12-07T00:14:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.660+0000 7fabc1abd700 1 --2- 172.21.15.179:0/3460910574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba8003a00 0x7faba8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.660+0000 7fabc1abd700 1 -- 172.21.15.179:0/3460910574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faba8004850 msgr2=0x7faba8004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T00:14:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.660+0000 7fabc1abd700 1 --2- 172.21.15.179:0/3460910574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faba8004850 0x7faba8004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.660+0000 7fabc1abd700 1 -- 172.21.15.179:0/3460910574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba8009a00 msgr2=0x7faba80052c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-07T00:14:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.660+0000 7fabc1abd700 1 --2- 172.21.15.179:0/3460910574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba8009a00 0x7faba80052c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.660+0000 7fabc1abd700 1 -- 172.21.15.179:0/3460910574 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc15aa50 con 0x7faba8003a00 2023-12-07T00:14:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.661+0000 7fabc1abd700 1 --2- 172.21.15.179:0/3460910574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba8003a00 0x7faba8003e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabac003ed0 tx=0x7faba8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504aa26e66b2d866 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.661+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac016070 con 0x7faba8003a00 2023-12-07T00:14:36.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.661+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac006860 con 0x7faba8003a00 2023-12-07T00:14:36.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.661+0000 7fabc0abb700 1 -- 172.21.15.179:0/3460910574 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac006c10 con 0x7faba8003a00 2023-12-07T00:14:36.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.662+0000 7fabc3d21700 1 -- 172.21.15.179:0/3460910574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba8003a00 msgr2=0x7faba8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.662+0000 7fabc3d21700 1 --2- 172.21.15.179:0/3460910574 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faba8003a00 0x7faba8003e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabac003ed0 tx=0x7faba8005880 comp rx=0 tx=0).stop 2023-12-07T00:14:36.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.662+0000 7fabc22be700 1 -- 172.21.15.179:0/3460910574 reap_dead start 2023-12-07T00:14:36.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.662+0000 7fabc22be700 1 -- 172.21.15.179:0/3460910574 reap_dead start 2023-12-07T00:14:36.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.663+0000 7fabc3d21700 1 -- 172.21.15.179:0/3460910574 shutdown_connections 2023-12-07T00:14:36.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.663+0000 7fabc3d21700 1 -- 172.21.15.179:0/3460910574 >> 172.21.15.179:0/3460910574 conn(0x7fabbc06af70 msgr2=0x7fabbc06b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.664+0000 7fabc3d21700 1 -- 172.21.15.179:0/3460910574 shutdown_connections 2023-12-07T00:14:36.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.664+0000 7fabc3d21700 1 -- 172.21.15.179:0/3460910574 wait complete. 2023-12-07T00:14:36.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.666+0000 7fabc3d21700 1 Processor -- start 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.666+0000 7fabc3d21700 1 -- start start 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.667+0000 7fabc3d21700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba8003a00 0x7fabbc1325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.667+0000 7fabc3d21700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabbc06d6d0 0x7fabbc06db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.667+0000 7fabc3d21700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc12fbc0 0x7fabbc130070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.667+0000 7fabc3d21700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc06e090 con 0x7fabbc12fbc0 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.667+0000 7fabc3d21700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc142210 con 0x7faba8003a00 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.667+0000 7fabc3d21700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc140be0 con 0x7fabbc06d6d0 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.668+0000 7fabc22be700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc12fbc0 0x7fabbc130070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.668+0000 7fabc22be700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc12fbc0 0x7fabbc130070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39686/0 (socket says 172.21.15.179:39686) 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.668+0000 7fabc22be700 1 -- 172.21.15.179:0/2862694698 learned_addr learned my addr 172.21.15.179:0/2862694698 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:36.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.668+0000 7fabc22be700 1 -- 172.21.15.179:0/2862694698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabbc06d6d0 msgr2=0x7fabbc06db50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T00:14:36.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.668+0000 7fabc22be700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabbc06d6d0 0x7fabbc06db50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.668+0000 7fabc22be700 1 -- 172.21.15.179:0/2862694698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba8003a00 msgr2=0x7fabbc1325c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-07T00:14:36.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.668+0000 7fabc22be700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba8003a00 0x7fabbc1325c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.668+0000 7fabc22be700 1 -- 172.21.15.179:0/2862694698 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc140ec0 con 0x7fabbc12fbc0 2023-12-07T00:14:36.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.669+0000 7fabc22be700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc12fbc0 0x7fabbc130070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fabbc157df0 tx=0x7fabb800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.670+0000 7fabb27fc700 1 -- 172.21.15.179:0/2862694698 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80074e0 con 0x7fabbc12fbc0 2023-12-07T00:14:36.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.670+0000 7fabb27fc700 1 -- 172.21.15.179:0/2862694698 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8007640 con 0x7fabbc12fbc0 2023-12-07T00:14:36.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.670+0000 7fabb27fc700 1 -- 172.21.15.179:0/2862694698 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8005a90 con 0x7fabbc12fbc0 2023-12-07T00:14:36.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.670+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc1411a0 con 0x7fabbc12fbc0 2023-12-07T00:14:36.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.670+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc141760 con 0x7fabbc12fbc0 2023-12-07T00:14:36.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.682+0000 7fabb27fc700 1 -- 172.21.15.179:0/2862694698 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabb8005bf0 con 0x7fabbc12fbc0 2023-12-07T00:14:36.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.682+0000 7fabb27fc700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faba806cb40 0x7faba806f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:36.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.683+0000 7fabb27fc700 1 -- 172.21.15.179:0/2862694698 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fabb8088d30 con 0x7fabbc12fbc0 2023-12-07T00:14:36.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.683+0000 7fabc1abd700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faba806cb40 0x7faba806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:36.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.684+0000 7fabc1abd700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faba806cb40 0x7faba806f000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabac014040 tx=0x7fabac009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:36.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.684+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba40052e0 con 0x7fabbc12fbc0 2023-12-07T00:14:36.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.694+0000 7fabb27fc700 1 -- 172.21.15.179:0/2862694698 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabb8053ad0 con 0x7fabbc12fbc0 2023-12-07T00:14:36.965 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.966+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe060005590 con 0x7fe07c14ba10 2023-12-07T00:14:36.965 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.966+0000 7fe06affd700 1 -- 172.21.15.179:0/3613223907 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe06c059420 con 0x7fe07c14ba10 2023-12-07T00:14:36.969 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:36.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4d9c005860 con 0x7f4dbc14bb40 2023-12-07T00:14:36.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7f4da3fff700 1 -- 172.21.15.179:0/2425622402 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4dac057a80 con 0x7f4dbc14bb40 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe05c06afa0 msgr2=0x7fe05c06d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe05c06afa0 0x7fe05c06d460 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe0740012e0 tx=0x7fe074001780 comp rx=0 tx=0).stop 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c14ba10 msgr2=0x7fe07c0ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c14ba10 0x7fe07c0ce880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe06c015000 tx=0x7fe06c004750 comp rx=0 tx=0).stop 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 shutdown_connections 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe05c06afa0 0x7fe05c06d460 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe07c14ba10 0x7fe07c0ce880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe07c0722a0 0x7fe07c165390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 --2- 172.21.15.179:0/3613223907 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe07c0b49a0 0x7fe07c163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.971+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 >> 172.21.15.179:0/3613223907 conn(0x7fe07c06b150 msgr2=0x7fe07c0b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.971 INFO:teuthology.orchestra.run.smithi179.stdout:55834574859 2023-12-07T00:14:36.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.973+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 shutdown_connections 2023-12-07T00:14:36.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.974+0000 7fe080b0c700 1 -- 172.21.15.179:0/3613223907 wait complete. 2023-12-07T00:14:36.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4da806af20 msgr2=0x7f4da806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4da806af20 0x7f4da806d3e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4db400b370 tx=0x7f4db4009000 comp rx=0 tx=0).stop 2023-12-07T00:14:36.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14bb40 msgr2=0x7f4dbc130100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14bb40 0x7f4dbc130100 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00b410 tx=0x7f4dac00b720 comp rx=0 tx=0).stop 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 shutdown_connections 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4da806af20 0x7f4da806d3e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4dbc14bb40 0x7f4dbc130100 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4dbc0b33c0 0x7f4dbc1486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 --2- 172.21.15.179:0/2425622402 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4dbc14b530 0x7f4dbc1390f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.975+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 >> 172.21.15.179:0/2425622402 conn(0x7f4dbc06af70 msgr2=0x7f4dbc0b2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.976+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 shutdown_connections 2023-12-07T00:14:36.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:36.976+0000 7f4dc1835700 1 -- 172.21.15.179:0/2425622402 wait complete. 2023-12-07T00:14:36.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-12-07T00:14:36.997 DEBUG:teuthology.parallel:result is None 2023-12-07T00:14:36.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.0 2023-12-07T00:14:36.998 DEBUG:teuthology.parallel:result is None 2023-12-07T00:14:37.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.021+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f321c005860 con 0x7f323c15e220 2023-12-07T00:14:37.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.022+0000 7f3238ff9700 1 -- 172.21.15.179:0/3596460657 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3234059e50 con 0x7f323c15e220 2023-12-07T00:14:37.021 INFO:teuthology.orchestra.run.smithi179.stdout:55834574860 2023-12-07T00:14:37.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f322806aed0 msgr2=0x7f322806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f322806aed0 0x7f322806d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f322c009c40 tx=0x7f322c008040 comp rx=0 tx=0).stop 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c15e220 msgr2=0x7f323c14a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c15e220 0x7f323c14a250 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3234014040 tx=0x7f3234004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 shutdown_connections 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f322806aed0 0x7f322806d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f323c15e220 0x7f323c14a250 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323c0b2c70 0x7f323c1e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 --2- 172.21.15.179:0/3596460657 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f323c15de40 0x7f323c0d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 >> 172.21.15.179:0/3596460657 conn(0x7f323c072970 msgr2=0x7f323c160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 shutdown_connections 2023-12-07T00:14:37.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.024+0000 7f3242621700 1 -- 172.21.15.179:0/3596460657 wait complete. 2023-12-07T00:14:37.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.028+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f709806b740 con 0x7f709815a260 2023-12-07T00:14:37.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.029+0000 7f7094ff9700 1 -- 172.21.15.179:0/2209617095 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7090019030 con 0x7f709815a260 2023-12-07T00:14:37.028 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:37.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.032+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f708406af20 msgr2=0x7f708406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.032+0000 7f709e53e700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f708406af20 0x7f708406d3e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f708c000f60 tx=0x7f708c009040 comp rx=0 tx=0).stop 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.032+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f709815a260 msgr2=0x7f7098155640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.032+0000 7f709e53e700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f709815a260 0x7f7098155640 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f709000b990 tx=0x7f709000bca0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.032+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 shutdown_connections 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.032+0000 7f709e53e700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f708406af20 0x7f708406d3e0 secure :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f708c000f60 tx=0x7f708c009040 comp rx=0 tx=0).stop 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.032+0000 7f709e53e700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f709815a260 0x7f7098155640 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.033+0000 7f709e53e700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f709806ba90 0x7f7098135dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.033+0000 7f709e53e700 1 --2- 172.21.15.179:0/2209617095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70980b2f80 0x7f70980721d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.033+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 >> 172.21.15.179:0/2209617095 conn(0x7f709806af70 msgr2=0x7f7098136dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.034+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 shutdown_connections 2023-12-07T00:14:37.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.036+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5360067ee0 con 0x7f53601601b0 2023-12-07T00:14:37.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.036+0000 7f535cff9700 1 -- 172.21.15.179:0/1753191759 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f535001a070 con 0x7f53601601b0 2023-12-07T00:14:37.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.037+0000 7f709e53e700 1 -- 172.21.15.179:0/2209617095 wait complete. 2023-12-07T00:14:37.036 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:37.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2023-12-07T00:14:37.038 DEBUG:teuthology.parallel:result is None 2023-12-07T00:14:37.039 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.040+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f534006af20 msgr2=0x7f534006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.039 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.040+0000 7f5365bc9700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f534006af20 0x7f534006d3e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5360069ad0 tx=0x7f5348005040 comp rx=0 tx=0).stop 2023-12-07T00:14:37.039 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.040+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53601601b0 msgr2=0x7f536013fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.039 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.040+0000 7f5365bc9700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53601601b0 0x7f536013fe50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f535000f4b0 tx=0x7f535000f7c0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.044+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 shutdown_connections 2023-12-07T00:14:37.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.044+0000 7f5365bc9700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f534006af20 0x7f534006d3e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.044+0000 7f5365bc9700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5360160990 0x7f5360160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.044+0000 7f5365bc9700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f53601601b0 0x7f536013fe50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.044+0000 7f5365bc9700 1 --2- 172.21.15.179:0/1753191759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5360160590 0x7f536014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.043 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.044+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 >> 172.21.15.179:0/1753191759 conn(0x7f536006af70 msgr2=0x7f536006eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.045+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 shutdown_connections 2023-12-07T00:14:37.044 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.045+0000 7f5365bc9700 1 -- 172.21.15.179:0/1753191759 wait complete. 2023-12-07T00:14:37.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.047+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faba4005590 con 0x7fabbc12fbc0 2023-12-07T00:14:37.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.048+0000 7fabb27fc700 1 -- 172.21.15.179:0/2862694698 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabb8017020 con 0x7fabbc12fbc0 2023-12-07T00:14:37.047 INFO:teuthology.orchestra.run.smithi179.stdout:55834574858 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faba806cb40 msgr2=0x7faba806f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faba806cb40 0x7faba806f000 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fabac014040 tx=0x7fabac009030 comp rx=0 tx=0).stop 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc12fbc0 msgr2=0x7fabbc130070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc12fbc0 0x7fabbc130070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fabbc157df0 tx=0x7fabb800ca90 comp rx=0 tx=0).stop 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 shutdown_connections 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faba806cb40 0x7faba806f000 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fabbc12fbc0 0x7fabbc130070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faba8003a00 0x7fabbc1325c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 --2- 172.21.15.179:0/2862694698 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fabbc06d6d0 0x7fabbc06db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 >> 172.21.15.179:0/2862694698 conn(0x7fabbc06af70 msgr2=0x7fabbc158020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 shutdown_connections 2023-12-07T00:14:37.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.050+0000 7fabc3d21700 1 -- 172.21.15.179:0/2862694698 wait complete. 2023-12-07T00:14:37.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-12-07T00:14:37.052 DEBUG:teuthology.parallel:result is None 2023-12-07T00:14:37.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.056+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f42c406eec0 con 0x7f42b000d9e0 2023-12-07T00:14:37.055 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.056+0000 7f42ba7fc700 1 -- 172.21.15.179:0/863594610 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42c0058af0 con 0x7f42b000d9e0 2023-12-07T00:14:37.055 INFO:teuthology.orchestra.run.smithi179.stdout:55834574859 2023-12-07T00:14:37.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.057+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd1dc162880 con 0x7fd1c8004850 2023-12-07T00:14:37.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.058+0000 7fd1ce7fc700 1 -- 172.21.15.179:0/1285793290 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd1dc162880 con 0x7fd1c8004850 2023-12-07T00:14:37.057 INFO:teuthology.orchestra.run.smithi179.stdout:55834574860 2023-12-07T00:14:37.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.059+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f42a806aed0 msgr2=0x7f42a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.059+0000 7f42cbd32700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f42a806aed0 0x7f42a806d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42b40055f0 tx=0x7f42b4009040 comp rx=0 tx=0).stop 2023-12-07T00:14:37.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.059+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b000d9e0 msgr2=0x7f42c4206fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.058 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.059+0000 7f42cbd32700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b000d9e0 0x7f42c4206fc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42c406bd10 tx=0x7f42c00098b0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 shutdown_connections 2023-12-07T00:14:37.059 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7f42cbd32700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f42a806aed0 0x7f42a806d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7f42cbd32700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42c4205590 0x7f42c415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7f42cbd32700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f42b000d9e0 0x7f42c4206fc0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7f42cbd32700 1 --2- 172.21.15.179:0/863594610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f42c4205110 0x7f42c415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 >> 172.21.15.179:0/863594610 conn(0x7f42c406af70 msgr2=0x7f42c40cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 shutdown_connections 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd1c006af20 msgr2=0x7fd1c006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd1c006af20 0x7fd1c006d3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8015040 tx=0x7fd1d8007000 comp rx=0 tx=0).stop 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8004850 msgr2=0x7fd1dc1f73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8004850 0x7fd1dc1f73d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000f820 tx=0x7fd1d000fb30 comp rx=0 tx=0).stop 2023-12-07T00:14:37.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 shutdown_connections 2023-12-07T00:14:37.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd1c006af20 0x7fd1c006d3e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd1dc1633b0 0x7fd1dc163830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1c8004850 0x7fd1dc1f73d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 --2- 172.21.15.179:0/1285793290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd1dc14cf10 0x7fd1dc162e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.060+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 >> 172.21.15.179:0/1285793290 conn(0x7fd1dc072660 msgr2=0x7fd1dc0adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.061+0000 7f42cbd32700 1 -- 172.21.15.179:0/863594610 wait complete. 2023-12-07T00:14:37.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.061+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 shutdown_connections 2023-12-07T00:14:37.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.061+0000 7fd1e3c65700 1 -- 172.21.15.179:0/1285793290 wait complete. 2023-12-07T00:14:37.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.3 2023-12-07T00:14:37.063 DEBUG:teuthology.parallel:result is None 2023-12-07T00:14:37.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-12-07T00:14:37.066 DEBUG:teuthology.parallel:result is None 2023-12-07T00:14:37.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574860 for osd.2 2023-12-07T00:14:37.077 DEBUG:teuthology.parallel:result is None 2023-12-07T00:14:37.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-12-07T00:14:37.077 DEBUG:teuthology.parallel:result is None 2023-12-07T00:14:37.077 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-07T00:14:37.077 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T00:14:37.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.237+0000 7fde639ad700 1 Processor -- start 2023-12-07T00:14:37.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.238+0000 7fde639ad700 1 -- start start 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.238+0000 7fde639ad700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c0b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.238+0000 7fde639ad700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde5c0ae150 0x7fde5c0ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.238+0000 7fde639ad700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c06c920 con 0x7fde5c15db80 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.238+0000 7fde639ad700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0b1910 con 0x7fde5c0ae150 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.238+0000 7fde639ad700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c15df60 con 0x7fde5c0b0430 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde60f48700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c0b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61f4a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde5c0ae150 0x7fde5c0ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61749700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fde5c15db80 0x7fde5c06b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:53270/0 (socket says 172.21.15.179:53270) 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61749700 1 -- 172.21.15.179:0/2746227781 learned_addr learned my addr 172.21.15.179:0/2746227781 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde60f48700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c0b0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:40106/0 (socket says 172.21.15.179:40106) 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61f4a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde5c0ae150 0x7fde5c0ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41946/0 (socket says 172.21.15.179:41946) 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61f4a700 1 -- 172.21.15.179:0/2746227781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 msgr2=0x7fde5c0b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61f4a700 1 --2- 172.21.15.179:0/2746227781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c0b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.239 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61f4a700 1 -- 172.21.15.179:0/2746227781 >> v1:172.21.15.190:6789/0 conn(0x7fde5c15db80 legacy=0x7fde5c06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.240 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61f4a700 1 -- 172.21.15.179:0/2746227781 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0b0dd0 con 0x7fde5c0ae150 2023-12-07T00:14:37.240 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde60f48700 1 --2- 172.21.15.179:0/2746227781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c0b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:37.240 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde61f4a700 1 --2- 172.21.15.179:0/2746227781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c0ae150 0x7fde5c0ae5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde54009d90 tx=0x7fde5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f728f3e3e6a7fb91 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:37.240 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.239+0000 7fde53fff700 1 -- 172.21.15.179:0/2746227781 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5400e070 con 0x7fde5c0ae150 2023-12-07T00:14:37.240 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde53fff700 1 -- 172.21.15.179:0/2746227781 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5400bb20 con 0x7fde5c0ae150 2023-12-07T00:14:37.240 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde53fff700 1 -- 172.21.15.179:0/2746227781 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54012430 con 0x7fde5c0ae150 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde639ad700 1 -- 172.21.15.179:0/2746227781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c0ae150 msgr2=0x7fde5c0ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde639ad700 1 --2- 172.21.15.179:0/2746227781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c0ae150 0x7fde5c0ae5a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde54009d90 tx=0x7fde5400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde639ad700 1 -- 172.21.15.179:0/2746227781 shutdown_connections 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde639ad700 1 --2- 172.21.15.179:0/2746227781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c0ae150 0x7fde5c0ae5a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde639ad700 1 --2- 172.21.15.179:0/2746227781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c0b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde639ad700 1 -- 172.21.15.179:0/2746227781 >> 172.21.15.179:0/2746227781 conn(0x7fde5c072660 msgr2=0x7fde5c0b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde639ad700 1 -- 172.21.15.179:0/2746227781 shutdown_connections 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.240+0000 7fde639ad700 1 -- 172.21.15.179:0/2746227781 wait complete. 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.241+0000 7fde639ad700 1 Processor -- start 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.241+0000 7fde639ad700 1 -- start start 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde639ad700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5c0ae150 0x7fde5c14bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde639ad700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde639ad700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c15db80 0x7fde5c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde639ad700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1554d0 con 0x7fde5c0ae150 2023-12-07T00:14:37.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde639ad700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c14c280 con 0x7fde5c15db80 2023-12-07T00:14:37.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde639ad700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c1551f0 con 0x7fde5c0b0430 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde61749700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5c0ae150 0x7fde5c14bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde61749700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5c0ae150 0x7fde5c14bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39696/0 (socket says 172.21.15.179:39696) 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde61749700 1 -- 172.21.15.179:0/1610235256 learned_addr learned my addr 172.21.15.179:0/1610235256 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde61f4a700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c15db80 0x7fde5c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.242+0000 7fde60f48700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde61749700 1 -- 172.21.15.179:0/1610235256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 msgr2=0x7fde5c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde61749700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde61749700 1 -- 172.21.15.179:0/1610235256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c15db80 msgr2=0x7fde5c154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde61749700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c15db80 0x7fde5c154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde61749700 1 -- 172.21.15.179:0/1610235256 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580094a0 con 0x7fde5c0ae150 2023-12-07T00:14:37.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde61749700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5c0ae150 0x7fde5c14bd40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00c480 tx=0x7fde4c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:37.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde51ffb700 1 -- 172.21.15.179:0/1610235256 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c005d70 con 0x7fde5c0ae150 2023-12-07T00:14:37.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde51ffb700 1 -- 172.21.15.179:0/1610235256 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c00ce90 con 0x7fde5c0ae150 2023-12-07T00:14:37.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde54009a70 con 0x7fde5c0ae150 2023-12-07T00:14:37.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde51ffb700 1 -- 172.21.15.179:0/1610235256 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0072d0 con 0x7fde5c0ae150 2023-12-07T00:14:37.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.243+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c151930 con 0x7fde5c0ae150 2023-12-07T00:14:37.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.244+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c0b14d0 con 0x7fde5c0ae150 2023-12-07T00:14:37.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.244+0000 7fde51ffb700 1 -- 172.21.15.179:0/1610235256 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde4c007430 con 0x7fde5c0ae150 2023-12-07T00:14:37.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.245+0000 7fde51ffb700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fde4006aed0 0x7fde4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.245+0000 7fde51ffb700 1 -- 172.21.15.179:0/1610235256 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde4c088ad0 con 0x7fde5c0ae150 2023-12-07T00:14:37.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.245+0000 7fde60f48700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fde4006aed0 0x7fde4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.245+0000 7fde60f48700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fde4006aed0 0x7fde4006d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde5c1f4be0 tx=0x7fde58009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:37.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.249+0000 7fde51ffb700 1 -- 172.21.15.179:0/1610235256 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde4c053940 con 0x7fde5c0ae150 2023-12-07T00:14:37.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.435+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 --> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde5c06c360 con 0x7fde4006aed0 2023-12-07T00:14:37.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.444+0000 7fde51ffb700 1 -- 172.21.15.179:0/1610235256 <== mgr.4104 v2:172.21.15.179:6832/1592863421 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345286 (secure 0 0 0) 0x7fde580099c0 con 0x7fde4006aed0 2023-12-07T00:14:37.447 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fde4006aed0 msgr2=0x7fde4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fde4006aed0 0x7fde4006d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fde5c1f4be0 tx=0x7fde58009210 comp rx=0 tx=0).stop 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5c0ae150 msgr2=0x7fde5c14bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5c0ae150 0x7fde5c14bd40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00c480 tx=0x7fde4c00c790 comp rx=0 tx=0).stop 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 shutdown_connections 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fde4006aed0 0x7fde4006d390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde5c15db80 0x7fde5c154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde5c0ae150 0x7fde5c14bd40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 --2- 172.21.15.179:0/1610235256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fde5c0b0430 0x7fde5c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 >> 172.21.15.179:0/1610235256 conn(0x7fde5c072660 msgr2=0x7fde5c150cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 shutdown_connections 2023-12-07T00:14:37.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.448+0000 7fde639ad700 1 -- 172.21.15.179:0/1610235256 wait complete. 2023-12-07T00:14:37.453 INFO:teuthology.orchestra.run.smithi179.stderr:dumped all 2023-12-07T00:14:37.459 INFO:teuthology.orchestra.run.smithi179.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-07T00:14:36.518933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3579904,"data_stored":2119604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2228,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003342"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890228+0000","last_change":"2023-12-07T00:14:14.643199+0000","last_active":"2023-12-07T00:14:19.890228+0000","last_peered":"2023-12-07T00:14:19.890228+0000","last_clean":"2023-12-07T00:14:19.890228+0000","last_became_active":"2023-12-07T00:14:14.642929+0000","last_became_peered":"2023-12-07T00:14:14.642929+0000","last_unstale":"2023-12-07T00:14:19.890228+0000","last_undegraded":"2023-12-07T00:14:19.890228+0000","last_fullsized":"2023-12-07T00:14:19.890228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:20:09.627523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889353+0000","last_change":"2023-12-07T00:14:14.644949+0000","last_active":"2023-12-07T00:14:19.889353+0000","last_peered":"2023-12-07T00:14:19.889353+0000","last_clean":"2023-12-07T00:14:19.889353+0000","last_became_active":"2023-12-07T00:14:14.644679+0000","last_became_peered":"2023-12-07T00:14:14.644679+0000","last_unstale":"2023-12-07T00:14:19.889353+0000","last_undegraded":"2023-12-07T00:14:19.889353+0000","last_fullsized":"2023-12-07T00:14:19.889353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889573+0000","last_change":"2023-12-07T00:14:14.645513+0000","last_active":"2023-12-07T00:14:19.889573+0000","last_peered":"2023-12-07T00:14:19.889573+0000","last_clean":"2023-12-07T00:14:19.889573+0000","last_became_active":"2023-12-07T00:14:14.645261+0000","last_became_peered":"2023-12-07T00:14:14.645261+0000","last_unstale":"2023-12-07T00:14:19.889573+0000","last_undegraded":"2023-12-07T00:14:19.889573+0000","last_fullsized":"2023-12-07T00:14:19.889573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683459+0000","last_change":"2023-12-07T00:14:14.646952+0000","last_active":"2023-12-07T00:14:19.683459+0000","last_peered":"2023-12-07T00:14:19.683459+0000","last_clean":"2023-12-07T00:14:19.683459+0000","last_became_active":"2023-12-07T00:14:14.646645+0000","last_became_peered":"2023-12-07T00:14:14.646645+0000","last_unstale":"2023-12-07T00:14:19.683459+0000","last_undegraded":"2023-12-07T00:14:19.683459+0000","last_fullsized":"2023-12-07T00:14:19.683459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889608+0000","last_change":"2023-12-07T00:14:14.645840+0000","last_active":"2023-12-07T00:14:19.889608+0000","last_peered":"2023-12-07T00:14:19.889608+0000","last_clean":"2023-12-07T00:14:19.889608+0000","last_became_active":"2023-12-07T00:14:14.645226+0000","last_became_peered":"2023-12-07T00:14:14.645226+0000","last_unstale":"2023-12-07T00:14:19.889608+0000","last_undegraded":"2023-12-07T00:14:19.889608+0000","last_fullsized":"2023-12-07T00:14:19.889608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:24.947977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683090+0000","last_change":"2023-12-07T00:14:14.642310+0000","last_active":"2023-12-07T00:14:19.683090+0000","last_peered":"2023-12-07T00:14:19.683090+0000","last_clean":"2023-12-07T00:14:19.683090+0000","last_became_active":"2023-12-07T00:14:14.642041+0000","last_became_peered":"2023-12-07T00:14:14.642041+0000","last_unstale":"2023-12-07T00:14:19.683090+0000","last_undegraded":"2023-12-07T00:14:19.683090+0000","last_fullsized":"2023-12-07T00:14:19.683090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:20:09.627523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889514+0000","last_change":"2023-12-07T00:14:14.651174+0000","last_active":"2023-12-07T00:14:19.889514+0000","last_peered":"2023-12-07T00:14:19.889514+0000","last_clean":"2023-12-07T00:14:19.889514+0000","last_became_active":"2023-12-07T00:14:14.650891+0000","last_became_peered":"2023-12-07T00:14:14.650891+0000","last_unstale":"2023-12-07T00:14:19.889514+0000","last_undegraded":"2023-12-07T00:14:19.889514+0000","last_fullsized":"2023-12-07T00:14:19.889514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680378+0000","last_change":"2023-12-07T00:14:14.651410+0000","last_active":"2023-12-07T00:14:19.680378+0000","last_peered":"2023-12-07T00:14:19.680378+0000","last_clean":"2023-12-07T00:14:19.680378+0000","last_became_active":"2023-12-07T00:14:14.651150+0000","last_became_peered":"2023-12-07T00:14:14.651150+0000","last_unstale":"2023-12-07T00:14:19.680378+0000","last_undegraded":"2023-12-07T00:14:19.680378+0000","last_fullsized":"2023-12-07T00:14:19.680378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890130+0000","last_change":"2023-12-07T00:14:14.649568+0000","last_active":"2023-12-07T00:14:19.890130+0000","last_peered":"2023-12-07T00:14:19.890130+0000","last_clean":"2023-12-07T00:14:19.890130+0000","last_became_active":"2023-12-07T00:14:14.649226+0000","last_became_peered":"2023-12-07T00:14:14.649226+0000","last_unstale":"2023-12-07T00:14:19.890130+0000","last_undegraded":"2023-12-07T00:14:19.890130+0000","last_fullsized":"2023-12-07T00:14:19.890130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683413+0000","last_change":"2023-12-07T00:14:14.641982+0000","last_active":"2023-12-07T00:14:19.683413+0000","last_peered":"2023-12-07T00:14:19.683413+0000","last_clean":"2023-12-07T00:14:19.683413+0000","last_became_active":"2023-12-07T00:14:14.641635+0000","last_became_peered":"2023-12-07T00:14:14.641635+0000","last_unstale":"2023-12-07T00:14:19.683413+0000","last_undegraded":"2023-12-07T00:14:19.683413+0000","last_fullsized":"2023-12-07T00:14:19.683413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683349+0000","last_change":"2023-12-07T00:14:14.641705+0000","last_active":"2023-12-07T00:14:19.683349+0000","last_peered":"2023-12-07T00:14:19.683349+0000","last_clean":"2023-12-07T00:14:19.683349+0000","last_became_active":"2023-12-07T00:14:14.640554+0000","last_became_peered":"2023-12-07T00:14:14.640554+0000","last_unstale":"2023-12-07T00:14:19.683349+0000","last_undegraded":"2023-12-07T00:14:19.683349+0000","last_fullsized":"2023-12-07T00:14:19.683349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890100+0000","last_change":"2023-12-07T00:14:14.638208+0000","last_active":"2023-12-07T00:14:19.890100+0000","last_peered":"2023-12-07T00:14:19.890100+0000","last_clean":"2023-12-07T00:14:19.890100+0000","last_became_active":"2023-12-07T00:14:14.637940+0000","last_became_peered":"2023-12-07T00:14:14.637940+0000","last_unstale":"2023-12-07T00:14:19.890100+0000","last_undegraded":"2023-12-07T00:14:19.890100+0000","last_fullsized":"2023-12-07T00:14:19.890100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:09.512398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680049+0000","last_change":"2023-12-07T00:14:14.655710+0000","last_active":"2023-12-07T00:14:19.680049+0000","last_peered":"2023-12-07T00:14:19.680049+0000","last_clean":"2023-12-07T00:14:19.680049+0000","last_became_active":"2023-12-07T00:14:14.652457+0000","last_became_peered":"2023-12-07T00:14:14.652457+0000","last_unstale":"2023-12-07T00:14:19.680049+0000","last_undegraded":"2023-12-07T00:14:19.680049+0000","last_fullsized":"2023-12-07T00:14:19.680049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889539+0000","last_change":"2023-12-07T00:14:14.654290+0000","last_active":"2023-12-07T00:14:19.889539+0000","last_peered":"2023-12-07T00:14:19.889539+0000","last_clean":"2023-12-07T00:14:19.889539+0000","last_became_active":"2023-12-07T00:14:14.654021+0000","last_became_peered":"2023-12-07T00:14:14.654021+0000","last_unstale":"2023-12-07T00:14:19.889539+0000","last_undegraded":"2023-12-07T00:14:19.889539+0000","last_fullsized":"2023-12-07T00:14:19.889539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:18.698925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888456+0000","last_change":"2023-12-07T00:14:14.646526+0000","last_active":"2023-12-07T00:14:19.888456+0000","last_peered":"2023-12-07T00:14:19.888456+0000","last_clean":"2023-12-07T00:14:19.888456+0000","last_became_active":"2023-12-07T00:14:14.646114+0000","last_became_peered":"2023-12-07T00:14:14.646114+0000","last_unstale":"2023-12-07T00:14:19.888456+0000","last_undegraded":"2023-12-07T00:14:19.888456+0000","last_fullsized":"2023-12-07T00:14:19.888456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682644+0000","last_change":"2023-12-07T00:14:14.642157+0000","last_active":"2023-12-07T00:14:19.682644+0000","last_peered":"2023-12-07T00:14:19.682644+0000","last_clean":"2023-12-07T00:14:19.682644+0000","last_became_active":"2023-12-07T00:14:14.641857+0000","last_became_peered":"2023-12-07T00:14:14.641857+0000","last_unstale":"2023-12-07T00:14:19.682644+0000","last_undegraded":"2023-12-07T00:14:19.682644+0000","last_fullsized":"2023-12-07T00:14:19.682644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684069+0000","last_change":"2023-12-07T00:14:14.643563+0000","last_active":"2023-12-07T00:14:19.684069+0000","last_peered":"2023-12-07T00:14:19.684069+0000","last_clean":"2023-12-07T00:14:19.684069+0000","last_became_active":"2023-12-07T00:14:14.643055+0000","last_became_peered":"2023-12-07T00:14:14.643055+0000","last_unstale":"2023-12-07T00:14:19.684069+0000","last_undegraded":"2023-12-07T00:14:19.684069+0000","last_fullsized":"2023-12-07T00:14:19.684069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:36.710499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889136+0000","last_change":"2023-12-07T00:14:14.636014+0000","last_active":"2023-12-07T00:14:19.889136+0000","last_peered":"2023-12-07T00:14:19.889136+0000","last_clean":"2023-12-07T00:14:19.889136+0000","last_became_active":"2023-12-07T00:14:14.635717+0000","last_became_peered":"2023-12-07T00:14:14.635717+0000","last_unstale":"2023-12-07T00:14:19.889136+0000","last_undegraded":"2023-12-07T00:14:19.889136+0000","last_fullsized":"2023-12-07T00:14:19.889136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:24.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890290+0000","last_change":"2023-12-07T00:14:14.645014+0000","last_active":"2023-12-07T00:14:19.890290+0000","last_peered":"2023-12-07T00:14:19.890290+0000","last_clean":"2023-12-07T00:14:19.890290+0000","last_became_active":"2023-12-07T00:14:14.644738+0000","last_became_peered":"2023-12-07T00:14:14.644738+0000","last_unstale":"2023-12-07T00:14:19.890290+0000","last_undegraded":"2023-12-07T00:14:19.890290+0000","last_fullsized":"2023-12-07T00:14:19.890290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367254+0000","last_change":"2023-12-07T00:14:19.076496+0000","last_active":"2023-12-07T00:14:21.367254+0000","last_peered":"2023-12-07T00:14:21.367254+0000","last_clean":"2023-12-07T00:14:21.367254+0000","last_became_active":"2023-12-07T00:14:19.076104+0000","last_became_peered":"2023-12-07T00:14:19.076104+0000","last_unstale":"2023-12-07T00:14:21.367254+0000","last_undegraded":"2023-12-07T00:14:21.367254+0000","last_fullsized":"2023-12-07T00:14:21.367254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:19:30.998083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889786+0000","last_change":"2023-12-07T00:14:13.630530+0000","last_active":"2023-12-07T00:14:19.889786+0000","last_peered":"2023-12-07T00:14:19.889786+0000","last_clean":"2023-12-07T00:14:19.889786+0000","last_became_active":"2023-12-07T00:14:13.630248+0000","last_became_peered":"2023-12-07T00:14:13.630248+0000","last_unstale":"2023-12-07T00:14:19.889786+0000","last_undegraded":"2023-12-07T00:14:19.889786+0000","last_fullsized":"2023-12-07T00:14:19.889786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680935+0000","last_change":"2023-12-07T00:14:14.650100+0000","last_active":"2023-12-07T00:14:19.680935+0000","last_peered":"2023-12-07T00:14:19.680935+0000","last_clean":"2023-12-07T00:14:19.680935+0000","last_became_active":"2023-12-07T00:14:14.649807+0000","last_became_peered":"2023-12-07T00:14:14.649807+0000","last_unstale":"2023-12-07T00:14:19.680935+0000","last_undegraded":"2023-12-07T00:14:19.680935+0000","last_fullsized":"2023-12-07T00:14:19.680935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684337+0000","last_change":"2023-12-07T00:14:18.665602+0000","last_active":"2023-12-07T00:14:20.684337+0000","last_peered":"2023-12-07T00:14:20.684337+0000","last_clean":"2023-12-07T00:14:20.684337+0000","last_became_active":"2023-12-07T00:14:18.665065+0000","last_became_peered":"2023-12-07T00:14:18.665065+0000","last_unstale":"2023-12-07T00:14:20.684337+0000","last_undegraded":"2023-12-07T00:14:20.684337+0000","last_fullsized":"2023-12-07T00:14:20.684337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:28.978624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680641+0000","last_change":"2023-12-07T00:14:13.635320+0000","last_active":"2023-12-07T00:14:19.680641+0000","last_peered":"2023-12-07T00:14:19.680641+0000","last_clean":"2023-12-07T00:14:19.680641+0000","last_became_active":"2023-12-07T00:14:13.635008+0000","last_became_peered":"2023-12-07T00:14:13.635008+0000","last_unstale":"2023-12-07T00:14:19.680641+0000","last_undegraded":"2023-12-07T00:14:19.680641+0000","last_fullsized":"2023-12-07T00:14:19.680641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:17.694563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889743+0000","last_change":"2023-12-07T00:14:14.642235+0000","last_active":"2023-12-07T00:14:19.889743+0000","last_peered":"2023-12-07T00:14:19.889743+0000","last_clean":"2023-12-07T00:14:19.889743+0000","last_became_active":"2023-12-07T00:14:14.641920+0000","last_became_peered":"2023-12-07T00:14:14.641920+0000","last_unstale":"2023-12-07T00:14:19.889743+0000","last_undegraded":"2023-12-07T00:14:19.889743+0000","last_fullsized":"2023-12-07T00:14:19.889743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684737+0000","last_change":"2023-12-07T00:14:18.665909+0000","last_active":"2023-12-07T00:14:20.684737+0000","last_peered":"2023-12-07T00:14:20.684737+0000","last_clean":"2023-12-07T00:14:20.684737+0000","last_became_active":"2023-12-07T00:14:18.665195+0000","last_became_peered":"2023-12-07T00:14:18.665195+0000","last_unstale":"2023-12-07T00:14:20.684737+0000","last_undegraded":"2023-12-07T00:14:20.684737+0000","last_fullsized":"2023-12-07T00:14:20.684737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:36.812638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889883+0000","last_change":"2023-12-07T00:14:13.639070+0000","last_active":"2023-12-07T00:14:19.889883+0000","last_peered":"2023-12-07T00:14:19.889883+0000","last_clean":"2023-12-07T00:14:19.889883+0000","last_became_active":"2023-12-07T00:14:13.638806+0000","last_became_peered":"2023-12-07T00:14:13.638806+0000","last_unstale":"2023-12-07T00:14:19.889883+0000","last_undegraded":"2023-12-07T00:14:19.889883+0000","last_fullsized":"2023-12-07T00:14:19.889883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:17.694563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683306+0000","last_change":"2023-12-07T00:14:14.638446+0000","last_active":"2023-12-07T00:14:19.683306+0000","last_peered":"2023-12-07T00:14:19.683306+0000","last_clean":"2023-12-07T00:14:19.683306+0000","last_became_active":"2023-12-07T00:14:14.638158+0000","last_became_peered":"2023-12-07T00:14:14.638158+0000","last_unstale":"2023-12-07T00:14:19.683306+0000","last_undegraded":"2023-12-07T00:14:19.683306+0000","last_fullsized":"2023-12-07T00:14:19.683306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684589+0000","last_change":"2023-12-07T00:14:18.669676+0000","last_active":"2023-12-07T00:14:20.684589+0000","last_peered":"2023-12-07T00:14:20.684589+0000","last_clean":"2023-12-07T00:14:20.684589+0000","last_became_active":"2023-12-07T00:14:18.669279+0000","last_became_peered":"2023-12-07T00:14:18.669279+0000","last_unstale":"2023-12-07T00:14:20.684589+0000","last_undegraded":"2023-12-07T00:14:20.684589+0000","last_fullsized":"2023-12-07T00:14:20.684589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:31.897202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889817+0000","last_change":"2023-12-07T00:14:13.635829+0000","last_active":"2023-12-07T00:14:19.889817+0000","last_peered":"2023-12-07T00:14:19.889817+0000","last_clean":"2023-12-07T00:14:19.889817+0000","last_became_active":"2023-12-07T00:14:13.635554+0000","last_became_peered":"2023-12-07T00:14:13.635554+0000","last_unstale":"2023-12-07T00:14:19.889817+0000","last_undegraded":"2023-12-07T00:14:19.889817+0000","last_fullsized":"2023-12-07T00:14:19.889817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684138+0000","last_change":"2023-12-07T00:14:14.638063+0000","last_active":"2023-12-07T00:14:19.684138+0000","last_peered":"2023-12-07T00:14:19.684138+0000","last_clean":"2023-12-07T00:14:19.684138+0000","last_became_active":"2023-12-07T00:14:14.637766+0000","last_became_peered":"2023-12-07T00:14:14.637766+0000","last_unstale":"2023-12-07T00:14:19.684138+0000","last_undegraded":"2023-12-07T00:14:19.684138+0000","last_fullsized":"2023-12-07T00:14:19.684138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367970+0000","last_change":"2023-12-07T00:14:18.668124+0000","last_active":"2023-12-07T00:14:21.367970+0000","last_peered":"2023-12-07T00:14:21.367970+0000","last_clean":"2023-12-07T00:14:21.367970+0000","last_became_active":"2023-12-07T00:14:18.667677+0000","last_became_peered":"2023-12-07T00:14:18.667677+0000","last_unstale":"2023-12-07T00:14:21.367970+0000","last_undegraded":"2023-12-07T00:14:21.367970+0000","last_fullsized":"2023-12-07T00:14:21.367970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:29:46.330072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680292+0000","last_change":"2023-12-07T00:14:13.639589+0000","last_active":"2023-12-07T00:14:19.680292+0000","last_peered":"2023-12-07T00:14:19.680292+0000","last_clean":"2023-12-07T00:14:19.680292+0000","last_became_active":"2023-12-07T00:14:13.639315+0000","last_became_peered":"2023-12-07T00:14:13.639315+0000","last_unstale":"2023-12-07T00:14:19.680292+0000","last_undegraded":"2023-12-07T00:14:19.680292+0000","last_fullsized":"2023-12-07T00:14:19.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889199+0000","last_change":"2023-12-07T00:14:14.638371+0000","last_active":"2023-12-07T00:14:19.889199+0000","last_peered":"2023-12-07T00:14:19.889199+0000","last_clean":"2023-12-07T00:14:19.889199+0000","last_became_active":"2023-12-07T00:14:14.638090+0000","last_became_peered":"2023-12-07T00:14:14.638090+0000","last_unstale":"2023-12-07T00:14:19.889199+0000","last_undegraded":"2023-12-07T00:14:19.889199+0000","last_fullsized":"2023-12-07T00:14:19.889199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:02:05.622336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.681229+0000","last_change":"2023-12-07T00:14:18.667960+0000","last_active":"2023-12-07T00:14:20.681229+0000","last_peered":"2023-12-07T00:14:20.681229+0000","last_clean":"2023-12-07T00:14:20.681229+0000","last_became_active":"2023-12-07T00:14:18.667569+0000","last_became_peered":"2023-12-07T00:14:18.667569+0000","last_unstale":"2023-12-07T00:14:20.681229+0000","last_undegraded":"2023-12-07T00:14:20.681229+0000","last_fullsized":"2023-12-07T00:14:20.681229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:18.112203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683017+0000","last_change":"2023-12-07T00:14:13.637477+0000","last_active":"2023-12-07T00:14:19.683017+0000","last_peered":"2023-12-07T00:14:19.683017+0000","last_clean":"2023-12-07T00:14:19.683017+0000","last_became_active":"2023-12-07T00:14:13.637044+0000","last_became_peered":"2023-12-07T00:14:13.637044+0000","last_unstale":"2023-12-07T00:14:19.683017+0000","last_undegraded":"2023-12-07T00:14:19.683017+0000","last_fullsized":"2023-12-07T00:14:19.683017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888973+0000","last_change":"2023-12-07T00:14:14.648736+0000","last_active":"2023-12-07T00:14:19.888973+0000","last_peered":"2023-12-07T00:14:19.888973+0000","last_clean":"2023-12-07T00:14:19.888973+0000","last_became_active":"2023-12-07T00:14:14.648449+0000","last_became_peered":"2023-12-07T00:14:14.648449+0000","last_unstale":"2023-12-07T00:14:19.888973+0000","last_undegraded":"2023-12-07T00:14:19.888973+0000","last_fullsized":"2023-12-07T00:14:19.888973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.706104+0000","last_change":"2023-12-07T00:14:18.671310+0000","last_active":"2023-12-07T00:14:20.706104+0000","last_peered":"2023-12-07T00:14:20.706104+0000","last_clean":"2023-12-07T00:14:20.706104+0000","last_became_active":"2023-12-07T00:14:18.670905+0000","last_became_peered":"2023-12-07T00:14:18.670905+0000","last_unstale":"2023-12-07T00:14:20.706104+0000","last_undegraded":"2023-12-07T00:14:20.706104+0000","last_fullsized":"2023-12-07T00:14:20.706104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:36.812638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679983+0000","last_change":"2023-12-07T00:14:13.636864+0000","last_active":"2023-12-07T00:14:19.679983+0000","last_peered":"2023-12-07T00:14:19.679983+0000","last_clean":"2023-12-07T00:14:19.679983+0000","last_became_active":"2023-12-07T00:14:13.636497+0000","last_became_peered":"2023-12-07T00:14:13.636497+0000","last_unstale":"2023-12-07T00:14:19.679983+0000","last_undegraded":"2023-12-07T00:14:19.679983+0000","last_fullsized":"2023-12-07T00:14:19.679983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679793+0000","last_change":"2023-12-07T00:14:14.647211+0000","last_active":"2023-12-07T00:14:19.679793+0000","last_peered":"2023-12-07T00:14:19.679793+0000","last_clean":"2023-12-07T00:14:19.679793+0000","last_became_active":"2023-12-07T00:14:14.646890+0000","last_became_peered":"2023-12-07T00:14:14.646890+0000","last_unstale":"2023-12-07T00:14:19.679793+0000","last_undegraded":"2023-12-07T00:14:19.679793+0000","last_fullsized":"2023-12-07T00:14:19.679793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367712+0000","last_change":"2023-12-07T00:14:19.073249+0000","last_active":"2023-12-07T00:14:21.367712+0000","last_peered":"2023-12-07T00:14:21.367712+0000","last_clean":"2023-12-07T00:14:21.367712+0000","last_became_active":"2023-12-07T00:14:19.072757+0000","last_became_peered":"2023-12-07T00:14:19.072757+0000","last_unstale":"2023-12-07T00:14:21.367712+0000","last_undegraded":"2023-12-07T00:14:21.367712+0000","last_fullsized":"2023-12-07T00:14:21.367712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684347+0000","last_change":"2023-12-07T00:14:13.630879+0000","last_active":"2023-12-07T00:14:19.684347+0000","last_peered":"2023-12-07T00:14:19.684347+0000","last_clean":"2023-12-07T00:14:19.684347+0000","last_became_active":"2023-12-07T00:14:13.630299+0000","last_became_peered":"2023-12-07T00:14:13.630299+0000","last_unstale":"2023-12-07T00:14:19.684347+0000","last_undegraded":"2023-12-07T00:14:19.684347+0000","last_fullsized":"2023-12-07T00:14:19.684347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888694+0000","last_change":"2023-12-07T00:14:14.651244+0000","last_active":"2023-12-07T00:14:19.888694+0000","last_peered":"2023-12-07T00:14:19.888694+0000","last_clean":"2023-12-07T00:14:19.888694+0000","last_became_active":"2023-12-07T00:14:14.650996+0000","last_became_peered":"2023-12-07T00:14:14.650996+0000","last_unstale":"2023-12-07T00:14:19.888694+0000","last_undegraded":"2023-12-07T00:14:19.888694+0000","last_fullsized":"2023-12-07T00:14:19.888694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367059+0000","last_change":"2023-12-07T00:14:19.073306+0000","last_active":"2023-12-07T00:14:21.367059+0000","last_peered":"2023-12-07T00:14:21.367059+0000","last_clean":"2023-12-07T00:14:21.367059+0000","last_became_active":"2023-12-07T00:14:19.072870+0000","last_became_peered":"2023-12-07T00:14:19.072870+0000","last_unstale":"2023-12-07T00:14:21.367059+0000","last_undegraded":"2023-12-07T00:14:21.367059+0000","last_fullsized":"2023-12-07T00:14:21.367059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:02:29.749218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683882+0000","last_change":"2023-12-07T00:14:13.636919+0000","last_active":"2023-12-07T00:14:19.683882+0000","last_peered":"2023-12-07T00:14:19.683882+0000","last_clean":"2023-12-07T00:14:19.683882+0000","last_became_active":"2023-12-07T00:14:13.636581+0000","last_became_peered":"2023-12-07T00:14:13.636581+0000","last_unstale":"2023-12-07T00:14:19.683882+0000","last_undegraded":"2023-12-07T00:14:19.683882+0000","last_fullsized":"2023-12-07T00:14:19.683882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683788+0000","last_change":"2023-12-07T00:14:14.644313+0000","last_active":"2023-12-07T00:14:19.683788+0000","last_peered":"2023-12-07T00:14:19.683788+0000","last_clean":"2023-12-07T00:14:19.683788+0000","last_became_active":"2023-12-07T00:14:14.643846+0000","last_became_peered":"2023-12-07T00:14:14.643846+0000","last_unstale":"2023-12-07T00:14:19.683788+0000","last_undegraded":"2023-12-07T00:14:19.683788+0000","last_fullsized":"2023-12-07T00:14:19.683788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367087+0000","last_change":"2023-12-07T00:14:18.664942+0000","last_active":"2023-12-07T00:14:21.367087+0000","last_peered":"2023-12-07T00:14:21.367087+0000","last_clean":"2023-12-07T00:14:21.367087+0000","last_became_active":"2023-12-07T00:14:18.664530+0000","last_became_peered":"2023-12-07T00:14:18.664530+0000","last_unstale":"2023-12-07T00:14:21.367087+0000","last_undegraded":"2023-12-07T00:14:21.367087+0000","last_fullsized":"2023-12-07T00:14:21.367087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:50:31.696056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683699+0000","last_change":"2023-12-07T00:14:13.638292+0000","last_active":"2023-12-07T00:14:19.683699+0000","last_peered":"2023-12-07T00:14:19.683699+0000","last_clean":"2023-12-07T00:14:19.683699+0000","last_became_active":"2023-12-07T00:14:13.637982+0000","last_became_peered":"2023-12-07T00:14:13.637982+0000","last_unstale":"2023-12-07T00:14:19.683699+0000","last_undegraded":"2023-12-07T00:14:19.683699+0000","last_fullsized":"2023-12-07T00:14:19.683699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889880+0000","last_change":"2023-12-07T00:14:14.649013+0000","last_active":"2023-12-07T00:14:19.889880+0000","last_peered":"2023-12-07T00:14:19.889880+0000","last_clean":"2023-12-07T00:14:19.889880+0000","last_became_active":"2023-12-07T00:14:14.648768+0000","last_became_peered":"2023-12-07T00:14:14.648768+0000","last_unstale":"2023-12-07T00:14:19.889880+0000","last_undegraded":"2023-12-07T00:14:19.889880+0000","last_fullsized":"2023-12-07T00:14:19.889880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685363+0000","last_change":"2023-12-07T00:14:18.661970+0000","last_active":"2023-12-07T00:14:20.685363+0000","last_peered":"2023-12-07T00:14:20.685363+0000","last_clean":"2023-12-07T00:14:20.685363+0000","last_became_active":"2023-12-07T00:14:18.661509+0000","last_became_peered":"2023-12-07T00:14:18.661509+0000","last_unstale":"2023-12-07T00:14:20.685363+0000","last_undegraded":"2023-12-07T00:14:20.685363+0000","last_fullsized":"2023-12-07T00:14:20.685363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889467+0000","last_change":"2023-12-07T00:14:13.632679+0000","last_active":"2023-12-07T00:14:19.889467+0000","last_peered":"2023-12-07T00:14:19.889467+0000","last_clean":"2023-12-07T00:14:19.889467+0000","last_became_active":"2023-12-07T00:14:13.632414+0000","last_became_peered":"2023-12-07T00:14:13.632414+0000","last_unstale":"2023-12-07T00:14:19.889467+0000","last_undegraded":"2023-12-07T00:14:19.889467+0000","last_fullsized":"2023-12-07T00:14:19.889467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890001+0000","last_change":"2023-12-07T00:14:14.643589+0000","last_active":"2023-12-07T00:14:19.890001+0000","last_peered":"2023-12-07T00:14:19.890001+0000","last_clean":"2023-12-07T00:14:19.890001+0000","last_became_active":"2023-12-07T00:14:14.642709+0000","last_became_peered":"2023-12-07T00:14:14.642709+0000","last_unstale":"2023-12-07T00:14:19.890001+0000","last_undegraded":"2023-12-07T00:14:19.890001+0000","last_fullsized":"2023-12-07T00:14:19.890001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:25:52.844383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274940+0000","last_change":"2023-12-07T00:14:18.672498+0000","last_active":"2023-12-07T00:14:21.274940+0000","last_peered":"2023-12-07T00:14:21.274940+0000","last_clean":"2023-12-07T00:14:21.274940+0000","last_became_active":"2023-12-07T00:14:18.671937+0000","last_became_peered":"2023-12-07T00:14:18.671937+0000","last_unstale":"2023-12-07T00:14:21.274940+0000","last_undegraded":"2023-12-07T00:14:21.274940+0000","last_fullsized":"2023-12-07T00:14:21.274940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:24.753524+0000","last_change":"2023-12-07T00:14:13.637631+0000","last_active":"2023-12-07T00:14:24.753524+0000","last_peered":"2023-12-07T00:14:24.753524+0000","last_clean":"2023-12-07T00:14:24.753524+0000","last_became_active":"2023-12-07T00:14:13.637168+0000","last_became_peered":"2023-12-07T00:14:13.637168+0000","last_unstale":"2023-12-07T00:14:24.753524+0000","last_undegraded":"2023-12-07T00:14:24.753524+0000","last_fullsized":"2023-12-07T00:14:24.753524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:04.965261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890062+0000","last_change":"2023-12-07T00:14:14.650093+0000","last_active":"2023-12-07T00:14:19.890062+0000","last_peered":"2023-12-07T00:14:19.890062+0000","last_clean":"2023-12-07T00:14:19.890062+0000","last_became_active":"2023-12-07T00:14:14.649823+0000","last_became_peered":"2023-12-07T00:14:14.649823+0000","last_unstale":"2023-12-07T00:14:19.890062+0000","last_undegraded":"2023-12-07T00:14:19.890062+0000","last_fullsized":"2023-12-07T00:14:19.890062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367661+0000","last_change":"2023-12-07T00:14:19.071276+0000","last_active":"2023-12-07T00:14:21.367661+0000","last_peered":"2023-12-07T00:14:21.367661+0000","last_clean":"2023-12-07T00:14:21.367661+0000","last_became_active":"2023-12-07T00:14:19.070824+0000","last_became_peered":"2023-12-07T00:14:19.070824+0000","last_unstale":"2023-12-07T00:14:21.367661+0000","last_undegraded":"2023-12-07T00:14:21.367661+0000","last_fullsized":"2023-12-07T00:14:21.367661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:08.025637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888896+0000","last_change":"2023-12-07T00:14:13.631611+0000","last_active":"2023-12-07T00:14:19.888896+0000","last_peered":"2023-12-07T00:14:19.888896+0000","last_clean":"2023-12-07T00:14:19.888896+0000","last_became_active":"2023-12-07T00:14:13.631235+0000","last_became_peered":"2023-12-07T00:14:13.631235+0000","last_unstale":"2023-12-07T00:14:19.888896+0000","last_undegraded":"2023-12-07T00:14:19.888896+0000","last_fullsized":"2023-12-07T00:14:19.888896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:23.927140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889622+0000","last_change":"2023-12-07T00:14:14.644562+0000","last_active":"2023-12-07T00:14:19.889622+0000","last_peered":"2023-12-07T00:14:19.889622+0000","last_clean":"2023-12-07T00:14:19.889622+0000","last_became_active":"2023-12-07T00:14:14.644312+0000","last_became_peered":"2023-12-07T00:14:14.644312+0000","last_unstale":"2023-12-07T00:14:19.889622+0000","last_undegraded":"2023-12-07T00:14:19.889622+0000","last_fullsized":"2023-12-07T00:14:19.889622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:56.516763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367810+0000","last_change":"2023-12-07T00:14:19.070516+0000","last_active":"2023-12-07T00:14:21.367810+0000","last_peered":"2023-12-07T00:14:21.367810+0000","last_clean":"2023-12-07T00:14:21.367810+0000","last_became_active":"2023-12-07T00:14:19.069991+0000","last_became_peered":"2023-12-07T00:14:19.069991+0000","last_unstale":"2023-12-07T00:14:21.367810+0000","last_undegraded":"2023-12-07T00:14:21.367810+0000","last_fullsized":"2023-12-07T00:14:21.367810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:10:44.043162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682934+0000","last_change":"2023-12-07T00:14:13.633584+0000","last_active":"2023-12-07T00:14:19.682934+0000","last_peered":"2023-12-07T00:14:19.682934+0000","last_clean":"2023-12-07T00:14:19.682934+0000","last_became_active":"2023-12-07T00:14:13.633318+0000","last_became_peered":"2023-12-07T00:14:13.633318+0000","last_unstale":"2023-12-07T00:14:19.682934+0000","last_undegraded":"2023-12-07T00:14:19.682934+0000","last_fullsized":"2023-12-07T00:14:19.682934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:27.937653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889684+0000","last_change":"2023-12-07T00:14:14.646779+0000","last_active":"2023-12-07T00:14:19.889684+0000","last_peered":"2023-12-07T00:14:19.889684+0000","last_clean":"2023-12-07T00:14:19.889684+0000","last_became_active":"2023-12-07T00:14:14.646527+0000","last_became_peered":"2023-12-07T00:14:14.646527+0000","last_unstale":"2023-12-07T00:14:19.889684+0000","last_undegraded":"2023-12-07T00:14:19.889684+0000","last_fullsized":"2023-12-07T00:14:19.889684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:27.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367356+0000","last_change":"2023-12-07T00:14:19.073255+0000","last_active":"2023-12-07T00:14:21.367356+0000","last_peered":"2023-12-07T00:14:21.367356+0000","last_clean":"2023-12-07T00:14:21.367356+0000","last_became_active":"2023-12-07T00:14:19.072813+0000","last_became_peered":"2023-12-07T00:14:19.072813+0000","last_unstale":"2023-12-07T00:14:21.367356+0000","last_undegraded":"2023-12-07T00:14:21.367356+0000","last_fullsized":"2023-12-07T00:14:21.367356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:28:56.476351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683628+0000","last_change":"2023-12-07T00:14:13.637391+0000","last_active":"2023-12-07T00:14:19.683628+0000","last_peered":"2023-12-07T00:14:19.683628+0000","last_clean":"2023-12-07T00:14:19.683628+0000","last_became_active":"2023-12-07T00:14:13.636965+0000","last_became_peered":"2023-12-07T00:14:13.636965+0000","last_unstale":"2023-12-07T00:14:19.683628+0000","last_undegraded":"2023-12-07T00:14:19.683628+0000","last_fullsized":"2023-12-07T00:14:19.683628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683105+0000","last_change":"2023-12-07T00:14:14.644444+0000","last_active":"2023-12-07T00:14:19.683105+0000","last_peered":"2023-12-07T00:14:19.683105+0000","last_clean":"2023-12-07T00:14:19.683105+0000","last_became_active":"2023-12-07T00:14:14.644176+0000","last_became_peered":"2023-12-07T00:14:14.644176+0000","last_unstale":"2023-12-07T00:14:19.683105+0000","last_undegraded":"2023-12-07T00:14:19.683105+0000","last_fullsized":"2023-12-07T00:14:19.683105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367421+0000","last_change":"2023-12-07T00:14:18.674600+0000","last_active":"2023-12-07T00:14:21.367421+0000","last_peered":"2023-12-07T00:14:21.367421+0000","last_clean":"2023-12-07T00:14:21.367421+0000","last_became_active":"2023-12-07T00:14:18.674181+0000","last_became_peered":"2023-12-07T00:14:18.674181+0000","last_unstale":"2023-12-07T00:14:21.367421+0000","last_undegraded":"2023-12-07T00:14:21.367421+0000","last_fullsized":"2023-12-07T00:14:21.367421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888243+0000","last_change":"2023-12-07T00:14:13.624390+0000","last_active":"2023-12-07T00:14:19.888243+0000","last_peered":"2023-12-07T00:14:19.888243+0000","last_clean":"2023-12-07T00:14:19.888243+0000","last_became_active":"2023-12-07T00:14:13.624106+0000","last_became_peered":"2023-12-07T00:14:13.624106+0000","last_unstale":"2023-12-07T00:14:19.888243+0000","last_undegraded":"2023-12-07T00:14:19.888243+0000","last_fullsized":"2023-12-07T00:14:19.888243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:20:00.819376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889987+0000","last_change":"2023-12-07T00:14:14.653680+0000","last_active":"2023-12-07T00:14:19.889987+0000","last_peered":"2023-12-07T00:14:19.889987+0000","last_clean":"2023-12-07T00:14:19.889987+0000","last_became_active":"2023-12-07T00:14:14.653401+0000","last_became_peered":"2023-12-07T00:14:14.653401+0000","last_unstale":"2023-12-07T00:14:19.889987+0000","last_undegraded":"2023-12-07T00:14:19.889987+0000","last_fullsized":"2023-12-07T00:14:19.889987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685126+0000","last_change":"2023-12-07T00:14:18.675345+0000","last_active":"2023-12-07T00:14:20.685126+0000","last_peered":"2023-12-07T00:14:20.685126+0000","last_clean":"2023-12-07T00:14:20.685126+0000","last_became_active":"2023-12-07T00:14:18.674896+0000","last_became_peered":"2023-12-07T00:14:18.674896+0000","last_unstale":"2023-12-07T00:14:20.685126+0000","last_undegraded":"2023-12-07T00:14:20.685126+0000","last_fullsized":"2023-12-07T00:14:20.685126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889444+0000","last_change":"2023-12-07T00:14:13.631569+0000","last_active":"2023-12-07T00:14:19.889444+0000","last_peered":"2023-12-07T00:14:19.889444+0000","last_clean":"2023-12-07T00:14:19.889444+0000","last_became_active":"2023-12-07T00:14:13.631324+0000","last_became_peered":"2023-12-07T00:14:13.631324+0000","last_unstale":"2023-12-07T00:14:19.889444+0000","last_undegraded":"2023-12-07T00:14:19.889444+0000","last_fullsized":"2023-12-07T00:14:19.889444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:20.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889942+0000","last_change":"2023-12-07T00:14:14.654814+0000","last_active":"2023-12-07T00:14:19.889942+0000","last_peered":"2023-12-07T00:14:19.889942+0000","last_clean":"2023-12-07T00:14:19.889942+0000","last_became_active":"2023-12-07T00:14:14.654539+0000","last_became_peered":"2023-12-07T00:14:14.654539+0000","last_unstale":"2023-12-07T00:14:19.889942+0000","last_undegraded":"2023-12-07T00:14:19.889942+0000","last_fullsized":"2023-12-07T00:14:19.889942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:32.781991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274758+0000","last_change":"2023-12-07T00:14:18.672450+0000","last_active":"2023-12-07T00:14:21.274758+0000","last_peered":"2023-12-07T00:14:21.274758+0000","last_clean":"2023-12-07T00:14:21.274758+0000","last_became_active":"2023-12-07T00:14:18.671488+0000","last_became_peered":"2023-12-07T00:14:18.671488+0000","last_unstale":"2023-12-07T00:14:21.274758+0000","last_undegraded":"2023-12-07T00:14:21.274758+0000","last_fullsized":"2023-12-07T00:14:21.274758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889341+0000","last_change":"2023-12-07T00:14:13.628825+0000","last_active":"2023-12-07T00:14:19.889341+0000","last_peered":"2023-12-07T00:14:19.889341+0000","last_clean":"2023-12-07T00:14:19.889341+0000","last_became_active":"2023-12-07T00:14:13.628268+0000","last_became_peered":"2023-12-07T00:14:13.628268+0000","last_unstale":"2023-12-07T00:14:19.889341+0000","last_undegraded":"2023-12-07T00:14:19.889341+0000","last_fullsized":"2023-12-07T00:14:19.889341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684300+0000","last_change":"2023-12-07T00:14:14.648381+0000","last_active":"2023-12-07T00:14:19.684300+0000","last_peered":"2023-12-07T00:14:19.684300+0000","last_clean":"2023-12-07T00:14:19.684300+0000","last_became_active":"2023-12-07T00:14:14.647909+0000","last_became_peered":"2023-12-07T00:14:14.647909+0000","last_unstale":"2023-12-07T00:14:19.684300+0000","last_undegraded":"2023-12-07T00:14:19.684300+0000","last_fullsized":"2023-12-07T00:14:19.684300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:24.947977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274850+0000","last_change":"2023-12-07T00:14:18.672792+0000","last_active":"2023-12-07T00:14:21.274850+0000","last_peered":"2023-12-07T00:14:21.274850+0000","last_clean":"2023-12-07T00:14:21.274850+0000","last_became_active":"2023-12-07T00:14:18.672377+0000","last_became_peered":"2023-12-07T00:14:18.672377+0000","last_unstale":"2023-12-07T00:14:21.274850+0000","last_undegraded":"2023-12-07T00:14:21.274850+0000","last_fullsized":"2023-12-07T00:14:21.274850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682851+0000","last_change":"2023-12-07T00:14:13.630678+0000","last_active":"2023-12-07T00:14:19.682851+0000","last_peered":"2023-12-07T00:14:19.682851+0000","last_clean":"2023-12-07T00:14:19.682851+0000","last_became_active":"2023-12-07T00:14:13.630330+0000","last_became_peered":"2023-12-07T00:14:13.630330+0000","last_unstale":"2023-12-07T00:14:19.682851+0000","last_undegraded":"2023-12-07T00:14:19.682851+0000","last_fullsized":"2023-12-07T00:14:19.682851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:39.332777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889755+0000","last_change":"2023-12-07T00:14:14.645768+0000","last_active":"2023-12-07T00:14:19.889755+0000","last_peered":"2023-12-07T00:14:19.889755+0000","last_clean":"2023-12-07T00:14:19.889755+0000","last_became_active":"2023-12-07T00:14:14.645426+0000","last_became_peered":"2023-12-07T00:14:14.645426+0000","last_unstale":"2023-12-07T00:14:19.889755+0000","last_undegraded":"2023-12-07T00:14:19.889755+0000","last_fullsized":"2023-12-07T00:14:19.889755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:24.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.275200+0000","last_change":"2023-12-07T00:14:18.671276+0000","last_active":"2023-12-07T00:14:21.275200+0000","last_peered":"2023-12-07T00:14:21.275200+0000","last_clean":"2023-12-07T00:14:21.275200+0000","last_became_active":"2023-12-07T00:14:18.670847+0000","last_became_peered":"2023-12-07T00:14:18.670847+0000","last_unstale":"2023-12-07T00:14:21.275200+0000","last_undegraded":"2023-12-07T00:14:21.275200+0000","last_fullsized":"2023-12-07T00:14:21.275200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888363+0000","last_change":"2023-12-07T00:14:14.644465+0000","last_active":"2023-12-07T00:14:19.888363+0000","last_peered":"2023-12-07T00:14:19.888363+0000","last_clean":"2023-12-07T00:14:19.888363+0000","last_became_active":"2023-12-07T00:14:14.644158+0000","last_became_peered":"2023-12-07T00:14:14.644158+0000","last_unstale":"2023-12-07T00:14:19.888363+0000","last_undegraded":"2023-12-07T00:14:19.888363+0000","last_fullsized":"2023-12-07T00:14:19.888363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888598+0000","last_change":"2023-12-07T00:14:13.633388+0000","last_active":"2023-12-07T00:14:19.888598+0000","last_peered":"2023-12-07T00:14:19.888598+0000","last_clean":"2023-12-07T00:14:19.888598+0000","last_became_active":"2023-12-07T00:14:13.633091+0000","last_became_peered":"2023-12-07T00:14:13.633091+0000","last_unstale":"2023-12-07T00:14:19.888598+0000","last_undegraded":"2023-12-07T00:14:19.888598+0000","last_fullsized":"2023-12-07T00:14:19.888598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:24:13.479657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.706143+0000","last_change":"2023-12-07T00:14:19.071553+0000","last_active":"2023-12-07T00:14:20.706143+0000","last_peered":"2023-12-07T00:14:20.706143+0000","last_clean":"2023-12-07T00:14:20.706143+0000","last_became_active":"2023-12-07T00:14:19.071152+0000","last_became_peered":"2023-12-07T00:14:19.071152+0000","last_unstale":"2023-12-07T00:14:20.706143+0000","last_undegraded":"2023-12-07T00:14:20.706143+0000","last_fullsized":"2023-12-07T00:14:20.706143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680168+0000","last_change":"2023-12-07T00:14:14.652614+0000","last_active":"2023-12-07T00:14:19.680168+0000","last_peered":"2023-12-07T00:14:19.680168+0000","last_clean":"2023-12-07T00:14:19.680168+0000","last_became_active":"2023-12-07T00:14:14.652330+0000","last_became_peered":"2023-12-07T00:14:14.652330+0000","last_unstale":"2023-12-07T00:14:19.680168+0000","last_undegraded":"2023-12-07T00:14:19.680168+0000","last_fullsized":"2023-12-07T00:14:19.680168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683065+0000","last_change":"2023-12-07T00:14:13.632410+0000","last_active":"2023-12-07T00:14:19.683065+0000","last_peered":"2023-12-07T00:14:19.683065+0000","last_clean":"2023-12-07T00:14:19.683065+0000","last_became_active":"2023-12-07T00:14:13.632131+0000","last_became_peered":"2023-12-07T00:14:13.632131+0000","last_unstale":"2023-12-07T00:14:19.683065+0000","last_undegraded":"2023-12-07T00:14:19.683065+0000","last_fullsized":"2023-12-07T00:14:19.683065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:08.508036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890283+0000","last_change":"2023-12-07T00:14:04.636514+0000","last_active":"2023-12-07T00:14:19.890283+0000","last_peered":"2023-12-07T00:14:19.890283+0000","last_clean":"2023-12-07T00:14:19.890283+0000","last_became_active":"2023-12-07T00:14:04.635540+0000","last_became_peered":"2023-12-07T00:14:04.635540+0000","last_unstale":"2023-12-07T00:14:19.890283+0000","last_undegraded":"2023-12-07T00:14:19.890283+0000","last_fullsized":"2023-12-07T00:14:19.890283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_clean_scrub_stamp":"2023-12-07T00:14:03.541217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:08:01.012662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367559+0000","last_change":"2023-12-07T00:14:19.070256+0000","last_active":"2023-12-07T00:14:21.367559+0000","last_peered":"2023-12-07T00:14:21.367559+0000","last_clean":"2023-12-07T00:14:21.367559+0000","last_became_active":"2023-12-07T00:14:19.069857+0000","last_became_peered":"2023-12-07T00:14:19.069857+0000","last_unstale":"2023-12-07T00:14:21.367559+0000","last_undegraded":"2023-12-07T00:14:21.367559+0000","last_fullsized":"2023-12-07T00:14:21.367559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890041+0000","last_change":"2023-12-07T00:14:14.646599+0000","last_active":"2023-12-07T00:14:19.890041+0000","last_peered":"2023-12-07T00:14:19.890041+0000","last_clean":"2023-12-07T00:14:19.890041+0000","last_became_active":"2023-12-07T00:14:14.646211+0000","last_became_peered":"2023-12-07T00:14:14.646211+0000","last_unstale":"2023-12-07T00:14:19.890041+0000","last_undegraded":"2023-12-07T00:14:19.890041+0000","last_fullsized":"2023-12-07T00:14:19.890041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:05.969623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890386+0000","last_change":"2023-12-07T00:14:13.628132+0000","last_active":"2023-12-07T00:14:19.890386+0000","last_peered":"2023-12-07T00:14:19.890386+0000","last_clean":"2023-12-07T00:14:19.890386+0000","last_became_active":"2023-12-07T00:14:13.627883+0000","last_became_peered":"2023-12-07T00:14:13.627883+0000","last_unstale":"2023-12-07T00:14:19.890386+0000","last_undegraded":"2023-12-07T00:14:19.890386+0000","last_fullsized":"2023-12-07T00:14:19.890386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:08.508036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366914+0000","last_change":"2023-12-07T00:14:19.070287+0000","last_active":"2023-12-07T00:14:21.366914+0000","last_peered":"2023-12-07T00:14:21.366914+0000","last_clean":"2023-12-07T00:14:21.366914+0000","last_became_active":"2023-12-07T00:14:19.069931+0000","last_became_peered":"2023-12-07T00:14:19.069931+0000","last_unstale":"2023-12-07T00:14:21.366914+0000","last_undegraded":"2023-12-07T00:14:21.366914+0000","last_fullsized":"2023-12-07T00:14:21.366914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889775+0000","last_change":"2023-12-07T00:14:13.630867+0000","last_active":"2023-12-07T00:14:19.889775+0000","last_peered":"2023-12-07T00:14:19.889775+0000","last_clean":"2023-12-07T00:14:19.889775+0000","last_became_active":"2023-12-07T00:14:13.630542+0000","last_became_peered":"2023-12-07T00:14:13.630542+0000","last_unstale":"2023-12-07T00:14:19.889775+0000","last_undegraded":"2023-12-07T00:14:19.889775+0000","last_fullsized":"2023-12-07T00:14:19.889775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889492+0000","last_change":"2023-12-07T00:14:14.646636+0000","last_active":"2023-12-07T00:14:19.889492+0000","last_peered":"2023-12-07T00:14:19.889492+0000","last_clean":"2023-12-07T00:14:19.889492+0000","last_became_active":"2023-12-07T00:14:14.645841+0000","last_became_peered":"2023-12-07T00:14:14.645841+0000","last_unstale":"2023-12-07T00:14:19.889492+0000","last_undegraded":"2023-12-07T00:14:19.889492+0000","last_fullsized":"2023-12-07T00:14:19.889492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366975+0000","last_change":"2023-12-07T00:14:19.073292+0000","last_active":"2023-12-07T00:14:21.366975+0000","last_peered":"2023-12-07T00:14:21.366975+0000","last_clean":"2023-12-07T00:14:21.366975+0000","last_became_active":"2023-12-07T00:14:19.072850+0000","last_became_peered":"2023-12-07T00:14:19.072850+0000","last_unstale":"2023-12-07T00:14:21.366975+0000","last_undegraded":"2023-12-07T00:14:21.366975+0000","last_fullsized":"2023-12-07T00:14:21.366975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:35:28.448140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889274+0000","last_change":"2023-12-07T00:14:13.637981+0000","last_active":"2023-12-07T00:14:19.889274+0000","last_peered":"2023-12-07T00:14:19.889274+0000","last_clean":"2023-12-07T00:14:19.889274+0000","last_became_active":"2023-12-07T00:14:13.637648+0000","last_became_peered":"2023-12-07T00:14:13.637648+0000","last_unstale":"2023-12-07T00:14:19.889274+0000","last_undegraded":"2023-12-07T00:14:19.889274+0000","last_fullsized":"2023-12-07T00:14:19.889274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680868+0000","last_change":"2023-12-07T00:14:14.646947+0000","last_active":"2023-12-07T00:14:19.680868+0000","last_peered":"2023-12-07T00:14:19.680868+0000","last_clean":"2023-12-07T00:14:19.680868+0000","last_became_active":"2023-12-07T00:14:14.646649+0000","last_became_peered":"2023-12-07T00:14:14.646649+0000","last_unstale":"2023-12-07T00:14:19.680868+0000","last_undegraded":"2023-12-07T00:14:19.680868+0000","last_fullsized":"2023-12-07T00:14:19.680868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684472+0000","last_change":"2023-12-07T00:14:19.073479+0000","last_active":"2023-12-07T00:14:20.684472+0000","last_peered":"2023-12-07T00:14:20.684472+0000","last_clean":"2023-12-07T00:14:20.684472+0000","last_became_active":"2023-12-07T00:14:19.073084+0000","last_became_peered":"2023-12-07T00:14:19.073084+0000","last_unstale":"2023-12-07T00:14:20.684472+0000","last_undegraded":"2023-12-07T00:14:20.684472+0000","last_fullsized":"2023-12-07T00:14:20.684472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:40.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683778+0000","last_change":"2023-12-07T00:14:13.637916+0000","last_active":"2023-12-07T00:14:19.683778+0000","last_peered":"2023-12-07T00:14:19.683778+0000","last_clean":"2023-12-07T00:14:19.683778+0000","last_became_active":"2023-12-07T00:14:13.637538+0000","last_became_peered":"2023-12-07T00:14:13.637538+0000","last_unstale":"2023-12-07T00:14:19.683778+0000","last_undegraded":"2023-12-07T00:14:19.683778+0000","last_fullsized":"2023-12-07T00:14:19.683778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890503+0000","last_change":"2023-12-07T00:14:14.648223+0000","last_active":"2023-12-07T00:14:19.890503+0000","last_peered":"2023-12-07T00:14:19.890503+0000","last_clean":"2023-12-07T00:14:19.890503+0000","last_became_active":"2023-12-07T00:14:14.647966+0000","last_became_peered":"2023-12-07T00:14:14.647966+0000","last_unstale":"2023-12-07T00:14:19.890503+0000","last_undegraded":"2023-12-07T00:14:19.890503+0000","last_fullsized":"2023-12-07T00:14:19.890503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684860+0000","last_change":"2023-12-07T00:14:18.665311+0000","last_active":"2023-12-07T00:14:20.684860+0000","last_peered":"2023-12-07T00:14:20.684860+0000","last_clean":"2023-12-07T00:14:20.684860+0000","last_became_active":"2023-12-07T00:14:18.664892+0000","last_became_peered":"2023-12-07T00:14:18.664892+0000","last_unstale":"2023-12-07T00:14:20.684860+0000","last_undegraded":"2023-12-07T00:14:20.684860+0000","last_fullsized":"2023-12-07T00:14:20.684860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890458+0000","last_change":"2023-12-07T00:14:13.630986+0000","last_active":"2023-12-07T00:14:19.890458+0000","last_peered":"2023-12-07T00:14:19.890458+0000","last_clean":"2023-12-07T00:14:19.890458+0000","last_became_active":"2023-12-07T00:14:13.630609+0000","last_became_peered":"2023-12-07T00:14:13.630609+0000","last_unstale":"2023-12-07T00:14:19.890458+0000","last_undegraded":"2023-12-07T00:14:19.890458+0000","last_fullsized":"2023-12-07T00:14:19.890458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:53.916550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888978+0000","last_change":"2023-12-07T00:14:14.635608+0000","last_active":"2023-12-07T00:14:19.888978+0000","last_peered":"2023-12-07T00:14:19.888978+0000","last_clean":"2023-12-07T00:14:19.888978+0000","last_became_active":"2023-12-07T00:14:14.635340+0000","last_became_peered":"2023-12-07T00:14:14.635340+0000","last_unstale":"2023-12-07T00:14:19.888978+0000","last_undegraded":"2023-12-07T00:14:19.888978+0000","last_fullsized":"2023-12-07T00:14:19.888978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:54.920912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.275281+0000","last_change":"2023-12-07T00:14:19.071557+0000","last_active":"2023-12-07T00:14:21.275281+0000","last_peered":"2023-12-07T00:14:21.275281+0000","last_clean":"2023-12-07T00:14:21.275281+0000","last_became_active":"2023-12-07T00:14:19.071128+0000","last_became_peered":"2023-12-07T00:14:19.071128+0000","last_unstale":"2023-12-07T00:14:21.275281+0000","last_undegraded":"2023-12-07T00:14:21.275281+0000","last_fullsized":"2023-12-07T00:14:21.275281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:53:14.211329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888538+0000","last_change":"2023-12-07T00:14:13.629382+0000","last_active":"2023-12-07T00:14:19.888538+0000","last_peered":"2023-12-07T00:14:19.888538+0000","last_clean":"2023-12-07T00:14:19.888538+0000","last_became_active":"2023-12-07T00:14:13.629097+0000","last_became_peered":"2023-12-07T00:14:13.629097+0000","last_unstale":"2023-12-07T00:14:19.888538+0000","last_undegraded":"2023-12-07T00:14:19.888538+0000","last_fullsized":"2023-12-07T00:14:19.888538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:23.927140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679917+0000","last_change":"2023-12-07T00:14:14.655117+0000","last_active":"2023-12-07T00:14:19.679917+0000","last_peered":"2023-12-07T00:14:19.679917+0000","last_clean":"2023-12-07T00:14:19.679917+0000","last_became_active":"2023-12-07T00:14:14.652105+0000","last_became_peered":"2023-12-07T00:14:14.652105+0000","last_unstale":"2023-12-07T00:14:19.679917+0000","last_undegraded":"2023-12-07T00:14:19.679917+0000","last_fullsized":"2023-12-07T00:14:19.679917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685032+0000","last_change":"2023-12-07T00:14:18.665600+0000","last_active":"2023-12-07T00:14:20.685032+0000","last_peered":"2023-12-07T00:14:20.685032+0000","last_clean":"2023-12-07T00:14:20.685032+0000","last_became_active":"2023-12-07T00:14:18.664901+0000","last_became_peered":"2023-12-07T00:14:18.664901+0000","last_unstale":"2023-12-07T00:14:20.685032+0000","last_undegraded":"2023-12-07T00:14:20.685032+0000","last_fullsized":"2023-12-07T00:14:20.685032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889054+0000","last_change":"2023-12-07T00:14:13.633312+0000","last_active":"2023-12-07T00:14:19.889054+0000","last_peered":"2023-12-07T00:14:19.889054+0000","last_clean":"2023-12-07T00:14:19.889054+0000","last_became_active":"2023-12-07T00:14:13.633034+0000","last_became_peered":"2023-12-07T00:14:13.633034+0000","last_unstale":"2023-12-07T00:14:19.889054+0000","last_undegraded":"2023-12-07T00:14:19.889054+0000","last_fullsized":"2023-12-07T00:14:19.889054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:04.965261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680317+0000","last_change":"2023-12-07T00:14:14.655550+0000","last_active":"2023-12-07T00:14:19.680317+0000","last_peered":"2023-12-07T00:14:19.680317+0000","last_clean":"2023-12-07T00:14:19.680317+0000","last_became_active":"2023-12-07T00:14:14.651780+0000","last_became_peered":"2023-12-07T00:14:14.651780+0000","last_unstale":"2023-12-07T00:14:19.680317+0000","last_undegraded":"2023-12-07T00:14:19.680317+0000","last_fullsized":"2023-12-07T00:14:19.680317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685294+0000","last_change":"2023-12-07T00:14:18.669658+0000","last_active":"2023-12-07T00:14:20.685294+0000","last_peered":"2023-12-07T00:14:20.685294+0000","last_clean":"2023-12-07T00:14:20.685294+0000","last_became_active":"2023-12-07T00:14:18.669258+0000","last_became_peered":"2023-12-07T00:14:18.669258+0000","last_unstale":"2023-12-07T00:14:20.685294+0000","last_undegraded":"2023-12-07T00:14:20.685294+0000","last_fullsized":"2023-12-07T00:14:20.685294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890157+0000","last_change":"2023-12-07T00:14:13.634671+0000","last_active":"2023-12-07T00:14:19.890157+0000","last_peered":"2023-12-07T00:14:19.890157+0000","last_clean":"2023-12-07T00:14:19.890157+0000","last_became_active":"2023-12-07T00:14:13.634416+0000","last_became_peered":"2023-12-07T00:14:13.634416+0000","last_unstale":"2023-12-07T00:14:19.890157+0000","last_undegraded":"2023-12-07T00:14:19.890157+0000","last_fullsized":"2023-12-07T00:14:19.890157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:15.155566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683669+0000","last_change":"2023-12-07T00:14:14.646535+0000","last_active":"2023-12-07T00:14:19.683669+0000","last_peered":"2023-12-07T00:14:19.683669+0000","last_clean":"2023-12-07T00:14:19.683669+0000","last_became_active":"2023-12-07T00:14:14.646262+0000","last_became_peered":"2023-12-07T00:14:14.646262+0000","last_unstale":"2023-12-07T00:14:19.683669+0000","last_undegraded":"2023-12-07T00:14:19.683669+0000","last_fullsized":"2023-12-07T00:14:19.683669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.705879+0000","last_change":"2023-12-07T00:14:19.070666+0000","last_active":"2023-12-07T00:14:20.705879+0000","last_peered":"2023-12-07T00:14:20.705879+0000","last_clean":"2023-12-07T00:14:20.705879+0000","last_became_active":"2023-12-07T00:14:19.070102+0000","last_became_peered":"2023-12-07T00:14:19.070102+0000","last_unstale":"2023-12-07T00:14:20.705879+0000","last_undegraded":"2023-12-07T00:14:20.705879+0000","last_fullsized":"2023-12-07T00:14:20.705879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:40.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888826+0000","last_change":"2023-12-07T00:14:13.630742+0000","last_active":"2023-12-07T00:14:19.888826+0000","last_peered":"2023-12-07T00:14:19.888826+0000","last_clean":"2023-12-07T00:14:19.888826+0000","last_became_active":"2023-12-07T00:14:13.630467+0000","last_became_peered":"2023-12-07T00:14:13.630467+0000","last_unstale":"2023-12-07T00:14:19.888826+0000","last_undegraded":"2023-12-07T00:14:19.888826+0000","last_fullsized":"2023-12-07T00:14:19.888826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:53.916550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889980+0000","last_change":"2023-12-07T00:14:14.649293+0000","last_active":"2023-12-07T00:14:19.889980+0000","last_peered":"2023-12-07T00:14:19.889980+0000","last_clean":"2023-12-07T00:14:19.889980+0000","last_became_active":"2023-12-07T00:14:14.649021+0000","last_became_peered":"2023-12-07T00:14:14.649021+0000","last_unstale":"2023-12-07T00:14:19.889980+0000","last_undegraded":"2023-12-07T00:14:19.889980+0000","last_fullsized":"2023-12-07T00:14:19.889980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:16.080287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366749+0000","last_change":"2023-12-07T00:14:18.669575+0000","last_active":"2023-12-07T00:14:21.366749+0000","last_peered":"2023-12-07T00:14:21.366749+0000","last_clean":"2023-12-07T00:14:21.366749+0000","last_became_active":"2023-12-07T00:14:18.669100+0000","last_became_peered":"2023-12-07T00:14:18.669100+0000","last_unstale":"2023-12-07T00:14:21.366749+0000","last_undegraded":"2023-12-07T00:14:21.366749+0000","last_fullsized":"2023-12-07T00:14:21.366749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889422+0000","last_change":"2023-12-07T00:14:13.629136+0000","last_active":"2023-12-07T00:14:19.889422+0000","last_peered":"2023-12-07T00:14:19.889422+0000","last_clean":"2023-12-07T00:14:19.889422+0000","last_became_active":"2023-12-07T00:14:13.628827+0000","last_became_peered":"2023-12-07T00:14:13.628827+0000","last_unstale":"2023-12-07T00:14:19.889422+0000","last_undegraded":"2023-12-07T00:14:19.889422+0000","last_fullsized":"2023-12-07T00:14:19.889422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683381+0000","last_change":"2023-12-07T00:14:14.647552+0000","last_active":"2023-12-07T00:14:19.683381+0000","last_peered":"2023-12-07T00:14:19.683381+0000","last_clean":"2023-12-07T00:14:19.683381+0000","last_became_active":"2023-12-07T00:14:14.647247+0000","last_became_peered":"2023-12-07T00:14:14.647247+0000","last_unstale":"2023-12-07T00:14:19.683381+0000","last_undegraded":"2023-12-07T00:14:19.683381+0000","last_fullsized":"2023-12-07T00:14:19.683381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367215+0000","last_change":"2023-12-07T00:14:19.073305+0000","last_active":"2023-12-07T00:14:21.367215+0000","last_peered":"2023-12-07T00:14:21.367215+0000","last_clean":"2023-12-07T00:14:21.367215+0000","last_became_active":"2023-12-07T00:14:19.072907+0000","last_became_peered":"2023-12-07T00:14:19.072907+0000","last_unstale":"2023-12-07T00:14:21.367215+0000","last_undegraded":"2023-12-07T00:14:21.367215+0000","last_fullsized":"2023-12-07T00:14:21.367215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:53:14.211329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889029+0000","last_change":"2023-12-07T00:14:13.626391+0000","last_active":"2023-12-07T00:14:19.889029+0000","last_peered":"2023-12-07T00:14:19.889029+0000","last_clean":"2023-12-07T00:14:19.889029+0000","last_became_active":"2023-12-07T00:14:13.626017+0000","last_became_peered":"2023-12-07T00:14:13.626017+0000","last_unstale":"2023-12-07T00:14:19.889029+0000","last_undegraded":"2023-12-07T00:14:19.889029+0000","last_fullsized":"2023-12-07T00:14:19.889029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:02:04.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890256+0000","last_change":"2023-12-07T00:14:14.647419+0000","last_active":"2023-12-07T00:14:19.890256+0000","last_peered":"2023-12-07T00:14:19.890256+0000","last_clean":"2023-12-07T00:14:19.890256+0000","last_became_active":"2023-12-07T00:14:14.647169+0000","last_became_peered":"2023-12-07T00:14:14.647169+0000","last_unstale":"2023-12-07T00:14:19.890256+0000","last_undegraded":"2023-12-07T00:14:19.890256+0000","last_fullsized":"2023-12-07T00:14:19.890256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:36.710499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683191+0000","last_change":"2023-12-07T00:14:14.643376+0000","last_active":"2023-12-07T00:14:19.683191+0000","last_peered":"2023-12-07T00:14:19.683191+0000","last_clean":"2023-12-07T00:14:19.683191+0000","last_became_active":"2023-12-07T00:14:14.643090+0000","last_became_peered":"2023-12-07T00:14:14.643090+0000","last_unstale":"2023-12-07T00:14:19.683191+0000","last_undegraded":"2023-12-07T00:14:19.683191+0000","last_fullsized":"2023-12-07T00:14:19.683191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888376+0000","last_change":"2023-12-07T00:14:14.639433+0000","last_active":"2023-12-07T00:14:19.888376+0000","last_peered":"2023-12-07T00:14:19.888376+0000","last_clean":"2023-12-07T00:14:19.888376+0000","last_became_active":"2023-12-07T00:14:14.639177+0000","last_became_peered":"2023-12-07T00:14:14.639177+0000","last_unstale":"2023-12-07T00:14:19.888376+0000","last_undegraded":"2023-12-07T00:14:19.888376+0000","last_fullsized":"2023-12-07T00:14:19.888376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:09.512398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682993+0000","last_change":"2023-12-07T00:14:14.647105+0000","last_active":"2023-12-07T00:14:19.682993+0000","last_peered":"2023-12-07T00:14:19.682993+0000","last_clean":"2023-12-07T00:14:19.682993+0000","last_became_active":"2023-12-07T00:14:14.646811+0000","last_became_peered":"2023-12-07T00:14:14.646811+0000","last_unstale":"2023-12-07T00:14:19.682993+0000","last_undegraded":"2023-12-07T00:14:19.682993+0000","last_fullsized":"2023-12-07T00:14:19.682993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:27.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889051+0000","last_change":"2023-12-07T00:14:14.658213+0000","last_active":"2023-12-07T00:14:19.889051+0000","last_peered":"2023-12-07T00:14:19.889051+0000","last_clean":"2023-12-07T00:14:19.889051+0000","last_became_active":"2023-12-07T00:14:14.657944+0000","last_became_peered":"2023-12-07T00:14:14.657944+0000","last_unstale":"2023-12-07T00:14:19.889051+0000","last_undegraded":"2023-12-07T00:14:19.889051+0000","last_fullsized":"2023-12-07T00:14:19.889051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680455+0000","last_change":"2023-12-07T00:14:14.650342+0000","last_active":"2023-12-07T00:14:19.680455+0000","last_peered":"2023-12-07T00:14:19.680455+0000","last_clean":"2023-12-07T00:14:19.680455+0000","last_became_active":"2023-12-07T00:14:14.650042+0000","last_became_peered":"2023-12-07T00:14:14.650042+0000","last_unstale":"2023-12-07T00:14:19.680455+0000","last_undegraded":"2023-12-07T00:14:19.680455+0000","last_fullsized":"2023-12-07T00:14:19.680455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889376+0000","last_change":"2023-12-07T00:14:14.649194+0000","last_active":"2023-12-07T00:14:19.889376+0000","last_peered":"2023-12-07T00:14:19.889376+0000","last_clean":"2023-12-07T00:14:19.889376+0000","last_became_active":"2023-12-07T00:14:14.648929+0000","last_became_peered":"2023-12-07T00:14:14.648929+0000","last_unstale":"2023-12-07T00:14:19.889376+0000","last_undegraded":"2023-12-07T00:14:19.889376+0000","last_fullsized":"2023-12-07T00:14:19.889376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683509+0000","last_change":"2023-12-07T00:14:14.643466+0000","last_active":"2023-12-07T00:14:19.683509+0000","last_peered":"2023-12-07T00:14:19.683509+0000","last_clean":"2023-12-07T00:14:19.683509+0000","last_became_active":"2023-12-07T00:14:14.643195+0000","last_became_peered":"2023-12-07T00:14:14.643195+0000","last_unstale":"2023-12-07T00:14:19.683509+0000","last_undegraded":"2023-12-07T00:14:19.683509+0000","last_fullsized":"2023-12-07T00:14:19.683509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680917+0000","last_change":"2023-12-07T00:14:14.647201+0000","last_active":"2023-12-07T00:14:19.680917+0000","last_peered":"2023-12-07T00:14:19.680917+0000","last_clean":"2023-12-07T00:14:19.680917+0000","last_became_active":"2023-12-07T00:14:14.646844+0000","last_became_peered":"2023-12-07T00:14:14.646844+0000","last_unstale":"2023-12-07T00:14:19.680917+0000","last_undegraded":"2023-12-07T00:14:19.680917+0000","last_fullsized":"2023-12-07T00:14:19.680917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682760+0000","last_change":"2023-12-07T00:14:14.652468+0000","last_active":"2023-12-07T00:14:19.682760+0000","last_peered":"2023-12-07T00:14:19.682760+0000","last_clean":"2023-12-07T00:14:19.682760+0000","last_became_active":"2023-12-07T00:14:14.652125+0000","last_became_peered":"2023-12-07T00:14:14.652125+0000","last_unstale":"2023-12-07T00:14:19.682760+0000","last_undegraded":"2023-12-07T00:14:19.682760+0000","last_fullsized":"2023-12-07T00:14:19.682760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680075+0000","last_change":"2023-12-07T00:14:14.646216+0000","last_active":"2023-12-07T00:14:19.680075+0000","last_peered":"2023-12-07T00:14:19.680075+0000","last_clean":"2023-12-07T00:14:19.680075+0000","last_became_active":"2023-12-07T00:14:14.645667+0000","last_became_peered":"2023-12-07T00:14:14.645667+0000","last_unstale":"2023-12-07T00:14:19.680075+0000","last_undegraded":"2023-12-07T00:14:19.680075+0000","last_fullsized":"2023-12-07T00:14:19.680075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683019+0000","last_change":"2023-12-07T00:14:14.643268+0000","last_active":"2023-12-07T00:14:19.683019+0000","last_peered":"2023-12-07T00:14:19.683019+0000","last_clean":"2023-12-07T00:14:19.683019+0000","last_became_active":"2023-12-07T00:14:14.642911+0000","last_became_peered":"2023-12-07T00:14:14.642911+0000","last_unstale":"2023-12-07T00:14:19.683019+0000","last_undegraded":"2023-12-07T00:14:19.683019+0000","last_fullsized":"2023-12-07T00:14:19.683019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889125+0000","last_change":"2023-12-07T00:14:14.654077+0000","last_active":"2023-12-07T00:14:19.889125+0000","last_peered":"2023-12-07T00:14:19.889125+0000","last_clean":"2023-12-07T00:14:19.889125+0000","last_became_active":"2023-12-07T00:14:14.653784+0000","last_became_peered":"2023-12-07T00:14:14.653784+0000","last_unstale":"2023-12-07T00:14:19.889125+0000","last_undegraded":"2023-12-07T00:14:19.889125+0000","last_fullsized":"2023-12-07T00:14:19.889125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:14.081556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683657+0000","last_change":"2023-12-07T00:14:14.647010+0000","last_active":"2023-12-07T00:14:19.683657+0000","last_peered":"2023-12-07T00:14:19.683657+0000","last_clean":"2023-12-07T00:14:19.683657+0000","last_became_active":"2023-12-07T00:14:14.646731+0000","last_became_peered":"2023-12-07T00:14:14.646731+0000","last_unstale":"2023-12-07T00:14:19.683657+0000","last_undegraded":"2023-12-07T00:14:19.683657+0000","last_fullsized":"2023-12-07T00:14:19.683657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":707149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":116359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":897024,"data_stored":707205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":116325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":116289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T00:14:37.464 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T00:14:37.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.620+0000 7f6683e76700 1 Processor -- start 2023-12-07T00:14:37.619 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.620+0000 7f6683e76700 1 -- start start 2023-12-07T00:14:37.621 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6683e76700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f667c0d0070 0x7f667c0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6683e76700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 0x7f667c0ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6683e76700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c0673b0 con 0x7f667c066ef0 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6683e76700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0b04a0 con 0x7f667c0d0070 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6683e76700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c15e440 con 0x7f667c0ad0d0 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6681411700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f667c066ef0 0x7f667c0d0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46606/0 (socket says 172.21.15.179:46606) 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6681411700 1 -- 172.21.15.179:0/1391049343 learned_addr learned my addr 172.21.15.179:0/1391049343 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6681c12700 1 --2- 172.21.15.179:0/1391049343 >> v2:172.21.15.190:3300/0 conn(0x7f667c0d0070 0x7f667c0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6682413700 1 --2- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 0x7f667c0ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6680c10700 1 -- 172.21.15.179:0/1391049343 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958999831 0 0) 0x7f667c0673b0 con 0x7f667c066ef0 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6680c10700 1 -- 172.21.15.179:0/1391049343 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66680035b0 con 0x7f667c066ef0 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6681c12700 1 -- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 msgr2=0x7f667c0ad580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6681c12700 1 --2- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 0x7f667c0ad580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6681c12700 1 -- 172.21.15.179:0/1391049343 >> v1:172.21.15.179:6789/0 conn(0x7f667c066ef0 legacy=0x7f667c0d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6681c12700 1 -- 172.21.15.179:0/1391049343 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c0afb00 con 0x7f667c0d0070 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.621+0000 7f6682413700 1 --2- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 0x7f667c0ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6681c12700 1 --2- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667c0d0070 0x7f667c0b3c50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6678009840 tx=0x7f6678009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=396bfc7a5b6a691c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6680c10700 1 -- 172.21.15.179:0/1391049343 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678011830 con 0x7f667c0d0070 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6680c10700 1 -- 172.21.15.179:0/1391049343 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678011990 con 0x7f667c0d0070 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6680c10700 1 -- 172.21.15.179:0/1391049343 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678011d20 con 0x7f667c0d0070 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6683e76700 1 -- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667c0d0070 msgr2=0x7f667c0b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6683e76700 1 --2- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667c0d0070 0x7f667c0b3c50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6678009840 tx=0x7f6678009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6683e76700 1 -- 172.21.15.179:0/1391049343 shutdown_connections 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6683e76700 1 --2- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 0x7f667c0ad580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6683e76700 1 --2- 172.21.15.179:0/1391049343 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667c0d0070 0x7f667c0b3c50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6683e76700 1 -- 172.21.15.179:0/1391049343 >> 172.21.15.179:0/1391049343 conn(0x7f667c072660 msgr2=0x7f667c0b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6683e76700 1 -- 172.21.15.179:0/1391049343 shutdown_connections 2023-12-07T00:14:37.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.622+0000 7f6683e76700 1 -- 172.21.15.179:0/1391049343 wait complete. 2023-12-07T00:14:37.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6683e76700 1 Processor -- start 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6683e76700 1 -- start start 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6683e76700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f667c066ef0 0x7f667c143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6683e76700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 0x7f667c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6683e76700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667c0d0070 0x7f667c1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6683e76700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c0cfc80 con 0x7f667c066ef0 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6683e76700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1440e0 con 0x7f667c0d0070 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6683e76700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c159880 con 0x7f667c0ad0d0 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6681c12700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f667c066ef0 0x7f667c143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6681c12700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f667c066ef0 0x7f667c143ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39710/0 (socket says 172.21.15.179:39710) 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.624+0000 7f6681c12700 1 -- 172.21.15.179:0/3163398809 learned_addr learned my addr 172.21.15.179:0/3163398809 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f6681c12700 1 -- 172.21.15.179:0/3163398809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 msgr2=0x7f667c0cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f6681c12700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 0x7f667c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f6681c12700 1 -- 172.21.15.179:0/3163398809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667c0d0070 msgr2=0x7f667c1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f6681c12700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667c0d0070 0x7f667c1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f6681c12700 1 -- 172.21.15.179:0/3163398809 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674009a70 con 0x7f667c066ef0 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f6681c12700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f667c066ef0 0x7f667c143ba0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6678009790 tx=0x7f6678004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f66727fc700 1 -- 172.21.15.179:0/3163398809 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66780036a0 con 0x7f667c066ef0 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f66727fc700 1 -- 172.21.15.179:0/3163398809 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667801e070 con 0x7f667c066ef0 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f66727fc700 1 -- 172.21.15.179:0/3163398809 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678003a20 con 0x7f667c066ef0 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66780094a0 con 0x7f667c066ef0 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.625+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c159230 con 0x7f667c066ef0 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.626+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c0685f0 con 0x7f667c066ef0 2023-12-07T00:14:37.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.627+0000 7f66727fc700 1 -- 172.21.15.179:0/3163398809 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6678003b80 con 0x7f667c066ef0 2023-12-07T00:14:37.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.627+0000 7f66727fc700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f666006aed0 0x7f666006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:37.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.627+0000 7f66727fc700 1 -- 172.21.15.179:0/3163398809 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f667808ac40 con 0x7f667c066ef0 2023-12-07T00:14:37.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.627+0000 7f6681411700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f666006aed0 0x7f666006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:37.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.627+0000 7f6681411700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f666006aed0 0x7f666006d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f667c14a9f0 tx=0x7f666c0079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:37.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.631+0000 7f66727fc700 1 -- 172.21.15.179:0/3163398809 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6678055a90 con 0x7f667c066ef0 2023-12-07T00:14:37.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.816+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 --> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f667c067570 con 0x7f666006aed0 2023-12-07T00:14:37.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.825+0000 7f66727fc700 1 -- 172.21.15.179:0/3163398809 <== mgr.4104 v2:172.21.15.179:6832/1592863421 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345286 (secure 0 0 0) 0x7f667c067570 con 0x7f666006aed0 2023-12-07T00:14:37.828 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:37.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.828+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f666006aed0 msgr2=0x7f666006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.828+0000 7f6683e76700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f666006aed0 0x7f666006d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f667c14a9f0 tx=0x7f666c0079c0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f667c066ef0 msgr2=0x7f667c143ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f667c066ef0 0x7f667c143ba0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6678009790 tx=0x7f6678004750 comp rx=0 tx=0).stop 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 shutdown_connections 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f666006aed0 0x7f666006d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f667c0d0070 0x7f667c1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f667c066ef0 0x7f667c143ba0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 --2- 172.21.15.179:0/3163398809 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f667c0ad0d0 0x7f667c0cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 >> 172.21.15.179:0/3163398809 conn(0x7f667c072660 msgr2=0x7f667c0d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 shutdown_connections 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:37.829+0000 7f6683e76700 1 -- 172.21.15.179:0/3163398809 wait complete. 2023-12-07T00:14:37.832 INFO:teuthology.orchestra.run.smithi179.stderr:dumped all 2023-12-07T00:14:37.840 INFO:teuthology.orchestra.run.smithi179.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-12-07T00:14:36.518933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3579904,"data_stored":2119604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2228,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003342"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890228+0000","last_change":"2023-12-07T00:14:14.643199+0000","last_active":"2023-12-07T00:14:19.890228+0000","last_peered":"2023-12-07T00:14:19.890228+0000","last_clean":"2023-12-07T00:14:19.890228+0000","last_became_active":"2023-12-07T00:14:14.642929+0000","last_became_peered":"2023-12-07T00:14:14.642929+0000","last_unstale":"2023-12-07T00:14:19.890228+0000","last_undegraded":"2023-12-07T00:14:19.890228+0000","last_fullsized":"2023-12-07T00:14:19.890228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:20:09.627523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889353+0000","last_change":"2023-12-07T00:14:14.644949+0000","last_active":"2023-12-07T00:14:19.889353+0000","last_peered":"2023-12-07T00:14:19.889353+0000","last_clean":"2023-12-07T00:14:19.889353+0000","last_became_active":"2023-12-07T00:14:14.644679+0000","last_became_peered":"2023-12-07T00:14:14.644679+0000","last_unstale":"2023-12-07T00:14:19.889353+0000","last_undegraded":"2023-12-07T00:14:19.889353+0000","last_fullsized":"2023-12-07T00:14:19.889353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889573+0000","last_change":"2023-12-07T00:14:14.645513+0000","last_active":"2023-12-07T00:14:19.889573+0000","last_peered":"2023-12-07T00:14:19.889573+0000","last_clean":"2023-12-07T00:14:19.889573+0000","last_became_active":"2023-12-07T00:14:14.645261+0000","last_became_peered":"2023-12-07T00:14:14.645261+0000","last_unstale":"2023-12-07T00:14:19.889573+0000","last_undegraded":"2023-12-07T00:14:19.889573+0000","last_fullsized":"2023-12-07T00:14:19.889573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683459+0000","last_change":"2023-12-07T00:14:14.646952+0000","last_active":"2023-12-07T00:14:19.683459+0000","last_peered":"2023-12-07T00:14:19.683459+0000","last_clean":"2023-12-07T00:14:19.683459+0000","last_became_active":"2023-12-07T00:14:14.646645+0000","last_became_peered":"2023-12-07T00:14:14.646645+0000","last_unstale":"2023-12-07T00:14:19.683459+0000","last_undegraded":"2023-12-07T00:14:19.683459+0000","last_fullsized":"2023-12-07T00:14:19.683459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889608+0000","last_change":"2023-12-07T00:14:14.645840+0000","last_active":"2023-12-07T00:14:19.889608+0000","last_peered":"2023-12-07T00:14:19.889608+0000","last_clean":"2023-12-07T00:14:19.889608+0000","last_became_active":"2023-12-07T00:14:14.645226+0000","last_became_peered":"2023-12-07T00:14:14.645226+0000","last_unstale":"2023-12-07T00:14:19.889608+0000","last_undegraded":"2023-12-07T00:14:19.889608+0000","last_fullsized":"2023-12-07T00:14:19.889608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:24.947977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683090+0000","last_change":"2023-12-07T00:14:14.642310+0000","last_active":"2023-12-07T00:14:19.683090+0000","last_peered":"2023-12-07T00:14:19.683090+0000","last_clean":"2023-12-07T00:14:19.683090+0000","last_became_active":"2023-12-07T00:14:14.642041+0000","last_became_peered":"2023-12-07T00:14:14.642041+0000","last_unstale":"2023-12-07T00:14:19.683090+0000","last_undegraded":"2023-12-07T00:14:19.683090+0000","last_fullsized":"2023-12-07T00:14:19.683090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:20:09.627523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889514+0000","last_change":"2023-12-07T00:14:14.651174+0000","last_active":"2023-12-07T00:14:19.889514+0000","last_peered":"2023-12-07T00:14:19.889514+0000","last_clean":"2023-12-07T00:14:19.889514+0000","last_became_active":"2023-12-07T00:14:14.650891+0000","last_became_peered":"2023-12-07T00:14:14.650891+0000","last_unstale":"2023-12-07T00:14:19.889514+0000","last_undegraded":"2023-12-07T00:14:19.889514+0000","last_fullsized":"2023-12-07T00:14:19.889514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680378+0000","last_change":"2023-12-07T00:14:14.651410+0000","last_active":"2023-12-07T00:14:19.680378+0000","last_peered":"2023-12-07T00:14:19.680378+0000","last_clean":"2023-12-07T00:14:19.680378+0000","last_became_active":"2023-12-07T00:14:14.651150+0000","last_became_peered":"2023-12-07T00:14:14.651150+0000","last_unstale":"2023-12-07T00:14:19.680378+0000","last_undegraded":"2023-12-07T00:14:19.680378+0000","last_fullsized":"2023-12-07T00:14:19.680378+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890130+0000","last_change":"2023-12-07T00:14:14.649568+0000","last_active":"2023-12-07T00:14:19.890130+0000","last_peered":"2023-12-07T00:14:19.890130+0000","last_clean":"2023-12-07T00:14:19.890130+0000","last_became_active":"2023-12-07T00:14:14.649226+0000","last_became_peered":"2023-12-07T00:14:14.649226+0000","last_unstale":"2023-12-07T00:14:19.890130+0000","last_undegraded":"2023-12-07T00:14:19.890130+0000","last_fullsized":"2023-12-07T00:14:19.890130+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683413+0000","last_change":"2023-12-07T00:14:14.641982+0000","last_active":"2023-12-07T00:14:19.683413+0000","last_peered":"2023-12-07T00:14:19.683413+0000","last_clean":"2023-12-07T00:14:19.683413+0000","last_became_active":"2023-12-07T00:14:14.641635+0000","last_became_peered":"2023-12-07T00:14:14.641635+0000","last_unstale":"2023-12-07T00:14:19.683413+0000","last_undegraded":"2023-12-07T00:14:19.683413+0000","last_fullsized":"2023-12-07T00:14:19.683413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683349+0000","last_change":"2023-12-07T00:14:14.641705+0000","last_active":"2023-12-07T00:14:19.683349+0000","last_peered":"2023-12-07T00:14:19.683349+0000","last_clean":"2023-12-07T00:14:19.683349+0000","last_became_active":"2023-12-07T00:14:14.640554+0000","last_became_peered":"2023-12-07T00:14:14.640554+0000","last_unstale":"2023-12-07T00:14:19.683349+0000","last_undegraded":"2023-12-07T00:14:19.683349+0000","last_fullsized":"2023-12-07T00:14:19.683349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890100+0000","last_change":"2023-12-07T00:14:14.638208+0000","last_active":"2023-12-07T00:14:19.890100+0000","last_peered":"2023-12-07T00:14:19.890100+0000","last_clean":"2023-12-07T00:14:19.890100+0000","last_became_active":"2023-12-07T00:14:14.637940+0000","last_became_peered":"2023-12-07T00:14:14.637940+0000","last_unstale":"2023-12-07T00:14:19.890100+0000","last_undegraded":"2023-12-07T00:14:19.890100+0000","last_fullsized":"2023-12-07T00:14:19.890100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:09.512398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680049+0000","last_change":"2023-12-07T00:14:14.655710+0000","last_active":"2023-12-07T00:14:19.680049+0000","last_peered":"2023-12-07T00:14:19.680049+0000","last_clean":"2023-12-07T00:14:19.680049+0000","last_became_active":"2023-12-07T00:14:14.652457+0000","last_became_peered":"2023-12-07T00:14:14.652457+0000","last_unstale":"2023-12-07T00:14:19.680049+0000","last_undegraded":"2023-12-07T00:14:19.680049+0000","last_fullsized":"2023-12-07T00:14:19.680049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889539+0000","last_change":"2023-12-07T00:14:14.654290+0000","last_active":"2023-12-07T00:14:19.889539+0000","last_peered":"2023-12-07T00:14:19.889539+0000","last_clean":"2023-12-07T00:14:19.889539+0000","last_became_active":"2023-12-07T00:14:14.654021+0000","last_became_peered":"2023-12-07T00:14:14.654021+0000","last_unstale":"2023-12-07T00:14:19.889539+0000","last_undegraded":"2023-12-07T00:14:19.889539+0000","last_fullsized":"2023-12-07T00:14:19.889539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:18.698925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888456+0000","last_change":"2023-12-07T00:14:14.646526+0000","last_active":"2023-12-07T00:14:19.888456+0000","last_peered":"2023-12-07T00:14:19.888456+0000","last_clean":"2023-12-07T00:14:19.888456+0000","last_became_active":"2023-12-07T00:14:14.646114+0000","last_became_peered":"2023-12-07T00:14:14.646114+0000","last_unstale":"2023-12-07T00:14:19.888456+0000","last_undegraded":"2023-12-07T00:14:19.888456+0000","last_fullsized":"2023-12-07T00:14:19.888456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682644+0000","last_change":"2023-12-07T00:14:14.642157+0000","last_active":"2023-12-07T00:14:19.682644+0000","last_peered":"2023-12-07T00:14:19.682644+0000","last_clean":"2023-12-07T00:14:19.682644+0000","last_became_active":"2023-12-07T00:14:14.641857+0000","last_became_peered":"2023-12-07T00:14:14.641857+0000","last_unstale":"2023-12-07T00:14:19.682644+0000","last_undegraded":"2023-12-07T00:14:19.682644+0000","last_fullsized":"2023-12-07T00:14:19.682644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684069+0000","last_change":"2023-12-07T00:14:14.643563+0000","last_active":"2023-12-07T00:14:19.684069+0000","last_peered":"2023-12-07T00:14:19.684069+0000","last_clean":"2023-12-07T00:14:19.684069+0000","last_became_active":"2023-12-07T00:14:14.643055+0000","last_became_peered":"2023-12-07T00:14:14.643055+0000","last_unstale":"2023-12-07T00:14:19.684069+0000","last_undegraded":"2023-12-07T00:14:19.684069+0000","last_fullsized":"2023-12-07T00:14:19.684069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:36.710499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889136+0000","last_change":"2023-12-07T00:14:14.636014+0000","last_active":"2023-12-07T00:14:19.889136+0000","last_peered":"2023-12-07T00:14:19.889136+0000","last_clean":"2023-12-07T00:14:19.889136+0000","last_became_active":"2023-12-07T00:14:14.635717+0000","last_became_peered":"2023-12-07T00:14:14.635717+0000","last_unstale":"2023-12-07T00:14:19.889136+0000","last_undegraded":"2023-12-07T00:14:19.889136+0000","last_fullsized":"2023-12-07T00:14:19.889136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:24.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890290+0000","last_change":"2023-12-07T00:14:14.645014+0000","last_active":"2023-12-07T00:14:19.890290+0000","last_peered":"2023-12-07T00:14:19.890290+0000","last_clean":"2023-12-07T00:14:19.890290+0000","last_became_active":"2023-12-07T00:14:14.644738+0000","last_became_peered":"2023-12-07T00:14:14.644738+0000","last_unstale":"2023-12-07T00:14:19.890290+0000","last_undegraded":"2023-12-07T00:14:19.890290+0000","last_fullsized":"2023-12-07T00:14:19.890290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367254+0000","last_change":"2023-12-07T00:14:19.076496+0000","last_active":"2023-12-07T00:14:21.367254+0000","last_peered":"2023-12-07T00:14:21.367254+0000","last_clean":"2023-12-07T00:14:21.367254+0000","last_became_active":"2023-12-07T00:14:19.076104+0000","last_became_peered":"2023-12-07T00:14:19.076104+0000","last_unstale":"2023-12-07T00:14:21.367254+0000","last_undegraded":"2023-12-07T00:14:21.367254+0000","last_fullsized":"2023-12-07T00:14:21.367254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:19:30.998083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889786+0000","last_change":"2023-12-07T00:14:13.630530+0000","last_active":"2023-12-07T00:14:19.889786+0000","last_peered":"2023-12-07T00:14:19.889786+0000","last_clean":"2023-12-07T00:14:19.889786+0000","last_became_active":"2023-12-07T00:14:13.630248+0000","last_became_peered":"2023-12-07T00:14:13.630248+0000","last_unstale":"2023-12-07T00:14:19.889786+0000","last_undegraded":"2023-12-07T00:14:19.889786+0000","last_fullsized":"2023-12-07T00:14:19.889786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680935+0000","last_change":"2023-12-07T00:14:14.650100+0000","last_active":"2023-12-07T00:14:19.680935+0000","last_peered":"2023-12-07T00:14:19.680935+0000","last_clean":"2023-12-07T00:14:19.680935+0000","last_became_active":"2023-12-07T00:14:14.649807+0000","last_became_peered":"2023-12-07T00:14:14.649807+0000","last_unstale":"2023-12-07T00:14:19.680935+0000","last_undegraded":"2023-12-07T00:14:19.680935+0000","last_fullsized":"2023-12-07T00:14:19.680935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684337+0000","last_change":"2023-12-07T00:14:18.665602+0000","last_active":"2023-12-07T00:14:20.684337+0000","last_peered":"2023-12-07T00:14:20.684337+0000","last_clean":"2023-12-07T00:14:20.684337+0000","last_became_active":"2023-12-07T00:14:18.665065+0000","last_became_peered":"2023-12-07T00:14:18.665065+0000","last_unstale":"2023-12-07T00:14:20.684337+0000","last_undegraded":"2023-12-07T00:14:20.684337+0000","last_fullsized":"2023-12-07T00:14:20.684337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:28.978624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680641+0000","last_change":"2023-12-07T00:14:13.635320+0000","last_active":"2023-12-07T00:14:19.680641+0000","last_peered":"2023-12-07T00:14:19.680641+0000","last_clean":"2023-12-07T00:14:19.680641+0000","last_became_active":"2023-12-07T00:14:13.635008+0000","last_became_peered":"2023-12-07T00:14:13.635008+0000","last_unstale":"2023-12-07T00:14:19.680641+0000","last_undegraded":"2023-12-07T00:14:19.680641+0000","last_fullsized":"2023-12-07T00:14:19.680641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:17.694563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889743+0000","last_change":"2023-12-07T00:14:14.642235+0000","last_active":"2023-12-07T00:14:19.889743+0000","last_peered":"2023-12-07T00:14:19.889743+0000","last_clean":"2023-12-07T00:14:19.889743+0000","last_became_active":"2023-12-07T00:14:14.641920+0000","last_became_peered":"2023-12-07T00:14:14.641920+0000","last_unstale":"2023-12-07T00:14:19.889743+0000","last_undegraded":"2023-12-07T00:14:19.889743+0000","last_fullsized":"2023-12-07T00:14:19.889743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684737+0000","last_change":"2023-12-07T00:14:18.665909+0000","last_active":"2023-12-07T00:14:20.684737+0000","last_peered":"2023-12-07T00:14:20.684737+0000","last_clean":"2023-12-07T00:14:20.684737+0000","last_became_active":"2023-12-07T00:14:18.665195+0000","last_became_peered":"2023-12-07T00:14:18.665195+0000","last_unstale":"2023-12-07T00:14:20.684737+0000","last_undegraded":"2023-12-07T00:14:20.684737+0000","last_fullsized":"2023-12-07T00:14:20.684737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:36.812638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889883+0000","last_change":"2023-12-07T00:14:13.639070+0000","last_active":"2023-12-07T00:14:19.889883+0000","last_peered":"2023-12-07T00:14:19.889883+0000","last_clean":"2023-12-07T00:14:19.889883+0000","last_became_active":"2023-12-07T00:14:13.638806+0000","last_became_peered":"2023-12-07T00:14:13.638806+0000","last_unstale":"2023-12-07T00:14:19.889883+0000","last_undegraded":"2023-12-07T00:14:19.889883+0000","last_fullsized":"2023-12-07T00:14:19.889883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:01:17.694563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683306+0000","last_change":"2023-12-07T00:14:14.638446+0000","last_active":"2023-12-07T00:14:19.683306+0000","last_peered":"2023-12-07T00:14:19.683306+0000","last_clean":"2023-12-07T00:14:19.683306+0000","last_became_active":"2023-12-07T00:14:14.638158+0000","last_became_peered":"2023-12-07T00:14:14.638158+0000","last_unstale":"2023-12-07T00:14:19.683306+0000","last_undegraded":"2023-12-07T00:14:19.683306+0000","last_fullsized":"2023-12-07T00:14:19.683306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684589+0000","last_change":"2023-12-07T00:14:18.669676+0000","last_active":"2023-12-07T00:14:20.684589+0000","last_peered":"2023-12-07T00:14:20.684589+0000","last_clean":"2023-12-07T00:14:20.684589+0000","last_became_active":"2023-12-07T00:14:18.669279+0000","last_became_peered":"2023-12-07T00:14:18.669279+0000","last_unstale":"2023-12-07T00:14:20.684589+0000","last_undegraded":"2023-12-07T00:14:20.684589+0000","last_fullsized":"2023-12-07T00:14:20.684589+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:31.897202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889817+0000","last_change":"2023-12-07T00:14:13.635829+0000","last_active":"2023-12-07T00:14:19.889817+0000","last_peered":"2023-12-07T00:14:19.889817+0000","last_clean":"2023-12-07T00:14:19.889817+0000","last_became_active":"2023-12-07T00:14:13.635554+0000","last_became_peered":"2023-12-07T00:14:13.635554+0000","last_unstale":"2023-12-07T00:14:19.889817+0000","last_undegraded":"2023-12-07T00:14:19.889817+0000","last_fullsized":"2023-12-07T00:14:19.889817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684138+0000","last_change":"2023-12-07T00:14:14.638063+0000","last_active":"2023-12-07T00:14:19.684138+0000","last_peered":"2023-12-07T00:14:19.684138+0000","last_clean":"2023-12-07T00:14:19.684138+0000","last_became_active":"2023-12-07T00:14:14.637766+0000","last_became_peered":"2023-12-07T00:14:14.637766+0000","last_unstale":"2023-12-07T00:14:19.684138+0000","last_undegraded":"2023-12-07T00:14:19.684138+0000","last_fullsized":"2023-12-07T00:14:19.684138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367970+0000","last_change":"2023-12-07T00:14:18.668124+0000","last_active":"2023-12-07T00:14:21.367970+0000","last_peered":"2023-12-07T00:14:21.367970+0000","last_clean":"2023-12-07T00:14:21.367970+0000","last_became_active":"2023-12-07T00:14:18.667677+0000","last_became_peered":"2023-12-07T00:14:18.667677+0000","last_unstale":"2023-12-07T00:14:21.367970+0000","last_undegraded":"2023-12-07T00:14:21.367970+0000","last_fullsized":"2023-12-07T00:14:21.367970+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:29:46.330072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680292+0000","last_change":"2023-12-07T00:14:13.639589+0000","last_active":"2023-12-07T00:14:19.680292+0000","last_peered":"2023-12-07T00:14:19.680292+0000","last_clean":"2023-12-07T00:14:19.680292+0000","last_became_active":"2023-12-07T00:14:13.639315+0000","last_became_peered":"2023-12-07T00:14:13.639315+0000","last_unstale":"2023-12-07T00:14:19.680292+0000","last_undegraded":"2023-12-07T00:14:19.680292+0000","last_fullsized":"2023-12-07T00:14:19.680292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889199+0000","last_change":"2023-12-07T00:14:14.638371+0000","last_active":"2023-12-07T00:14:19.889199+0000","last_peered":"2023-12-07T00:14:19.889199+0000","last_clean":"2023-12-07T00:14:19.889199+0000","last_became_active":"2023-12-07T00:14:14.638090+0000","last_became_peered":"2023-12-07T00:14:14.638090+0000","last_unstale":"2023-12-07T00:14:19.889199+0000","last_undegraded":"2023-12-07T00:14:19.889199+0000","last_fullsized":"2023-12-07T00:14:19.889199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:02:05.622336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.681229+0000","last_change":"2023-12-07T00:14:18.667960+0000","last_active":"2023-12-07T00:14:20.681229+0000","last_peered":"2023-12-07T00:14:20.681229+0000","last_clean":"2023-12-07T00:14:20.681229+0000","last_became_active":"2023-12-07T00:14:18.667569+0000","last_became_peered":"2023-12-07T00:14:18.667569+0000","last_unstale":"2023-12-07T00:14:20.681229+0000","last_undegraded":"2023-12-07T00:14:20.681229+0000","last_fullsized":"2023-12-07T00:14:20.681229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:18.112203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683017+0000","last_change":"2023-12-07T00:14:13.637477+0000","last_active":"2023-12-07T00:14:19.683017+0000","last_peered":"2023-12-07T00:14:19.683017+0000","last_clean":"2023-12-07T00:14:19.683017+0000","last_became_active":"2023-12-07T00:14:13.637044+0000","last_became_peered":"2023-12-07T00:14:13.637044+0000","last_unstale":"2023-12-07T00:14:19.683017+0000","last_undegraded":"2023-12-07T00:14:19.683017+0000","last_fullsized":"2023-12-07T00:14:19.683017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888973+0000","last_change":"2023-12-07T00:14:14.648736+0000","last_active":"2023-12-07T00:14:19.888973+0000","last_peered":"2023-12-07T00:14:19.888973+0000","last_clean":"2023-12-07T00:14:19.888973+0000","last_became_active":"2023-12-07T00:14:14.648449+0000","last_became_peered":"2023-12-07T00:14:14.648449+0000","last_unstale":"2023-12-07T00:14:19.888973+0000","last_undegraded":"2023-12-07T00:14:19.888973+0000","last_fullsized":"2023-12-07T00:14:19.888973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.706104+0000","last_change":"2023-12-07T00:14:18.671310+0000","last_active":"2023-12-07T00:14:20.706104+0000","last_peered":"2023-12-07T00:14:20.706104+0000","last_clean":"2023-12-07T00:14:20.706104+0000","last_became_active":"2023-12-07T00:14:18.670905+0000","last_became_peered":"2023-12-07T00:14:18.670905+0000","last_unstale":"2023-12-07T00:14:20.706104+0000","last_undegraded":"2023-12-07T00:14:20.706104+0000","last_fullsized":"2023-12-07T00:14:20.706104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:36.812638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679983+0000","last_change":"2023-12-07T00:14:13.636864+0000","last_active":"2023-12-07T00:14:19.679983+0000","last_peered":"2023-12-07T00:14:19.679983+0000","last_clean":"2023-12-07T00:14:19.679983+0000","last_became_active":"2023-12-07T00:14:13.636497+0000","last_became_peered":"2023-12-07T00:14:13.636497+0000","last_unstale":"2023-12-07T00:14:19.679983+0000","last_undegraded":"2023-12-07T00:14:19.679983+0000","last_fullsized":"2023-12-07T00:14:19.679983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679793+0000","last_change":"2023-12-07T00:14:14.647211+0000","last_active":"2023-12-07T00:14:19.679793+0000","last_peered":"2023-12-07T00:14:19.679793+0000","last_clean":"2023-12-07T00:14:19.679793+0000","last_became_active":"2023-12-07T00:14:14.646890+0000","last_became_peered":"2023-12-07T00:14:14.646890+0000","last_unstale":"2023-12-07T00:14:19.679793+0000","last_undegraded":"2023-12-07T00:14:19.679793+0000","last_fullsized":"2023-12-07T00:14:19.679793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:54:55.492437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367712+0000","last_change":"2023-12-07T00:14:19.073249+0000","last_active":"2023-12-07T00:14:21.367712+0000","last_peered":"2023-12-07T00:14:21.367712+0000","last_clean":"2023-12-07T00:14:21.367712+0000","last_became_active":"2023-12-07T00:14:19.072757+0000","last_became_peered":"2023-12-07T00:14:19.072757+0000","last_unstale":"2023-12-07T00:14:21.367712+0000","last_undegraded":"2023-12-07T00:14:21.367712+0000","last_fullsized":"2023-12-07T00:14:21.367712+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684347+0000","last_change":"2023-12-07T00:14:13.630879+0000","last_active":"2023-12-07T00:14:19.684347+0000","last_peered":"2023-12-07T00:14:19.684347+0000","last_clean":"2023-12-07T00:14:19.684347+0000","last_became_active":"2023-12-07T00:14:13.630299+0000","last_became_peered":"2023-12-07T00:14:13.630299+0000","last_unstale":"2023-12-07T00:14:19.684347+0000","last_undegraded":"2023-12-07T00:14:19.684347+0000","last_fullsized":"2023-12-07T00:14:19.684347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888694+0000","last_change":"2023-12-07T00:14:14.651244+0000","last_active":"2023-12-07T00:14:19.888694+0000","last_peered":"2023-12-07T00:14:19.888694+0000","last_clean":"2023-12-07T00:14:19.888694+0000","last_became_active":"2023-12-07T00:14:14.650996+0000","last_became_peered":"2023-12-07T00:14:14.650996+0000","last_unstale":"2023-12-07T00:14:19.888694+0000","last_undegraded":"2023-12-07T00:14:19.888694+0000","last_fullsized":"2023-12-07T00:14:19.888694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367059+0000","last_change":"2023-12-07T00:14:19.073306+0000","last_active":"2023-12-07T00:14:21.367059+0000","last_peered":"2023-12-07T00:14:21.367059+0000","last_clean":"2023-12-07T00:14:21.367059+0000","last_became_active":"2023-12-07T00:14:19.072870+0000","last_became_peered":"2023-12-07T00:14:19.072870+0000","last_unstale":"2023-12-07T00:14:21.367059+0000","last_undegraded":"2023-12-07T00:14:21.367059+0000","last_fullsized":"2023-12-07T00:14:21.367059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:02:29.749218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683882+0000","last_change":"2023-12-07T00:14:13.636919+0000","last_active":"2023-12-07T00:14:19.683882+0000","last_peered":"2023-12-07T00:14:19.683882+0000","last_clean":"2023-12-07T00:14:19.683882+0000","last_became_active":"2023-12-07T00:14:13.636581+0000","last_became_peered":"2023-12-07T00:14:13.636581+0000","last_unstale":"2023-12-07T00:14:19.683882+0000","last_undegraded":"2023-12-07T00:14:19.683882+0000","last_fullsized":"2023-12-07T00:14:19.683882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683788+0000","last_change":"2023-12-07T00:14:14.644313+0000","last_active":"2023-12-07T00:14:19.683788+0000","last_peered":"2023-12-07T00:14:19.683788+0000","last_clean":"2023-12-07T00:14:19.683788+0000","last_became_active":"2023-12-07T00:14:14.643846+0000","last_became_peered":"2023-12-07T00:14:14.643846+0000","last_unstale":"2023-12-07T00:14:19.683788+0000","last_undegraded":"2023-12-07T00:14:19.683788+0000","last_fullsized":"2023-12-07T00:14:19.683788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:59:58.831084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367087+0000","last_change":"2023-12-07T00:14:18.664942+0000","last_active":"2023-12-07T00:14:21.367087+0000","last_peered":"2023-12-07T00:14:21.367087+0000","last_clean":"2023-12-07T00:14:21.367087+0000","last_became_active":"2023-12-07T00:14:18.664530+0000","last_became_peered":"2023-12-07T00:14:18.664530+0000","last_unstale":"2023-12-07T00:14:21.367087+0000","last_undegraded":"2023-12-07T00:14:21.367087+0000","last_fullsized":"2023-12-07T00:14:21.367087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:50:31.696056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683699+0000","last_change":"2023-12-07T00:14:13.638292+0000","last_active":"2023-12-07T00:14:19.683699+0000","last_peered":"2023-12-07T00:14:19.683699+0000","last_clean":"2023-12-07T00:14:19.683699+0000","last_became_active":"2023-12-07T00:14:13.637982+0000","last_became_peered":"2023-12-07T00:14:13.637982+0000","last_unstale":"2023-12-07T00:14:19.683699+0000","last_undegraded":"2023-12-07T00:14:19.683699+0000","last_fullsized":"2023-12-07T00:14:19.683699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889880+0000","last_change":"2023-12-07T00:14:14.649013+0000","last_active":"2023-12-07T00:14:19.889880+0000","last_peered":"2023-12-07T00:14:19.889880+0000","last_clean":"2023-12-07T00:14:19.889880+0000","last_became_active":"2023-12-07T00:14:14.648768+0000","last_became_peered":"2023-12-07T00:14:14.648768+0000","last_unstale":"2023-12-07T00:14:19.889880+0000","last_undegraded":"2023-12-07T00:14:19.889880+0000","last_fullsized":"2023-12-07T00:14:19.889880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685363+0000","last_change":"2023-12-07T00:14:18.661970+0000","last_active":"2023-12-07T00:14:20.685363+0000","last_peered":"2023-12-07T00:14:20.685363+0000","last_clean":"2023-12-07T00:14:20.685363+0000","last_became_active":"2023-12-07T00:14:18.661509+0000","last_became_peered":"2023-12-07T00:14:18.661509+0000","last_unstale":"2023-12-07T00:14:20.685363+0000","last_undegraded":"2023-12-07T00:14:20.685363+0000","last_fullsized":"2023-12-07T00:14:20.685363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889467+0000","last_change":"2023-12-07T00:14:13.632679+0000","last_active":"2023-12-07T00:14:19.889467+0000","last_peered":"2023-12-07T00:14:19.889467+0000","last_clean":"2023-12-07T00:14:19.889467+0000","last_became_active":"2023-12-07T00:14:13.632414+0000","last_became_peered":"2023-12-07T00:14:13.632414+0000","last_unstale":"2023-12-07T00:14:19.889467+0000","last_undegraded":"2023-12-07T00:14:19.889467+0000","last_fullsized":"2023-12-07T00:14:19.889467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890001+0000","last_change":"2023-12-07T00:14:14.643589+0000","last_active":"2023-12-07T00:14:19.890001+0000","last_peered":"2023-12-07T00:14:19.890001+0000","last_clean":"2023-12-07T00:14:19.890001+0000","last_became_active":"2023-12-07T00:14:14.642709+0000","last_became_peered":"2023-12-07T00:14:14.642709+0000","last_unstale":"2023-12-07T00:14:19.890001+0000","last_undegraded":"2023-12-07T00:14:19.890001+0000","last_fullsized":"2023-12-07T00:14:19.890001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:25:52.844383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274940+0000","last_change":"2023-12-07T00:14:18.672498+0000","last_active":"2023-12-07T00:14:21.274940+0000","last_peered":"2023-12-07T00:14:21.274940+0000","last_clean":"2023-12-07T00:14:21.274940+0000","last_became_active":"2023-12-07T00:14:18.671937+0000","last_became_peered":"2023-12-07T00:14:18.671937+0000","last_unstale":"2023-12-07T00:14:21.274940+0000","last_undegraded":"2023-12-07T00:14:21.274940+0000","last_fullsized":"2023-12-07T00:14:21.274940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:24.753524+0000","last_change":"2023-12-07T00:14:13.637631+0000","last_active":"2023-12-07T00:14:24.753524+0000","last_peered":"2023-12-07T00:14:24.753524+0000","last_clean":"2023-12-07T00:14:24.753524+0000","last_became_active":"2023-12-07T00:14:13.637168+0000","last_became_peered":"2023-12-07T00:14:13.637168+0000","last_unstale":"2023-12-07T00:14:24.753524+0000","last_undegraded":"2023-12-07T00:14:24.753524+0000","last_fullsized":"2023-12-07T00:14:24.753524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:04.965261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890062+0000","last_change":"2023-12-07T00:14:14.650093+0000","last_active":"2023-12-07T00:14:19.890062+0000","last_peered":"2023-12-07T00:14:19.890062+0000","last_clean":"2023-12-07T00:14:19.890062+0000","last_became_active":"2023-12-07T00:14:14.649823+0000","last_became_peered":"2023-12-07T00:14:14.649823+0000","last_unstale":"2023-12-07T00:14:19.890062+0000","last_undegraded":"2023-12-07T00:14:19.890062+0000","last_fullsized":"2023-12-07T00:14:19.890062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367661+0000","last_change":"2023-12-07T00:14:19.071276+0000","last_active":"2023-12-07T00:14:21.367661+0000","last_peered":"2023-12-07T00:14:21.367661+0000","last_clean":"2023-12-07T00:14:21.367661+0000","last_became_active":"2023-12-07T00:14:19.070824+0000","last_became_peered":"2023-12-07T00:14:19.070824+0000","last_unstale":"2023-12-07T00:14:21.367661+0000","last_undegraded":"2023-12-07T00:14:21.367661+0000","last_fullsized":"2023-12-07T00:14:21.367661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:08.025637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888896+0000","last_change":"2023-12-07T00:14:13.631611+0000","last_active":"2023-12-07T00:14:19.888896+0000","last_peered":"2023-12-07T00:14:19.888896+0000","last_clean":"2023-12-07T00:14:19.888896+0000","last_became_active":"2023-12-07T00:14:13.631235+0000","last_became_peered":"2023-12-07T00:14:13.631235+0000","last_unstale":"2023-12-07T00:14:19.888896+0000","last_undegraded":"2023-12-07T00:14:19.888896+0000","last_fullsized":"2023-12-07T00:14:19.888896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:23.927140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889622+0000","last_change":"2023-12-07T00:14:14.644562+0000","last_active":"2023-12-07T00:14:19.889622+0000","last_peered":"2023-12-07T00:14:19.889622+0000","last_clean":"2023-12-07T00:14:19.889622+0000","last_became_active":"2023-12-07T00:14:14.644312+0000","last_became_peered":"2023-12-07T00:14:14.644312+0000","last_unstale":"2023-12-07T00:14:19.889622+0000","last_undegraded":"2023-12-07T00:14:19.889622+0000","last_fullsized":"2023-12-07T00:14:19.889622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:56.516763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367810+0000","last_change":"2023-12-07T00:14:19.070516+0000","last_active":"2023-12-07T00:14:21.367810+0000","last_peered":"2023-12-07T00:14:21.367810+0000","last_clean":"2023-12-07T00:14:21.367810+0000","last_became_active":"2023-12-07T00:14:19.069991+0000","last_became_peered":"2023-12-07T00:14:19.069991+0000","last_unstale":"2023-12-07T00:14:21.367810+0000","last_undegraded":"2023-12-07T00:14:21.367810+0000","last_fullsized":"2023-12-07T00:14:21.367810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:10:44.043162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682934+0000","last_change":"2023-12-07T00:14:13.633584+0000","last_active":"2023-12-07T00:14:19.682934+0000","last_peered":"2023-12-07T00:14:19.682934+0000","last_clean":"2023-12-07T00:14:19.682934+0000","last_became_active":"2023-12-07T00:14:13.633318+0000","last_became_peered":"2023-12-07T00:14:13.633318+0000","last_unstale":"2023-12-07T00:14:19.682934+0000","last_undegraded":"2023-12-07T00:14:19.682934+0000","last_fullsized":"2023-12-07T00:14:19.682934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:27.937653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889684+0000","last_change":"2023-12-07T00:14:14.646779+0000","last_active":"2023-12-07T00:14:19.889684+0000","last_peered":"2023-12-07T00:14:19.889684+0000","last_clean":"2023-12-07T00:14:19.889684+0000","last_became_active":"2023-12-07T00:14:14.646527+0000","last_became_peered":"2023-12-07T00:14:14.646527+0000","last_unstale":"2023-12-07T00:14:19.889684+0000","last_undegraded":"2023-12-07T00:14:19.889684+0000","last_fullsized":"2023-12-07T00:14:19.889684+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:27.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367356+0000","last_change":"2023-12-07T00:14:19.073255+0000","last_active":"2023-12-07T00:14:21.367356+0000","last_peered":"2023-12-07T00:14:21.367356+0000","last_clean":"2023-12-07T00:14:21.367356+0000","last_became_active":"2023-12-07T00:14:19.072813+0000","last_became_peered":"2023-12-07T00:14:19.072813+0000","last_unstale":"2023-12-07T00:14:21.367356+0000","last_undegraded":"2023-12-07T00:14:21.367356+0000","last_fullsized":"2023-12-07T00:14:21.367356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:28:56.476351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683628+0000","last_change":"2023-12-07T00:14:13.637391+0000","last_active":"2023-12-07T00:14:19.683628+0000","last_peered":"2023-12-07T00:14:19.683628+0000","last_clean":"2023-12-07T00:14:19.683628+0000","last_became_active":"2023-12-07T00:14:13.636965+0000","last_became_peered":"2023-12-07T00:14:13.636965+0000","last_unstale":"2023-12-07T00:14:19.683628+0000","last_undegraded":"2023-12-07T00:14:19.683628+0000","last_fullsized":"2023-12-07T00:14:19.683628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683105+0000","last_change":"2023-12-07T00:14:14.644444+0000","last_active":"2023-12-07T00:14:19.683105+0000","last_peered":"2023-12-07T00:14:19.683105+0000","last_clean":"2023-12-07T00:14:19.683105+0000","last_became_active":"2023-12-07T00:14:14.644176+0000","last_became_peered":"2023-12-07T00:14:14.644176+0000","last_unstale":"2023-12-07T00:14:19.683105+0000","last_undegraded":"2023-12-07T00:14:19.683105+0000","last_fullsized":"2023-12-07T00:14:19.683105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367421+0000","last_change":"2023-12-07T00:14:18.674600+0000","last_active":"2023-12-07T00:14:21.367421+0000","last_peered":"2023-12-07T00:14:21.367421+0000","last_clean":"2023-12-07T00:14:21.367421+0000","last_became_active":"2023-12-07T00:14:18.674181+0000","last_became_peered":"2023-12-07T00:14:18.674181+0000","last_unstale":"2023-12-07T00:14:21.367421+0000","last_undegraded":"2023-12-07T00:14:21.367421+0000","last_fullsized":"2023-12-07T00:14:21.367421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888243+0000","last_change":"2023-12-07T00:14:13.624390+0000","last_active":"2023-12-07T00:14:19.888243+0000","last_peered":"2023-12-07T00:14:19.888243+0000","last_clean":"2023-12-07T00:14:19.888243+0000","last_became_active":"2023-12-07T00:14:13.624106+0000","last_became_peered":"2023-12-07T00:14:13.624106+0000","last_unstale":"2023-12-07T00:14:19.888243+0000","last_undegraded":"2023-12-07T00:14:19.888243+0000","last_fullsized":"2023-12-07T00:14:19.888243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:20:00.819376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889987+0000","last_change":"2023-12-07T00:14:14.653680+0000","last_active":"2023-12-07T00:14:19.889987+0000","last_peered":"2023-12-07T00:14:19.889987+0000","last_clean":"2023-12-07T00:14:19.889987+0000","last_became_active":"2023-12-07T00:14:14.653401+0000","last_became_peered":"2023-12-07T00:14:14.653401+0000","last_unstale":"2023-12-07T00:14:19.889987+0000","last_undegraded":"2023-12-07T00:14:19.889987+0000","last_fullsized":"2023-12-07T00:14:19.889987+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685126+0000","last_change":"2023-12-07T00:14:18.675345+0000","last_active":"2023-12-07T00:14:20.685126+0000","last_peered":"2023-12-07T00:14:20.685126+0000","last_clean":"2023-12-07T00:14:20.685126+0000","last_became_active":"2023-12-07T00:14:18.674896+0000","last_became_peered":"2023-12-07T00:14:18.674896+0000","last_unstale":"2023-12-07T00:14:20.685126+0000","last_undegraded":"2023-12-07T00:14:20.685126+0000","last_fullsized":"2023-12-07T00:14:20.685126+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889444+0000","last_change":"2023-12-07T00:14:13.631569+0000","last_active":"2023-12-07T00:14:19.889444+0000","last_peered":"2023-12-07T00:14:19.889444+0000","last_clean":"2023-12-07T00:14:19.889444+0000","last_became_active":"2023-12-07T00:14:13.631324+0000","last_became_peered":"2023-12-07T00:14:13.631324+0000","last_unstale":"2023-12-07T00:14:19.889444+0000","last_undegraded":"2023-12-07T00:14:19.889444+0000","last_fullsized":"2023-12-07T00:14:19.889444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:20.439658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889942+0000","last_change":"2023-12-07T00:14:14.654814+0000","last_active":"2023-12-07T00:14:19.889942+0000","last_peered":"2023-12-07T00:14:19.889942+0000","last_clean":"2023-12-07T00:14:19.889942+0000","last_became_active":"2023-12-07T00:14:14.654539+0000","last_became_peered":"2023-12-07T00:14:14.654539+0000","last_unstale":"2023-12-07T00:14:19.889942+0000","last_undegraded":"2023-12-07T00:14:19.889942+0000","last_fullsized":"2023-12-07T00:14:19.889942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:43:32.781991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274758+0000","last_change":"2023-12-07T00:14:18.672450+0000","last_active":"2023-12-07T00:14:21.274758+0000","last_peered":"2023-12-07T00:14:21.274758+0000","last_clean":"2023-12-07T00:14:21.274758+0000","last_became_active":"2023-12-07T00:14:18.671488+0000","last_became_peered":"2023-12-07T00:14:18.671488+0000","last_unstale":"2023-12-07T00:14:21.274758+0000","last_undegraded":"2023-12-07T00:14:21.274758+0000","last_fullsized":"2023-12-07T00:14:21.274758+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889341+0000","last_change":"2023-12-07T00:14:13.628825+0000","last_active":"2023-12-07T00:14:19.889341+0000","last_peered":"2023-12-07T00:14:19.889341+0000","last_clean":"2023-12-07T00:14:19.889341+0000","last_became_active":"2023-12-07T00:14:13.628268+0000","last_became_peered":"2023-12-07T00:14:13.628268+0000","last_unstale":"2023-12-07T00:14:19.889341+0000","last_undegraded":"2023-12-07T00:14:19.889341+0000","last_fullsized":"2023-12-07T00:14:19.889341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:21:33.857655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.684300+0000","last_change":"2023-12-07T00:14:14.648381+0000","last_active":"2023-12-07T00:14:19.684300+0000","last_peered":"2023-12-07T00:14:19.684300+0000","last_clean":"2023-12-07T00:14:19.684300+0000","last_became_active":"2023-12-07T00:14:14.647909+0000","last_became_peered":"2023-12-07T00:14:14.647909+0000","last_unstale":"2023-12-07T00:14:19.684300+0000","last_undegraded":"2023-12-07T00:14:19.684300+0000","last_fullsized":"2023-12-07T00:14:19.684300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:30:24.947977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.274850+0000","last_change":"2023-12-07T00:14:18.672792+0000","last_active":"2023-12-07T00:14:21.274850+0000","last_peered":"2023-12-07T00:14:21.274850+0000","last_clean":"2023-12-07T00:14:21.274850+0000","last_became_active":"2023-12-07T00:14:18.672377+0000","last_became_peered":"2023-12-07T00:14:18.672377+0000","last_unstale":"2023-12-07T00:14:21.274850+0000","last_undegraded":"2023-12-07T00:14:21.274850+0000","last_fullsized":"2023-12-07T00:14:21.274850+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:41:34.976951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682851+0000","last_change":"2023-12-07T00:14:13.630678+0000","last_active":"2023-12-07T00:14:19.682851+0000","last_peered":"2023-12-07T00:14:19.682851+0000","last_clean":"2023-12-07T00:14:19.682851+0000","last_became_active":"2023-12-07T00:14:13.630330+0000","last_became_peered":"2023-12-07T00:14:13.630330+0000","last_unstale":"2023-12-07T00:14:19.682851+0000","last_undegraded":"2023-12-07T00:14:19.682851+0000","last_fullsized":"2023-12-07T00:14:19.682851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:39.332777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889755+0000","last_change":"2023-12-07T00:14:14.645768+0000","last_active":"2023-12-07T00:14:19.889755+0000","last_peered":"2023-12-07T00:14:19.889755+0000","last_clean":"2023-12-07T00:14:19.889755+0000","last_became_active":"2023-12-07T00:14:14.645426+0000","last_became_peered":"2023-12-07T00:14:14.645426+0000","last_unstale":"2023-12-07T00:14:19.889755+0000","last_undegraded":"2023-12-07T00:14:19.889755+0000","last_fullsized":"2023-12-07T00:14:19.889755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:24.931502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.275200+0000","last_change":"2023-12-07T00:14:18.671276+0000","last_active":"2023-12-07T00:14:21.275200+0000","last_peered":"2023-12-07T00:14:21.275200+0000","last_clean":"2023-12-07T00:14:21.275200+0000","last_became_active":"2023-12-07T00:14:18.670847+0000","last_became_peered":"2023-12-07T00:14:18.670847+0000","last_unstale":"2023-12-07T00:14:21.275200+0000","last_undegraded":"2023-12-07T00:14:21.275200+0000","last_fullsized":"2023-12-07T00:14:21.275200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:49:22.926024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888363+0000","last_change":"2023-12-07T00:14:14.644465+0000","last_active":"2023-12-07T00:14:19.888363+0000","last_peered":"2023-12-07T00:14:19.888363+0000","last_clean":"2023-12-07T00:14:19.888363+0000","last_became_active":"2023-12-07T00:14:14.644158+0000","last_became_peered":"2023-12-07T00:14:14.644158+0000","last_unstale":"2023-12-07T00:14:19.888363+0000","last_undegraded":"2023-12-07T00:14:19.888363+0000","last_fullsized":"2023-12-07T00:14:19.888363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888598+0000","last_change":"2023-12-07T00:14:13.633388+0000","last_active":"2023-12-07T00:14:19.888598+0000","last_peered":"2023-12-07T00:14:19.888598+0000","last_clean":"2023-12-07T00:14:19.888598+0000","last_became_active":"2023-12-07T00:14:13.633091+0000","last_became_peered":"2023-12-07T00:14:13.633091+0000","last_unstale":"2023-12-07T00:14:19.888598+0000","last_undegraded":"2023-12-07T00:14:19.888598+0000","last_fullsized":"2023-12-07T00:14:19.888598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:24:13.479657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.706143+0000","last_change":"2023-12-07T00:14:19.071553+0000","last_active":"2023-12-07T00:14:20.706143+0000","last_peered":"2023-12-07T00:14:20.706143+0000","last_clean":"2023-12-07T00:14:20.706143+0000","last_became_active":"2023-12-07T00:14:19.071152+0000","last_became_peered":"2023-12-07T00:14:19.071152+0000","last_unstale":"2023-12-07T00:14:20.706143+0000","last_undegraded":"2023-12-07T00:14:20.706143+0000","last_fullsized":"2023-12-07T00:14:20.706143+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680168+0000","last_change":"2023-12-07T00:14:14.652614+0000","last_active":"2023-12-07T00:14:19.680168+0000","last_peered":"2023-12-07T00:14:19.680168+0000","last_clean":"2023-12-07T00:14:19.680168+0000","last_became_active":"2023-12-07T00:14:14.652330+0000","last_became_peered":"2023-12-07T00:14:14.652330+0000","last_unstale":"2023-12-07T00:14:19.680168+0000","last_undegraded":"2023-12-07T00:14:19.680168+0000","last_fullsized":"2023-12-07T00:14:19.680168+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683065+0000","last_change":"2023-12-07T00:14:13.632410+0000","last_active":"2023-12-07T00:14:19.683065+0000","last_peered":"2023-12-07T00:14:19.683065+0000","last_clean":"2023-12-07T00:14:19.683065+0000","last_became_active":"2023-12-07T00:14:13.632131+0000","last_became_peered":"2023-12-07T00:14:13.632131+0000","last_unstale":"2023-12-07T00:14:19.683065+0000","last_undegraded":"2023-12-07T00:14:19.683065+0000","last_fullsized":"2023-12-07T00:14:19.683065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:08.508036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890283+0000","last_change":"2023-12-07T00:14:04.636514+0000","last_active":"2023-12-07T00:14:19.890283+0000","last_peered":"2023-12-07T00:14:19.890283+0000","last_clean":"2023-12-07T00:14:19.890283+0000","last_became_active":"2023-12-07T00:14:04.635540+0000","last_became_peered":"2023-12-07T00:14:04.635540+0000","last_unstale":"2023-12-07T00:14:19.890283+0000","last_undegraded":"2023-12-07T00:14:19.890283+0000","last_fullsized":"2023-12-07T00:14:19.890283+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_clean_scrub_stamp":"2023-12-07T00:14:03.541217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:08:01.012662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367559+0000","last_change":"2023-12-07T00:14:19.070256+0000","last_active":"2023-12-07T00:14:21.367559+0000","last_peered":"2023-12-07T00:14:21.367559+0000","last_clean":"2023-12-07T00:14:21.367559+0000","last_became_active":"2023-12-07T00:14:19.069857+0000","last_became_peered":"2023-12-07T00:14:19.069857+0000","last_unstale":"2023-12-07T00:14:21.367559+0000","last_undegraded":"2023-12-07T00:14:21.367559+0000","last_fullsized":"2023-12-07T00:14:21.367559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890041+0000","last_change":"2023-12-07T00:14:14.646599+0000","last_active":"2023-12-07T00:14:19.890041+0000","last_peered":"2023-12-07T00:14:19.890041+0000","last_clean":"2023-12-07T00:14:19.890041+0000","last_became_active":"2023-12-07T00:14:14.646211+0000","last_became_peered":"2023-12-07T00:14:14.646211+0000","last_unstale":"2023-12-07T00:14:19.890041+0000","last_undegraded":"2023-12-07T00:14:19.890041+0000","last_fullsized":"2023-12-07T00:14:19.890041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:05.969623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890386+0000","last_change":"2023-12-07T00:14:13.628132+0000","last_active":"2023-12-07T00:14:19.890386+0000","last_peered":"2023-12-07T00:14:19.890386+0000","last_clean":"2023-12-07T00:14:19.890386+0000","last_became_active":"2023-12-07T00:14:13.627883+0000","last_became_peered":"2023-12-07T00:14:13.627883+0000","last_unstale":"2023-12-07T00:14:19.890386+0000","last_undegraded":"2023-12-07T00:14:19.890386+0000","last_fullsized":"2023-12-07T00:14:19.890386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:08.508036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366914+0000","last_change":"2023-12-07T00:14:19.070287+0000","last_active":"2023-12-07T00:14:21.366914+0000","last_peered":"2023-12-07T00:14:21.366914+0000","last_clean":"2023-12-07T00:14:21.366914+0000","last_became_active":"2023-12-07T00:14:19.069931+0000","last_became_peered":"2023-12-07T00:14:19.069931+0000","last_unstale":"2023-12-07T00:14:21.366914+0000","last_undegraded":"2023-12-07T00:14:21.366914+0000","last_fullsized":"2023-12-07T00:14:21.366914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889775+0000","last_change":"2023-12-07T00:14:13.630867+0000","last_active":"2023-12-07T00:14:19.889775+0000","last_peered":"2023-12-07T00:14:19.889775+0000","last_clean":"2023-12-07T00:14:19.889775+0000","last_became_active":"2023-12-07T00:14:13.630542+0000","last_became_peered":"2023-12-07T00:14:13.630542+0000","last_unstale":"2023-12-07T00:14:19.889775+0000","last_undegraded":"2023-12-07T00:14:19.889775+0000","last_fullsized":"2023-12-07T00:14:19.889775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889492+0000","last_change":"2023-12-07T00:14:14.646636+0000","last_active":"2023-12-07T00:14:19.889492+0000","last_peered":"2023-12-07T00:14:19.889492+0000","last_clean":"2023-12-07T00:14:19.889492+0000","last_became_active":"2023-12-07T00:14:14.645841+0000","last_became_peered":"2023-12-07T00:14:14.645841+0000","last_unstale":"2023-12-07T00:14:19.889492+0000","last_undegraded":"2023-12-07T00:14:19.889492+0000","last_fullsized":"2023-12-07T00:14:19.889492+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366975+0000","last_change":"2023-12-07T00:14:19.073292+0000","last_active":"2023-12-07T00:14:21.366975+0000","last_peered":"2023-12-07T00:14:21.366975+0000","last_clean":"2023-12-07T00:14:21.366975+0000","last_became_active":"2023-12-07T00:14:19.072850+0000","last_became_peered":"2023-12-07T00:14:19.072850+0000","last_unstale":"2023-12-07T00:14:21.366975+0000","last_undegraded":"2023-12-07T00:14:21.366975+0000","last_fullsized":"2023-12-07T00:14:21.366975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:35:28.448140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889274+0000","last_change":"2023-12-07T00:14:13.637981+0000","last_active":"2023-12-07T00:14:19.889274+0000","last_peered":"2023-12-07T00:14:19.889274+0000","last_clean":"2023-12-07T00:14:19.889274+0000","last_became_active":"2023-12-07T00:14:13.637648+0000","last_became_peered":"2023-12-07T00:14:13.637648+0000","last_unstale":"2023-12-07T00:14:19.889274+0000","last_undegraded":"2023-12-07T00:14:19.889274+0000","last_fullsized":"2023-12-07T00:14:19.889274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:13.077194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680868+0000","last_change":"2023-12-07T00:14:14.646947+0000","last_active":"2023-12-07T00:14:19.680868+0000","last_peered":"2023-12-07T00:14:19.680868+0000","last_clean":"2023-12-07T00:14:19.680868+0000","last_became_active":"2023-12-07T00:14:14.646649+0000","last_became_peered":"2023-12-07T00:14:14.646649+0000","last_unstale":"2023-12-07T00:14:19.680868+0000","last_undegraded":"2023-12-07T00:14:19.680868+0000","last_fullsized":"2023-12-07T00:14:19.680868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684472+0000","last_change":"2023-12-07T00:14:19.073479+0000","last_active":"2023-12-07T00:14:20.684472+0000","last_peered":"2023-12-07T00:14:20.684472+0000","last_clean":"2023-12-07T00:14:20.684472+0000","last_became_active":"2023-12-07T00:14:19.073084+0000","last_became_peered":"2023-12-07T00:14:19.073084+0000","last_unstale":"2023-12-07T00:14:20.684472+0000","last_undegraded":"2023-12-07T00:14:20.684472+0000","last_fullsized":"2023-12-07T00:14:20.684472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:40.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683778+0000","last_change":"2023-12-07T00:14:13.637916+0000","last_active":"2023-12-07T00:14:19.683778+0000","last_peered":"2023-12-07T00:14:19.683778+0000","last_clean":"2023-12-07T00:14:19.683778+0000","last_became_active":"2023-12-07T00:14:13.637538+0000","last_became_peered":"2023-12-07T00:14:13.637538+0000","last_unstale":"2023-12-07T00:14:19.683778+0000","last_undegraded":"2023-12-07T00:14:19.683778+0000","last_fullsized":"2023-12-07T00:14:19.683778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:07:55.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890503+0000","last_change":"2023-12-07T00:14:14.648223+0000","last_active":"2023-12-07T00:14:19.890503+0000","last_peered":"2023-12-07T00:14:19.890503+0000","last_clean":"2023-12-07T00:14:19.890503+0000","last_became_active":"2023-12-07T00:14:14.647966+0000","last_became_peered":"2023-12-07T00:14:14.647966+0000","last_unstale":"2023-12-07T00:14:19.890503+0000","last_undegraded":"2023-12-07T00:14:19.890503+0000","last_fullsized":"2023-12-07T00:14:19.890503+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:16.159928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.684860+0000","last_change":"2023-12-07T00:14:18.665311+0000","last_active":"2023-12-07T00:14:20.684860+0000","last_peered":"2023-12-07T00:14:20.684860+0000","last_clean":"2023-12-07T00:14:20.684860+0000","last_became_active":"2023-12-07T00:14:18.664892+0000","last_became_peered":"2023-12-07T00:14:18.664892+0000","last_unstale":"2023-12-07T00:14:20.684860+0000","last_undegraded":"2023-12-07T00:14:20.684860+0000","last_fullsized":"2023-12-07T00:14:20.684860+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890458+0000","last_change":"2023-12-07T00:14:13.630986+0000","last_active":"2023-12-07T00:14:19.890458+0000","last_peered":"2023-12-07T00:14:19.890458+0000","last_clean":"2023-12-07T00:14:19.890458+0000","last_became_active":"2023-12-07T00:14:13.630609+0000","last_became_peered":"2023-12-07T00:14:13.630609+0000","last_unstale":"2023-12-07T00:14:19.890458+0000","last_undegraded":"2023-12-07T00:14:19.890458+0000","last_fullsized":"2023-12-07T00:14:19.890458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:53.916550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888978+0000","last_change":"2023-12-07T00:14:14.635608+0000","last_active":"2023-12-07T00:14:19.888978+0000","last_peered":"2023-12-07T00:14:19.888978+0000","last_clean":"2023-12-07T00:14:19.888978+0000","last_became_active":"2023-12-07T00:14:14.635340+0000","last_became_peered":"2023-12-07T00:14:14.635340+0000","last_unstale":"2023-12-07T00:14:19.888978+0000","last_undegraded":"2023-12-07T00:14:19.888978+0000","last_fullsized":"2023-12-07T00:14:19.888978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:54.920912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.275281+0000","last_change":"2023-12-07T00:14:19.071557+0000","last_active":"2023-12-07T00:14:21.275281+0000","last_peered":"2023-12-07T00:14:21.275281+0000","last_clean":"2023-12-07T00:14:21.275281+0000","last_became_active":"2023-12-07T00:14:19.071128+0000","last_became_peered":"2023-12-07T00:14:19.071128+0000","last_unstale":"2023-12-07T00:14:21.275281+0000","last_undegraded":"2023-12-07T00:14:21.275281+0000","last_fullsized":"2023-12-07T00:14:21.275281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:53:14.211329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888538+0000","last_change":"2023-12-07T00:14:13.629382+0000","last_active":"2023-12-07T00:14:19.888538+0000","last_peered":"2023-12-07T00:14:19.888538+0000","last_clean":"2023-12-07T00:14:19.888538+0000","last_became_active":"2023-12-07T00:14:13.629097+0000","last_became_peered":"2023-12-07T00:14:13.629097+0000","last_unstale":"2023-12-07T00:14:19.888538+0000","last_undegraded":"2023-12-07T00:14:19.888538+0000","last_fullsized":"2023-12-07T00:14:19.888538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:10:23.927140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.679917+0000","last_change":"2023-12-07T00:14:14.655117+0000","last_active":"2023-12-07T00:14:19.679917+0000","last_peered":"2023-12-07T00:14:19.679917+0000","last_clean":"2023-12-07T00:14:19.679917+0000","last_became_active":"2023-12-07T00:14:14.652105+0000","last_became_peered":"2023-12-07T00:14:14.652105+0000","last_unstale":"2023-12-07T00:14:19.679917+0000","last_undegraded":"2023-12-07T00:14:19.679917+0000","last_fullsized":"2023-12-07T00:14:19.679917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685032+0000","last_change":"2023-12-07T00:14:18.665600+0000","last_active":"2023-12-07T00:14:20.685032+0000","last_peered":"2023-12-07T00:14:20.685032+0000","last_clean":"2023-12-07T00:14:20.685032+0000","last_became_active":"2023-12-07T00:14:18.664901+0000","last_became_peered":"2023-12-07T00:14:18.664901+0000","last_unstale":"2023-12-07T00:14:20.685032+0000","last_undegraded":"2023-12-07T00:14:20.685032+0000","last_fullsized":"2023-12-07T00:14:20.685032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:15:41.615139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889054+0000","last_change":"2023-12-07T00:14:13.633312+0000","last_active":"2023-12-07T00:14:19.889054+0000","last_peered":"2023-12-07T00:14:19.889054+0000","last_clean":"2023-12-07T00:14:19.889054+0000","last_became_active":"2023-12-07T00:14:13.633034+0000","last_became_peered":"2023-12-07T00:14:13.633034+0000","last_unstale":"2023-12-07T00:14:19.889054+0000","last_undegraded":"2023-12-07T00:14:19.889054+0000","last_fullsized":"2023-12-07T00:14:19.889054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:32:04.965261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680317+0000","last_change":"2023-12-07T00:14:14.655550+0000","last_active":"2023-12-07T00:14:19.680317+0000","last_peered":"2023-12-07T00:14:19.680317+0000","last_clean":"2023-12-07T00:14:19.680317+0000","last_became_active":"2023-12-07T00:14:14.651780+0000","last_became_peered":"2023-12-07T00:14:14.651780+0000","last_unstale":"2023-12-07T00:14:19.680317+0000","last_undegraded":"2023-12-07T00:14:19.680317+0000","last_fullsized":"2023-12-07T00:14:19.680317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:56:08.244343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.685294+0000","last_change":"2023-12-07T00:14:18.669658+0000","last_active":"2023-12-07T00:14:20.685294+0000","last_peered":"2023-12-07T00:14:20.685294+0000","last_clean":"2023-12-07T00:14:20.685294+0000","last_became_active":"2023-12-07T00:14:18.669258+0000","last_became_peered":"2023-12-07T00:14:18.669258+0000","last_unstale":"2023-12-07T00:14:20.685294+0000","last_undegraded":"2023-12-07T00:14:20.685294+0000","last_fullsized":"2023-12-07T00:14:20.685294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:09:12.123244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890157+0000","last_change":"2023-12-07T00:14:13.634671+0000","last_active":"2023-12-07T00:14:19.890157+0000","last_peered":"2023-12-07T00:14:19.890157+0000","last_clean":"2023-12-07T00:14:19.890157+0000","last_became_active":"2023-12-07T00:14:13.634416+0000","last_became_peered":"2023-12-07T00:14:13.634416+0000","last_unstale":"2023-12-07T00:14:19.890157+0000","last_undegraded":"2023-12-07T00:14:19.890157+0000","last_fullsized":"2023-12-07T00:14:19.890157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:58:15.155566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683669+0000","last_change":"2023-12-07T00:14:14.646535+0000","last_active":"2023-12-07T00:14:19.683669+0000","last_peered":"2023-12-07T00:14:19.683669+0000","last_clean":"2023-12-07T00:14:19.683669+0000","last_became_active":"2023-12-07T00:14:14.646262+0000","last_became_peered":"2023-12-07T00:14:14.646262+0000","last_unstale":"2023-12-07T00:14:19.683669+0000","last_undegraded":"2023-12-07T00:14:19.683669+0000","last_fullsized":"2023-12-07T00:14:19.683669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:00:12.030432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:20.705879+0000","last_change":"2023-12-07T00:14:19.070666+0000","last_active":"2023-12-07T00:14:20.705879+0000","last_peered":"2023-12-07T00:14:20.705879+0000","last_clean":"2023-12-07T00:14:20.705879+0000","last_became_active":"2023-12-07T00:14:19.070102+0000","last_became_peered":"2023-12-07T00:14:19.070102+0000","last_unstale":"2023-12-07T00:14:20.705879+0000","last_undegraded":"2023-12-07T00:14:20.705879+0000","last_fullsized":"2023-12-07T00:14:20.705879+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:40.741146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888826+0000","last_change":"2023-12-07T00:14:13.630742+0000","last_active":"2023-12-07T00:14:19.888826+0000","last_peered":"2023-12-07T00:14:19.888826+0000","last_clean":"2023-12-07T00:14:19.888826+0000","last_became_active":"2023-12-07T00:14:13.630467+0000","last_became_peered":"2023-12-07T00:14:13.630467+0000","last_unstale":"2023-12-07T00:14:19.888826+0000","last_undegraded":"2023-12-07T00:14:19.888826+0000","last_fullsized":"2023-12-07T00:14:19.888826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:47:53.916550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889980+0000","last_change":"2023-12-07T00:14:14.649293+0000","last_active":"2023-12-07T00:14:19.889980+0000","last_peered":"2023-12-07T00:14:19.889980+0000","last_clean":"2023-12-07T00:14:19.889980+0000","last_became_active":"2023-12-07T00:14:14.649021+0000","last_became_peered":"2023-12-07T00:14:14.649021+0000","last_unstale":"2023-12-07T00:14:19.889980+0000","last_undegraded":"2023-12-07T00:14:19.889980+0000","last_fullsized":"2023-12-07T00:14:19.889980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:16.080287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.366749+0000","last_change":"2023-12-07T00:14:18.669575+0000","last_active":"2023-12-07T00:14:21.366749+0000","last_peered":"2023-12-07T00:14:21.366749+0000","last_clean":"2023-12-07T00:14:21.366749+0000","last_became_active":"2023-12-07T00:14:18.669100+0000","last_became_peered":"2023-12-07T00:14:18.669100+0000","last_unstale":"2023-12-07T00:14:21.366749+0000","last_undegraded":"2023-12-07T00:14:21.366749+0000","last_fullsized":"2023-12-07T00:14:21.366749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:21:20.110934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889422+0000","last_change":"2023-12-07T00:14:13.629136+0000","last_active":"2023-12-07T00:14:19.889422+0000","last_peered":"2023-12-07T00:14:19.889422+0000","last_clean":"2023-12-07T00:14:19.889422+0000","last_became_active":"2023-12-07T00:14:13.628827+0000","last_became_peered":"2023-12-07T00:14:13.628827+0000","last_unstale":"2023-12-07T00:14:19.889422+0000","last_undegraded":"2023-12-07T00:14:19.889422+0000","last_fullsized":"2023-12-07T00:14:19.889422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:02:43.935698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683381+0000","last_change":"2023-12-07T00:14:14.647552+0000","last_active":"2023-12-07T00:14:19.683381+0000","last_peered":"2023-12-07T00:14:19.683381+0000","last_clean":"2023-12-07T00:14:19.683381+0000","last_became_active":"2023-12-07T00:14:14.647247+0000","last_became_peered":"2023-12-07T00:14:14.647247+0000","last_unstale":"2023-12-07T00:14:19.683381+0000","last_undegraded":"2023-12-07T00:14:19.683381+0000","last_fullsized":"2023-12-07T00:14:19.683381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-07T00:14:21.367215+0000","last_change":"2023-12-07T00:14:19.073305+0000","last_active":"2023-12-07T00:14:21.367215+0000","last_peered":"2023-12-07T00:14:21.367215+0000","last_clean":"2023-12-07T00:14:21.367215+0000","last_became_active":"2023-12-07T00:14:19.072907+0000","last_became_peered":"2023-12-07T00:14:19.072907+0000","last_unstale":"2023-12-07T00:14:21.367215+0000","last_undegraded":"2023-12-07T00:14:21.367215+0000","last_fullsized":"2023-12-07T00:14:21.367215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:17.640653+0000","last_clean_scrub_stamp":"2023-12-07T00:14:17.640653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:53:14.211329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889029+0000","last_change":"2023-12-07T00:14:13.626391+0000","last_active":"2023-12-07T00:14:19.889029+0000","last_peered":"2023-12-07T00:14:19.889029+0000","last_clean":"2023-12-07T00:14:19.889029+0000","last_became_active":"2023-12-07T00:14:13.626017+0000","last_became_peered":"2023-12-07T00:14:13.626017+0000","last_unstale":"2023-12-07T00:14:19.889029+0000","last_undegraded":"2023-12-07T00:14:19.889029+0000","last_fullsized":"2023-12-07T00:14:19.889029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:12.605644+0000","last_clean_scrub_stamp":"2023-12-07T00:14:12.605644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:02:04.617974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.890256+0000","last_change":"2023-12-07T00:14:14.647419+0000","last_active":"2023-12-07T00:14:19.890256+0000","last_peered":"2023-12-07T00:14:19.890256+0000","last_clean":"2023-12-07T00:14:19.890256+0000","last_became_active":"2023-12-07T00:14:14.647169+0000","last_became_peered":"2023-12-07T00:14:14.647169+0000","last_unstale":"2023-12-07T00:14:19.890256+0000","last_undegraded":"2023-12-07T00:14:19.890256+0000","last_fullsized":"2023-12-07T00:14:19.890256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:05:36.710499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683191+0000","last_change":"2023-12-07T00:14:14.643376+0000","last_active":"2023-12-07T00:14:19.683191+0000","last_peered":"2023-12-07T00:14:19.683191+0000","last_clean":"2023-12-07T00:14:19.683191+0000","last_became_active":"2023-12-07T00:14:14.643090+0000","last_became_peered":"2023-12-07T00:14:14.643090+0000","last_unstale":"2023-12-07T00:14:19.683191+0000","last_undegraded":"2023-12-07T00:14:19.683191+0000","last_fullsized":"2023-12-07T00:14:19.683191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.888376+0000","last_change":"2023-12-07T00:14:14.639433+0000","last_active":"2023-12-07T00:14:19.888376+0000","last_peered":"2023-12-07T00:14:19.888376+0000","last_clean":"2023-12-07T00:14:19.888376+0000","last_became_active":"2023-12-07T00:14:14.639177+0000","last_became_peered":"2023-12-07T00:14:14.639177+0000","last_unstale":"2023-12-07T00:14:19.888376+0000","last_undegraded":"2023-12-07T00:14:19.888376+0000","last_fullsized":"2023-12-07T00:14:19.888376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:32:09.512398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682993+0000","last_change":"2023-12-07T00:14:14.647105+0000","last_active":"2023-12-07T00:14:19.682993+0000","last_peered":"2023-12-07T00:14:19.682993+0000","last_clean":"2023-12-07T00:14:19.682993+0000","last_became_active":"2023-12-07T00:14:14.646811+0000","last_became_peered":"2023-12-07T00:14:14.646811+0000","last_unstale":"2023-12-07T00:14:19.682993+0000","last_undegraded":"2023-12-07T00:14:19.682993+0000","last_fullsized":"2023-12-07T00:14:19.682993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:15:27.866555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889051+0000","last_change":"2023-12-07T00:14:14.658213+0000","last_active":"2023-12-07T00:14:19.889051+0000","last_peered":"2023-12-07T00:14:19.889051+0000","last_clean":"2023-12-07T00:14:19.889051+0000","last_became_active":"2023-12-07T00:14:14.657944+0000","last_became_peered":"2023-12-07T00:14:14.657944+0000","last_unstale":"2023-12-07T00:14:19.889051+0000","last_undegraded":"2023-12-07T00:14:19.889051+0000","last_fullsized":"2023-12-07T00:14:19.889051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:40:40.337139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680455+0000","last_change":"2023-12-07T00:14:14.650342+0000","last_active":"2023-12-07T00:14:19.680455+0000","last_peered":"2023-12-07T00:14:19.680455+0000","last_clean":"2023-12-07T00:14:19.680455+0000","last_became_active":"2023-12-07T00:14:14.650042+0000","last_became_peered":"2023-12-07T00:14:14.650042+0000","last_unstale":"2023-12-07T00:14:19.680455+0000","last_undegraded":"2023-12-07T00:14:19.680455+0000","last_fullsized":"2023-12-07T00:14:19.680455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:09:06.494847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889376+0000","last_change":"2023-12-07T00:14:14.649194+0000","last_active":"2023-12-07T00:14:19.889376+0000","last_peered":"2023-12-07T00:14:19.889376+0000","last_clean":"2023-12-07T00:14:19.889376+0000","last_became_active":"2023-12-07T00:14:14.648929+0000","last_became_peered":"2023-12-07T00:14:14.648929+0000","last_unstale":"2023-12-07T00:14:19.889376+0000","last_undegraded":"2023-12-07T00:14:19.889376+0000","last_fullsized":"2023-12-07T00:14:19.889376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683509+0000","last_change":"2023-12-07T00:14:14.643466+0000","last_active":"2023-12-07T00:14:19.683509+0000","last_peered":"2023-12-07T00:14:19.683509+0000","last_clean":"2023-12-07T00:14:19.683509+0000","last_became_active":"2023-12-07T00:14:14.643195+0000","last_became_peered":"2023-12-07T00:14:14.643195+0000","last_unstale":"2023-12-07T00:14:19.683509+0000","last_undegraded":"2023-12-07T00:14:19.683509+0000","last_fullsized":"2023-12-07T00:14:19.683509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:24:28.942015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680917+0000","last_change":"2023-12-07T00:14:14.647201+0000","last_active":"2023-12-07T00:14:19.680917+0000","last_peered":"2023-12-07T00:14:19.680917+0000","last_clean":"2023-12-07T00:14:19.680917+0000","last_became_active":"2023-12-07T00:14:14.646844+0000","last_became_peered":"2023-12-07T00:14:14.646844+0000","last_unstale":"2023-12-07T00:14:19.680917+0000","last_undegraded":"2023-12-07T00:14:19.680917+0000","last_fullsized":"2023-12-07T00:14:19.680917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:54:07.905652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.682760+0000","last_change":"2023-12-07T00:14:14.652468+0000","last_active":"2023-12-07T00:14:19.682760+0000","last_peered":"2023-12-07T00:14:19.682760+0000","last_clean":"2023-12-07T00:14:19.682760+0000","last_became_active":"2023-12-07T00:14:14.652125+0000","last_became_peered":"2023-12-07T00:14:14.652125+0000","last_unstale":"2023-12-07T00:14:19.682760+0000","last_undegraded":"2023-12-07T00:14:19.682760+0000","last_fullsized":"2023-12-07T00:14:19.682760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:43:02.372683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.680075+0000","last_change":"2023-12-07T00:14:14.646216+0000","last_active":"2023-12-07T00:14:19.680075+0000","last_peered":"2023-12-07T00:14:19.680075+0000","last_clean":"2023-12-07T00:14:19.680075+0000","last_became_active":"2023-12-07T00:14:14.645667+0000","last_became_peered":"2023-12-07T00:14:14.645667+0000","last_unstale":"2023-12-07T00:14:19.680075+0000","last_undegraded":"2023-12-07T00:14:19.680075+0000","last_fullsized":"2023-12-07T00:14:19.680075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683019+0000","last_change":"2023-12-07T00:14:14.643268+0000","last_active":"2023-12-07T00:14:19.683019+0000","last_peered":"2023-12-07T00:14:19.683019+0000","last_clean":"2023-12-07T00:14:19.683019+0000","last_became_active":"2023-12-07T00:14:14.642911+0000","last_became_peered":"2023-12-07T00:14:14.642911+0000","last_unstale":"2023-12-07T00:14:19.683019+0000","last_undegraded":"2023-12-07T00:14:19.683019+0000","last_fullsized":"2023-12-07T00:14:19.683019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:50:05.715807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.889125+0000","last_change":"2023-12-07T00:14:14.654077+0000","last_active":"2023-12-07T00:14:19.889125+0000","last_peered":"2023-12-07T00:14:19.889125+0000","last_clean":"2023-12-07T00:14:19.889125+0000","last_became_active":"2023-12-07T00:14:14.653784+0000","last_became_peered":"2023-12-07T00:14:14.653784+0000","last_unstale":"2023-12-07T00:14:19.889125+0000","last_undegraded":"2023-12-07T00:14:19.889125+0000","last_fullsized":"2023-12-07T00:14:19.889125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:42:14.081556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-07T00:14:19.683657+0000","last_change":"2023-12-07T00:14:14.647010+0000","last_active":"2023-12-07T00:14:19.683657+0000","last_peered":"2023-12-07T00:14:19.683657+0000","last_clean":"2023-12-07T00:14:19.683657+0000","last_became_active":"2023-12-07T00:14:14.646731+0000","last_became_peered":"2023-12-07T00:14:14.646731+0000","last_unstale":"2023-12-07T00:14:19.683657+0000","last_undegraded":"2023-12-07T00:14:19.683657+0000","last_fullsized":"2023-12-07T00:14:19.683657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:13.610006+0000","last_clean_scrub_stamp":"2023-12-07T00:14:13.610006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:34:25.957112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":707149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":116359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":897024,"data_stored":707205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":116199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":116325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":116289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T00:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-07T00:14:37.846 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-07T00:14:37.846 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-07T00:14:37.847 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-07T00:14:37.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.000+0000 7f73678fe700 1 Processor -- start 2023-12-07T00:14:38.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.000+0000 7f73678fe700 1 -- start start 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.001+0000 7f73678fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73600b1590 0x7f73600b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.001+0000 7f73678fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f73600ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.001+0000 7f73678fe700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600cd530 con 0x7f736015e0c0 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.001+0000 7f73678fe700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736015e4a0 con 0x7f73600b1590 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.001+0000 7f73678fe700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600b1ae0 con 0x7f73600ccb40 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.001+0000 7f7364e99700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73600b1590 0x7f73600b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.001+0000 7f7364e99700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f73600b1590 0x7f73600b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39720/0 (socket says 172.21.15.179:39720) 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.001+0000 7f7364e99700 1 -- 172.21.15.179:0/1256064623 learned_addr learned my addr 172.21.15.179:0/1256064623 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7365e9b700 1 --2- 172.21.15.179:0/1256064623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f73600ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7364e99700 1 -- 172.21.15.179:0/1256064623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 msgr2=0x7f73600ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:38.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7364e99700 1 --2- 172.21.15.179:0/1256064623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f73600ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7364e99700 1 -- 172.21.15.179:0/1256064623 >> v1:172.21.15.190:6789/0 conn(0x7f736015e0c0 legacy=0x7f7360066f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7364e99700 1 -- 172.21.15.179:0/1256064623 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600b51c0 con 0x7f73600b1590 2023-12-07T00:14:38.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7364e99700 1 --2- 172.21.15.179:0/1256064623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73600b1590 0x7f73600b5ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f735c0098f0 tx=0x7f735c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74c01f560fd0144 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7357fff700 1 -- 172.21.15.179:0/1256064623 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c00b8a0 con 0x7f73600b1590 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7357fff700 1 -- 172.21.15.179:0/1256064623 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c00ba00 con 0x7f73600b1590 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.002+0000 7f7357fff700 1 -- 172.21.15.179:0/1256064623 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c00bd90 con 0x7f73600b1590 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.003+0000 7f73678fe700 1 -- 172.21.15.179:0/1256064623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73600b1590 msgr2=0x7f73600b5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.003+0000 7f73678fe700 1 --2- 172.21.15.179:0/1256064623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73600b1590 0x7f73600b5ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f735c0098f0 tx=0x7f735c009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.003+0000 7f73678fe700 1 -- 172.21.15.179:0/1256064623 shutdown_connections 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.003+0000 7f73678fe700 1 --2- 172.21.15.179:0/1256064623 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f73600ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.003+0000 7f73678fe700 1 --2- 172.21.15.179:0/1256064623 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73600b1590 0x7f73600b5ca0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.003+0000 7f73678fe700 1 -- 172.21.15.179:0/1256064623 >> 172.21.15.179:0/1256064623 conn(0x7f7360099a40 msgr2=0x7f73600b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.003+0000 7f73678fe700 1 -- 172.21.15.179:0/1256064623 shutdown_connections 2023-12-07T00:14:38.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.003+0000 7f73678fe700 1 -- 172.21.15.179:0/1256064623 wait complete. 2023-12-07T00:14:38.006 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.004+0000 7f73678fe700 1 Processor -- start 2023-12-07T00:14:38.006 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.004+0000 7f73678fe700 1 -- start start 2023-12-07T00:14:38.006 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f73678fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73600b1590 0x7f7360151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.006 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f73678fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f736006ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f73678fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736015e0c0 0x7f7360160450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f73678fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73601f3300 con 0x7f736015e0c0 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f73678fe700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600ae0d0 con 0x7f73600b1590 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f73678fe700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600ae3b0 con 0x7f73600ccb40 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f7365e9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736015e0c0 0x7f7360160450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f7365e9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736015e0c0 0x7f7360160450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39728/0 (socket says 172.21.15.179:39728) 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f7365e9b700 1 -- 172.21.15.179:0/2450994713 learned_addr learned my addr 172.21.15.179:0/2450994713 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f7364e99700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f736006ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.005+0000 7f736569a700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73600b1590 0x7f7360151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7365e9b700 1 -- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 msgr2=0x7f736006ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7365e9b700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f736006ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7365e9b700 1 -- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73600b1590 msgr2=0x7f7360151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7365e9b700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73600b1590 0x7f7360151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7365e9b700 1 -- 172.21.15.179:0/2450994713 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c009550 con 0x7f736015e0c0 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7364e99700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f736006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7365e9b700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736015e0c0 0x7f7360160450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7358007e40 tx=0x7f735800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7355ffb700 1 -- 172.21.15.179:0/2450994713 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735800eea0 con 0x7f736015e0c0 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7355ffb700 1 -- 172.21.15.179:0/2450994713 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7358014420 con 0x7f736015e0c0 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73600ae690 con 0x7f736015e0c0 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f7355ffb700 1 -- 172.21.15.179:0/2450994713 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73580147b0 con 0x7f736015e0c0 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.006+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736006f1a0 con 0x7f736015e0c0 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.007+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736006f330 con 0x7f736015e0c0 2023-12-07T00:14:38.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.007+0000 7f7355ffb700 1 -- 172.21.15.179:0/2450994713 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7358014910 con 0x7f736015e0c0 2023-12-07T00:14:38.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.008+0000 7f7355ffb700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f734406aed0 0x7f734406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.008+0000 7f7355ffb700 1 -- 172.21.15.179:0/2450994713 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f735808a130 con 0x7f736015e0c0 2023-12-07T00:14:38.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.008+0000 7f736569a700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f734406aed0 0x7f734406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.008+0000 7f736569a700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f734406aed0 0x7f734406d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7350000f60 tx=0x7f7350009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.012+0000 7f7355ffb700 1 -- 172.21.15.179:0/2450994713 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7358054e50 con 0x7f736015e0c0 2023-12-07T00:14:38.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.245+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f73600685f0 con 0x7f736015e0c0 2023-12-07T00:14:38.245 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.246+0000 7f7355ffb700 1 -- 172.21.15.179:0/2450994713 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7358058470 con 0x7f736015e0c0 2023-12-07T00:14:38.245 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:38.245 INFO:teuthology.orchestra.run.smithi179.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.247+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f734406aed0 msgr2=0x7f734406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.247+0000 7f73678fe700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f734406aed0 0x7f734406d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7350000f60 tx=0x7f7350009040 comp rx=0 tx=0).stop 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.247+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736015e0c0 msgr2=0x7f7360160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.247+0000 7f73678fe700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736015e0c0 0x7f7360160450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7358007e40 tx=0x7f735800e3c0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.248+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 shutdown_connections 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.248+0000 7f73678fe700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f734406aed0 0x7f734406d390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.248+0000 7f73678fe700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f736015e0c0 0x7f7360160450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.248+0000 7f73678fe700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73600b1590 0x7f7360151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.248+0000 7f73678fe700 1 --2- 172.21.15.179:0/2450994713 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73600ccb40 0x7f736006ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.248+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 >> 172.21.15.179:0/2450994713 conn(0x7f7360099a40 msgr2=0x7f73600b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:38.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.248+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 shutdown_connections 2023-12-07T00:14:38.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.248+0000 7f73678fe700 1 -- 172.21.15.179:0/2450994713 wait complete. 2023-12-07T00:14:38.259 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-07T00:14:38.259 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.380+0000 7fd095529700 1 Processor -- start 2023-12-07T00:14:38.380 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.380+0000 7fd095529700 1 -- start start 2023-12-07T00:14:38.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.381+0000 7fd095529700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd090158560 0x7fd0900b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.381+0000 7fd095529700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd09015b010 0x7fd0900b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.381+0000 7fd095529700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09015b8d0 con 0x7fd0900b2aa0 2023-12-07T00:14:38.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.381+0000 7fd095529700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900b2f10 con 0x7fd09015b010 2023-12-07T00:14:38.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.381+0000 7fd095529700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09015bbb0 con 0x7fd090158560 2023-12-07T00:14:38.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08e7fc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd09015b010 0x7fd0900b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08effd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd090158560 0x7fd0900b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08e7fc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd09015b010 0x7fd0900b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:41988/0 (socket says 172.21.15.179:41988) 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08e7fc700 1 -- 172.21.15.179:0/2058824710 learned_addr learned my addr 172.21.15.179:0/2058824710 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08effd700 1 -- 172.21.15.179:0/2058824710 >> v2:172.21.15.190:3300/0 conn(0x7fd09015b010 msgr2=0x7fd0900b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08effd700 1 --2- 172.21.15.179:0/2058824710 >> v2:172.21.15.190:3300/0 conn(0x7fd09015b010 0x7fd0900b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08effd700 1 -- 172.21.15.179:0/2058824710 >> v1:172.21.15.190:6789/0 conn(0x7fd0900b2aa0 legacy=0x7fd09006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08effd700 1 -- 172.21.15.179:0/2058824710 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09015be90 con 0x7fd090158560 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08e7fc700 1 --2- 172.21.15.179:0/2058824710 >> v2:172.21.15.190:3300/0 conn(0x7fd09015b010 0x7fd0900b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08effd700 1 --2- 172.21.15.179:0/2058824710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd090158560 0x7fd0900b4470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd084009840 tx=0x7fd084009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d35fc1cb19f2e01 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08dffb700 1 -- 172.21.15.179:0/2058824710 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084011830 con 0x7fd090158560 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08dffb700 1 -- 172.21.15.179:0/2058824710 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd084011990 con 0x7fd090158560 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.382+0000 7fd08dffb700 1 -- 172.21.15.179:0/2058824710 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084011d20 con 0x7fd090158560 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.383+0000 7fd095529700 1 -- 172.21.15.179:0/2058824710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd090158560 msgr2=0x7fd0900b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.383+0000 7fd095529700 1 --2- 172.21.15.179:0/2058824710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd090158560 0x7fd0900b4470 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd084009840 tx=0x7fd084009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.383+0000 7fd095529700 1 -- 172.21.15.179:0/2058824710 shutdown_connections 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.383+0000 7fd095529700 1 --2- 172.21.15.179:0/2058824710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd090158560 0x7fd0900b4470 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.383+0000 7fd095529700 1 --2- 172.21.15.179:0/2058824710 >> v2:172.21.15.190:3300/0 conn(0x7fd09015b010 0x7fd0900b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.383+0000 7fd095529700 1 -- 172.21.15.179:0/2058824710 >> 172.21.15.179:0/2058824710 conn(0x7fd090072970 msgr2=0x7fd090072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:38.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.383+0000 7fd095529700 1 -- 172.21.15.179:0/2058824710 shutdown_connections 2023-12-07T00:14:38.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.383+0000 7fd095529700 1 -- 172.21.15.179:0/2058824710 wait complete. 2023-12-07T00:14:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.384+0000 7fd095529700 1 Processor -- start 2023-12-07T00:14:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.384+0000 7fd095529700 1 -- start start 2023-12-07T00:14:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd095529700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0900b2aa0 0x7fd090153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd095529700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd090158560 0x7fd090154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd095529700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd09015b010 0x7fd090152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd095529700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090153be0 con 0x7fd090158560 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd095529700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090153620 con 0x7fd09015b010 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd095529700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd090153900 con 0x7fd0900b2aa0 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd090158560 0x7fd090154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd090158560 0x7fd090154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39740/0 (socket says 172.21.15.179:39740) 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 -- 172.21.15.179:0/2165879026 learned_addr learned my addr 172.21.15.179:0/2165879026 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08effd700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0900b2aa0 0x7fd090153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08f7fe700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd09015b010 0x7fd090152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 -- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0900b2aa0 msgr2=0x7fd090153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0900b2aa0 0x7fd090153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 -- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd09015b010 msgr2=0x7fd090152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd09015b010 0x7fd090152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 -- 172.21.15.179:0/2165879026 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08000b7a0 con 0x7fd090158560 2023-12-07T00:14:38.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08f7fe700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd09015b010 0x7fd090152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.385+0000 7fd08e7fc700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd090158560 0x7fd090154400 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd08000ed40 tx=0x7fd08000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.386+0000 7fd0777fe700 1 -- 172.21.15.179:0/2165879026 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08000de40 con 0x7fd090158560 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.386+0000 7fd0777fe700 1 -- 172.21.15.179:0/2165879026 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080005a20 con 0x7fd090158560 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.386+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0840094a0 con 0x7fd090158560 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.386+0000 7fd0777fe700 1 -- 172.21.15.179:0/2165879026 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080005dd0 con 0x7fd090158560 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.386+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0900ca060 con 0x7fd090158560 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.387+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09004f290 con 0x7fd090158560 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.387+0000 7fd0777fe700 1 -- 172.21.15.179:0/2165879026 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd080006240 con 0x7fd090158560 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.387+0000 7fd0777fe700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd07c06aed0 0x7fd07c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.387+0000 7fd0777fe700 1 -- 172.21.15.179:0/2165879026 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd08008a0c0 con 0x7fd090158560 2023-12-07T00:14:38.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.387+0000 7fd08effd700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd07c06aed0 0x7fd07c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.388+0000 7fd08effd700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd07c06aed0 0x7fd07c06d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd084000c00 tx=0x7fd084008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.392+0000 7fd0777fe700 1 -- 172.21.15.179:0/2165879026 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd080054e90 con 0x7fd090158560 2023-12-07T00:14:38.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.583+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0900685f0 con 0x7fd090158560 2023-12-07T00:14:38.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.584+0000 7fd0777fe700 1 -- 172.21.15.179:0/2165879026 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fd0800584b0 con 0x7fd090158560 2023-12-07T00:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:38.584 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:38.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd07c06aed0 msgr2=0x7fd07c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd07c06aed0 0x7fd07c06d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd084000c00 tx=0x7fd084008030 comp rx=0 tx=0).stop 2023-12-07T00:14:38.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd090158560 msgr2=0x7fd090154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd090158560 0x7fd090154400 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd08000ed40 tx=0x7fd08000d630 comp rx=0 tx=0).stop 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 shutdown_connections 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd07c06aed0 0x7fd07c06d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd09015b010 0x7fd090152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0900b2aa0 0x7fd090153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 --2- 172.21.15.179:0/2165879026 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd090158560 0x7fd090154400 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 >> 172.21.15.179:0/2165879026 conn(0x7fd090072970 msgr2=0x7fd0900cf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 shutdown_connections 2023-12-07T00:14:38.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.586+0000 7fd095529700 1 -- 172.21.15.179:0/2165879026 wait complete. 2023-12-07T00:14:38.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:38.599 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:38.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.725+0000 7efecc5a8700 1 Processor -- start 2023-12-07T00:14:38.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.725+0000 7efecc5a8700 1 -- start start 2023-12-07T00:14:38.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.725+0000 7efecc5a8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161360 0x7efec40cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efecc5a8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efec406af70 0x7efec406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efecc5a8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec40cb0f0 con 0x7efec4161c70 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efecc5a8700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec4162810 con 0x7efec406af70 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efecc5a8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec406b930 con 0x7efec4161360 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efec9b43700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efec406af70 0x7efec406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efeca344700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161360 0x7efec40cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efec9b43700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efec406af70 0x7efec406b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:42000/0 (socket says 172.21.15.179:42000) 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efeca344700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161360 0x7efec40cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:40160/0 (socket says 172.21.15.179:40160) 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efec9b43700 1 -- 172.21.15.179:0/2560069553 learned_addr learned my addr 172.21.15.179:0/2560069553 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efeca344700 1 -- 172.21.15.179:0/2560069553 >> v2:172.21.15.190:3300/0 conn(0x7efec406af70 msgr2=0x7efec406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efeca344700 1 --2- 172.21.15.179:0/2560069553 >> v2:172.21.15.190:3300/0 conn(0x7efec406af70 0x7efec406b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efeca344700 1 -- 172.21.15.179:0/2560069553 >> v1:172.21.15.190:6789/0 conn(0x7efec4161c70 legacy=0x7efec4162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efeca344700 1 -- 172.21.15.179:0/2560069553 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4161740 con 0x7efec4161360 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efec9342700 1 -- 172.21.15.179:0/2560069553 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1622847408 0 0) 0x7efec40cb0f0 con 0x7efec4161c70 2023-12-07T00:14:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efec9b43700 1 --2- 172.21.15.179:0/2560069553 >> v2:172.21.15.190:3300/0 conn(0x7efec406af70 0x7efec406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:38.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efeca344700 1 --2- 172.21.15.179:0/2560069553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161360 0x7efec40cc100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efec0009840 tx=0x7efec0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e4cf90aa5dfaaf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.726+0000 7efec9342700 1 -- 172.21.15.179:0/2560069553 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0011830 con 0x7efec4161360 2023-12-07T00:14:38.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efec9342700 1 -- 172.21.15.179:0/2560069553 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec0011990 con 0x7efec4161360 2023-12-07T00:14:38.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efec9342700 1 -- 172.21.15.179:0/2560069553 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0011d20 con 0x7efec4161360 2023-12-07T00:14:38.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efecc5a8700 1 -- 172.21.15.179:0/2560069553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161360 msgr2=0x7efec40cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2560069553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161360 0x7efec40cc100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efec0009840 tx=0x7efec0009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:38.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efecc5a8700 1 -- 172.21.15.179:0/2560069553 shutdown_connections 2023-12-07T00:14:38.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2560069553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161360 0x7efec40cc100 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2560069553 >> v2:172.21.15.190:3300/0 conn(0x7efec406af70 0x7efec406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efecc5a8700 1 -- 172.21.15.179:0/2560069553 >> 172.21.15.179:0/2560069553 conn(0x7efec4099a40 msgr2=0x7efec4099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:38.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efecc5a8700 1 -- 172.21.15.179:0/2560069553 shutdown_connections 2023-12-07T00:14:38.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.727+0000 7efecc5a8700 1 -- 172.21.15.179:0/2560069553 wait complete. 2023-12-07T00:14:38.731 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.728+0000 7efecc5a8700 1 Processor -- start 2023-12-07T00:14:38.731 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.728+0000 7efecc5a8700 1 -- start start 2023-12-07T00:14:38.731 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efecc5a8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec406af70 0x7efec4151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efecc5a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec4161360 0x7efec40b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efecc5a8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161c70 0x7efec40b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efecc5a8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec415d1a0 con 0x7efec4161360 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efecc5a8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec415d480 con 0x7efec406af70 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efecc5a8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec415d760 con 0x7efec4161c70 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efec9b43700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec4161360 0x7efec40b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efec9b43700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec4161360 0x7efec40b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39754/0 (socket says 172.21.15.179:39754) 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efec9b43700 1 -- 172.21.15.179:0/2415062586 learned_addr learned my addr 172.21.15.179:0/2415062586 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efeca344700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec406af70 0x7efec4151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.729+0000 7efecab45700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161c70 0x7efec40b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efec9b43700 1 -- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161c70 msgr2=0x7efec40b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efec9b43700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161c70 0x7efec40b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efec9b43700 1 -- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec406af70 msgr2=0x7efec4151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efec9b43700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec406af70 0x7efec4151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efec9b43700 1 -- 172.21.15.179:0/2415062586 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4009550 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efeca344700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec406af70 0x7efec4151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efec9b43700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec4161360 0x7efec40b0f50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e9b0 tx=0x7efeb400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efebaffd700 1 -- 172.21.15.179:0/2415062586 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400ee50 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efebaffd700 1 -- 172.21.15.179:0/2415062586 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb400c850 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efebaffd700 1 -- 172.21.15.179:0/2415062586 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400cbc0 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec00094a0 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.730+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec415dd20 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.731+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40685f0 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.731+0000 7efebaffd700 1 -- 172.21.15.179:0/2415062586 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efeb400cd20 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.732+0000 7efebaffd700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efea806aed0 0x7efea806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.732+0000 7efebaffd700 1 -- 172.21.15.179:0/2415062586 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efeb4089870 con 0x7efec4161360 2023-12-07T00:14:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.732+0000 7efeca344700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efea806aed0 0x7efea806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:38.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.732+0000 7efeca344700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efea806aed0 0x7efea806d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efec00090b0 tx=0x7efec0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:38.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.736+0000 7efebaffd700 1 -- 172.21.15.179:0/2415062586 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efeb4054630 con 0x7efec4161360 2023-12-07T00:14:38.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.928+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efec40b6a20 con 0x7efec4161360 2023-12-07T00:14:38.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.929+0000 7efebaffd700 1 -- 172.21.15.179:0/2415062586 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7efeb4057c50 con 0x7efec4161360 2023-12-07T00:14:38.928 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:38.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efea806aed0 msgr2=0x7efea806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efea806aed0 0x7efea806d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efec00090b0 tx=0x7efec0008030 comp rx=0 tx=0).stop 2023-12-07T00:14:38.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec4161360 msgr2=0x7efec40b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:38.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec4161360 0x7efec40b0f50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e9b0 tx=0x7efeb400ecc0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 shutdown_connections 2023-12-07T00:14:38.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efea806aed0 0x7efea806d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efec4161c70 0x7efec40b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efec406af70 0x7efec4151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 --2- 172.21.15.179:0/2415062586 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efec4161360 0x7efec40b0f50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:38.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 >> 172.21.15.179:0/2415062586 conn(0x7efec4099a40 msgr2=0x7efec40cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:38.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 shutdown_connections 2023-12-07T00:14:38.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:38.931+0000 7efecc5a8700 1 -- 172.21.15.179:0/2415062586 wait complete. 2023-12-07T00:14:38.942 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:14:39.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.067+0000 7f45b521b700 1 Processor -- start 2023-12-07T00:14:39.066 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.067+0000 7f45b521b700 1 -- start start 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45b521b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b006b680 0x7f45b00cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45b521b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f45b0161c70 0x7f45b0162100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45b521b700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b00cb0f0 con 0x7f45b0161360 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45b521b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b0161740 con 0x7f45b0161c70 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45b521b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00cb340 con 0x7f45b006b680 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45ae59c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b006b680 0x7f45b00cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45af59e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f45b0161c70 0x7f45b0162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45ae59c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b006b680 0x7f45b00cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:40176/0 (socket says 172.21.15.179:40176) 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45ae59c700 1 -- 172.21.15.179:0/674674213 learned_addr learned my addr 172.21.15.179:0/674674213 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45af59e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f45b0161c70 0x7f45b0162100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:42016/0 (socket says 172.21.15.179:42016) 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45ae59c700 1 -- 172.21.15.179:0/674674213 >> v2:172.21.15.190:3300/0 conn(0x7f45b0161c70 msgr2=0x7f45b0162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:39.068 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45ae59c700 1 --2- 172.21.15.179:0/674674213 >> v2:172.21.15.190:3300/0 conn(0x7f45b0161c70 0x7f45b0162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45ae59c700 1 -- 172.21.15.179:0/674674213 >> v1:172.21.15.190:6789/0 conn(0x7f45b0161360 legacy=0x7f45b006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45ae59c700 1 -- 172.21.15.179:0/674674213 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b00cb620 con 0x7f45b006b680 2023-12-07T00:14:39.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.068+0000 7f45af59e700 1 --2- 172.21.15.179:0/674674213 >> v2:172.21.15.190:3300/0 conn(0x7f45b0161c70 0x7f45b0162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:39.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45ae59c700 1 --2- 172.21.15.179:0/674674213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b006b680 0x7f45b00cc100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f45a40098f0 tx=0x7f45a4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f137022ae021db6 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45add9b700 1 -- 172.21.15.179:0/674674213 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4011830 con 0x7f45b006b680 2023-12-07T00:14:39.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45add9b700 1 -- 172.21.15.179:0/674674213 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a4011990 con 0x7f45b006b680 2023-12-07T00:14:39.069 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45add9b700 1 -- 172.21.15.179:0/674674213 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a4011d20 con 0x7f45b006b680 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45b521b700 1 -- 172.21.15.179:0/674674213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b006b680 msgr2=0x7f45b00cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45b521b700 1 --2- 172.21.15.179:0/674674213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b006b680 0x7f45b00cc100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f45a40098f0 tx=0x7f45a4009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45b521b700 1 -- 172.21.15.179:0/674674213 shutdown_connections 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45b521b700 1 --2- 172.21.15.179:0/674674213 >> v2:172.21.15.190:3300/0 conn(0x7f45b0161c70 0x7f45b0162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45b521b700 1 --2- 172.21.15.179:0/674674213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b006b680 0x7f45b00cc100 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45b521b700 1 -- 172.21.15.179:0/674674213 >> 172.21.15.179:0/674674213 conn(0x7f45b0099a40 msgr2=0x7f45b0099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45b521b700 1 -- 172.21.15.179:0/674674213 shutdown_connections 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.069+0000 7f45b521b700 1 -- 172.21.15.179:0/674674213 wait complete. 2023-12-07T00:14:39.070 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.071+0000 7f45b521b700 1 Processor -- start 2023-12-07T00:14:39.071 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.071+0000 7f45b521b700 1 -- start start 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45b521b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45b006b680 0x7f45b014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45b521b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b0161360 0x7f45b00b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45b521b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b0161c70 0x7f45b00b6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45b521b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00c73e0 con 0x7f45b0161c70 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45b521b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00c67d0 con 0x7f45b006b680 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45b521b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00c6ab0 con 0x7f45b0161360 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b0161c70 0x7f45b00b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b0161c70 0x7f45b00b6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39770/0 (socket says 172.21.15.179:39770) 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 -- 172.21.15.179:0/3295297023 learned_addr learned my addr 172.21.15.179:0/3295297023 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45ae59c700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b0161360 0x7f45b00b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45aed9d700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45b006b680 0x7f45b014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 -- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b0161360 msgr2=0x7f45b00b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b0161360 0x7f45b00b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 -- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45b006b680 msgr2=0x7f45b014dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45b006b680 0x7f45b014dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 -- 172.21.15.179:0/3295297023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8009a70 con 0x7f45b0161c70 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45ae59c700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b0161360 0x7f45b00b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45aed9d700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45b006b680 0x7f45b014dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45af59e700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b0161c70 0x7f45b00b6320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f45a800efc0 tx=0x7f45a800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45977fe700 1 -- 172.21.15.179:0/3295297023 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a8009d70 con 0x7f45b0161c70 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45977fe700 1 -- 172.21.15.179:0/3295297023 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a800f040 con 0x7f45b0161c70 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a4009550 con 0x7f45b0161c70 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.072+0000 7f45977fe700 1 -- 172.21.15.179:0/3295297023 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a800ce00 con 0x7f45b0161c70 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.073+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b00c7070 con 0x7f45b0161c70 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.074+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b00b38f0 con 0x7f45b0161c70 2023-12-07T00:14:39.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.074+0000 7f45977fe700 1 -- 172.21.15.179:0/3295297023 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45a8014480 con 0x7f45b0161c70 2023-12-07T00:14:39.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.074+0000 7f45977fe700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f459c06aed0 0x7f459c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.074+0000 7f45977fe700 1 -- 172.21.15.179:0/3295297023 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f45a808a0e0 con 0x7f45b0161c70 2023-12-07T00:14:39.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.074+0000 7f45aed9d700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f459c06aed0 0x7f459c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.075+0000 7f45aed9d700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f459c06aed0 0x7f459c06d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45a0000f60 tx=0x7f45a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.079+0000 7f45977fe700 1 -- 172.21.15.179:0/3295297023 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45b00b38f0 con 0x7f45b0161c70 2023-12-07T00:14:39.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.273+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45b00b38f0 con 0x7f45b0161c70 2023-12-07T00:14:39.273 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.274+0000 7f45977fe700 1 -- 172.21.15.179:0/3295297023 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45b00b38f0 con 0x7f45b0161c70 2023-12-07T00:14:39.273 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:39.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f459c06aed0 msgr2=0x7f459c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f459c06aed0 0x7f459c06d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f45a0000f60 tx=0x7f45a0009040 comp rx=0 tx=0).stop 2023-12-07T00:14:39.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b0161c70 msgr2=0x7f45b00b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b0161c70 0x7f45b00b6320 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f45a800efc0 tx=0x7f45a800c3a0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 shutdown_connections 2023-12-07T00:14:39.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f459c06aed0 0x7f459c06d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f45b0161c70 0x7f45b00b6320 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45b006b680 0x7f45b014dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 --2- 172.21.15.179:0/3295297023 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45b0161360 0x7f45b00b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 >> 172.21.15.179:0/3295297023 conn(0x7f45b0099a40 msgr2=0x7f45b0099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:39.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 shutdown_connections 2023-12-07T00:14:39.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.276+0000 7f45b521b700 1 -- 172.21.15.179:0/3295297023 wait complete. 2023-12-07T00:14:39.287 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:14:39.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.412+0000 7fe1eb0ee700 1 Processor -- start 2023-12-07T00:14:39.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.412+0000 7fe1eb0ee700 1 -- start start 2023-12-07T00:14:39.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.412+0000 7fe1eb0ee700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1e415b970 0x7fe1e40cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.412+0000 7fe1eb0ee700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe1e415caa0 0x7fe1e406af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.412+0000 7fe1eb0ee700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e406b4b0 0x7fe1e40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.412+0000 7fe1eb0ee700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e406b900 con 0x7fe1e415caa0 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.412+0000 7fe1eb0ee700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e4160560 con 0x7fe1e415b970 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.412+0000 7fe1eb0ee700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e415f9e0 con 0x7fe1e406b4b0 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe1e415caa0 0x7fe1e406af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe1e415caa0 0x7fe1e406af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39774/0 (socket says 172.21.15.179:39774) 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 -- 172.21.15.179:0/36855998 learned_addr learned my addr 172.21.15.179:0/36855998 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e8e8a700 1 --2- 172.21.15.179:0/36855998 >> v2:172.21.15.190:3300/0 conn(0x7fe1e415b970 0x7fe1e40cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e968b700 1 --2- 172.21.15.179:0/36855998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e406b4b0 0x7fe1e40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 -- 172.21.15.179:0/36855998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e406b4b0 msgr2=0x7fe1e40cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 --2- 172.21.15.179:0/36855998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e406b4b0 0x7fe1e40cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 -- 172.21.15.179:0/36855998 >> v2:172.21.15.190:3300/0 conn(0x7fe1e415b970 msgr2=0x7fe1e40cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 --2- 172.21.15.179:0/36855998 >> v2:172.21.15.190:3300/0 conn(0x7fe1e415b970 0x7fe1e40cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 -- 172.21.15.179:0/36855998 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e415fcc0 con 0x7fe1e415caa0 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e968b700 1 --2- 172.21.15.179:0/36855998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e406b4b0 0x7fe1e40cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:39.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e8e8a700 1 --2- 172.21.15.179:0/36855998 >> v2:172.21.15.190:3300/0 conn(0x7fe1e415b970 0x7fe1e40cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e3fff700 1 --2- 172.21.15.179:0/36855998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e406af70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40d1b20 tx=0x7fe1d0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6be36ca094098f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e37fe700 1 -- 172.21.15.179:0/36855998 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000b870 con 0x7fe1e415caa0 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e37fe700 1 -- 172.21.15.179:0/36855998 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d000b9d0 con 0x7fe1e415caa0 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.413+0000 7fe1e37fe700 1 -- 172.21.15.179:0/36855998 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d000bd60 con 0x7fe1e415caa0 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/36855998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 msgr2=0x7fe1e406af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/36855998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e406af70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40d1b20 tx=0x7fe1d0009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/36855998 shutdown_connections 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/36855998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e406b4b0 0x7fe1e40cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/36855998 >> v2:172.21.15.190:3300/0 conn(0x7fe1e415b970 0x7fe1e40cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/36855998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e406af70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/36855998 >> 172.21.15.179:0/36855998 conn(0x7fe1e4099a40 msgr2=0x7fe1e4099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/36855998 shutdown_connections 2023-12-07T00:14:39.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.414+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/36855998 wait complete. 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.415+0000 7fe1eb0ee700 1 Processor -- start 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.415+0000 7fe1eb0ee700 1 -- start start 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1eb0ee700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e406b4b0 0x7fe1e40b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1eb0ee700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e415b970 0x7fe1e40b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1eb0ee700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e415dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1eb0ee700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40b38f0 con 0x7fe1e415caa0 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1eb0ee700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40b0a80 con 0x7fe1e406b4b0 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1eb0ee700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40b0d20 con 0x7fe1e415b970 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e968b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e415dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e968b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e415dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39784/0 (socket says 172.21.15.179:39784) 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e968b700 1 -- 172.21.15.179:0/3147315295 learned_addr learned my addr 172.21.15.179:0/3147315295 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e8e8a700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e406b4b0 0x7fe1e40b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e3fff700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e415b970 0x7fe1e40b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e968b700 1 -- 172.21.15.179:0/3147315295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e415b970 msgr2=0x7fe1e40b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e968b700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e415b970 0x7fe1e40b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e968b700 1 -- 172.21.15.179:0/3147315295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e406b4b0 msgr2=0x7fe1e40b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e968b700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e406b4b0 0x7fe1e40b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.416+0000 7fe1e968b700 1 -- 172.21.15.179:0/3147315295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0009550 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.417+0000 7fe1e968b700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e415dd30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc007df0 tx=0x7fe1dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.417+0000 7fe1e17fa700 1 -- 172.21.15.179:0/3147315295 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc00ddd0 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.417+0000 7fe1e17fa700 1 -- 172.21.15.179:0/3147315295 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc00f040 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.417+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40b1000 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.417+0000 7fe1e17fa700 1 -- 172.21.15.179:0/3147315295 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc003c60 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.417+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e40b3b40 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.418+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e40b3eb0 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.418+0000 7fe1e17fa700 1 -- 172.21.15.179:0/3147315295 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1dc004030 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.418+0000 7fe1e17fa700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe1c806aed0 0x7fe1c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.419+0000 7fe1e17fa700 1 -- 172.21.15.179:0/3147315295 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1dc089ad0 con 0x7fe1e415caa0 2023-12-07T00:14:39.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.419+0000 7fe1e8e8a700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe1c806aed0 0x7fe1c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.419+0000 7fe1e8e8a700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe1c806aed0 0x7fe1c806d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009870 tx=0x7fe1d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.422 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.423+0000 7fe1e17fa700 1 -- 172.21.15.179:0/3147315295 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1dc0548a0 con 0x7fe1e415caa0 2023-12-07T00:14:39.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.615+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1e40685f0 con 0x7fe1e415caa0 2023-12-07T00:14:39.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.615+0000 7fe1e17fa700 1 -- 172.21.15.179:0/3147315295 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1dc057ec0 con 0x7fe1e415caa0 2023-12-07T00:14:39.615 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:14:39.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe1c806aed0 msgr2=0x7fe1c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe1c806aed0 0x7fe1c806d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009870 tx=0x7fe1d8008040 comp rx=0 tx=0).stop 2023-12-07T00:14:39.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 msgr2=0x7fe1e415dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e415dd30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc007df0 tx=0x7fe1dc00d3b0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 shutdown_connections 2023-12-07T00:14:39.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe1c806aed0 0x7fe1c806d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe1e415caa0 0x7fe1e415dd30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e406b4b0 0x7fe1e40b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 --2- 172.21.15.179:0/3147315295 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e415b970 0x7fe1e40b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 >> 172.21.15.179:0/3147315295 conn(0x7fe1e4099a40 msgr2=0x7fe1e4159b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:39.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 shutdown_connections 2023-12-07T00:14:39.618 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.618+0000 7fe1eb0ee700 1 -- 172.21.15.179:0/3147315295 wait complete. 2023-12-07T00:14:39.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:14:39.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.754+0000 7f15cbf26700 1 Processor -- start 2023-12-07T00:14:39.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.754+0000 7f15cbf26700 1 -- start start 2023-12-07T00:14:39.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15cbf26700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15c40ce770 0x7f15c4070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15cbf26700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40d0ed0 0x7f15c40adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15cbf26700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c406f960 con 0x7f15c415ab70 2023-12-07T00:14:39.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15cbf26700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c415af50 con 0x7f15c40ce770 2023-12-07T00:14:39.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15cbf26700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c406fc40 con 0x7f15c40d0ed0 2023-12-07T00:14:39.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15c94c1700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15c40ce770 0x7f15c4070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15c94c1700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f15c40ce770 0x7f15c4070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39790/0 (socket says 172.21.15.179:39790) 2023-12-07T00:14:39.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15c94c1700 1 -- 172.21.15.179:0/2972225764 learned_addr learned my addr 172.21.15.179:0/2972225764 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:39.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15ca4c3700 1 --2- 172.21.15.179:0/2972225764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40d0ed0 0x7f15c40adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15c94c1700 1 -- 172.21.15.179:0/2972225764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40d0ed0 msgr2=0x7f15c40adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:39.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15c94c1700 1 --2- 172.21.15.179:0/2972225764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40d0ed0 0x7f15c40adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15c94c1700 1 -- 172.21.15.179:0/2972225764 >> v1:172.21.15.190:6789/0 conn(0x7f15c415ab70 legacy=0x7f15c40d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15c94c1700 1 -- 172.21.15.179:0/2972225764 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40cf110 con 0x7f15c40ce770 2023-12-07T00:14:39.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.755+0000 7f15c8cc0700 1 -- 172.21.15.179:0/2972225764 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640550821 0 0) 0x7f15c406f960 con 0x7f15c415ab70 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15c94c1700 1 --2- 172.21.15.179:0/2972225764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c40ce770 0x7f15c4070880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15c000bb90 tx=0x7f15c000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842c0aef3e55c934 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15c8cc0700 1 -- 172.21.15.179:0/2972225764 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c000dd30 con 0x7f15c40ce770 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15c8cc0700 1 -- 172.21.15.179:0/2972225764 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c000de90 con 0x7f15c40ce770 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15c8cc0700 1 -- 172.21.15.179:0/2972225764 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0010690 con 0x7f15c40ce770 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15cbf26700 1 -- 172.21.15.179:0/2972225764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c40ce770 msgr2=0x7f15c4070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15cbf26700 1 --2- 172.21.15.179:0/2972225764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c40ce770 0x7f15c4070880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15c000bb90 tx=0x7f15c000bea0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15cbf26700 1 -- 172.21.15.179:0/2972225764 shutdown_connections 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15cbf26700 1 --2- 172.21.15.179:0/2972225764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40d0ed0 0x7f15c40adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15cbf26700 1 --2- 172.21.15.179:0/2972225764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c40ce770 0x7f15c4070880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15cbf26700 1 -- 172.21.15.179:0/2972225764 >> 172.21.15.179:0/2972225764 conn(0x7f15c4099a40 msgr2=0x7f15c4099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15cbf26700 1 -- 172.21.15.179:0/2972225764 shutdown_connections 2023-12-07T00:14:39.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.756+0000 7f15cbf26700 1 -- 172.21.15.179:0/2972225764 wait complete. 2023-12-07T00:14:39.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.758+0000 7f15cbf26700 1 Processor -- start 2023-12-07T00:14:39.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.758+0000 7f15cbf26700 1 -- start start 2023-12-07T00:14:39.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15cbf26700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40ce770 0x7f15c414d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15cbf26700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15c40d0ed0 0x7f15c40ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15cbf26700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c415ab70 0x7f15c40c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15cbf26700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c414dd90 con 0x7f15c415ab70 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15cbf26700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40c9f90 con 0x7f15c40d0ed0 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15cbf26700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40c8cd0 con 0x7f15c40ce770 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15ca4c3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c415ab70 0x7f15c40c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15ca4c3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c415ab70 0x7f15c40c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39798/0 (socket says 172.21.15.179:39798) 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15ca4c3700 1 -- 172.21.15.179:0/3719313368 learned_addr learned my addr 172.21.15.179:0/3719313368 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15c94c1700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15c40d0ed0 0x7f15c40ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15c9cc2700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40ce770 0x7f15c414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15ca4c3700 1 -- 172.21.15.179:0/3719313368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40ce770 msgr2=0x7f15c414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15ca4c3700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40ce770 0x7f15c414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15ca4c3700 1 -- 172.21.15.179:0/3719313368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15c40d0ed0 msgr2=0x7f15c40ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15ca4c3700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15c40d0ed0 0x7f15c40ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.759+0000 7f15ca4c3700 1 -- 172.21.15.179:0/3719313368 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c000b7f0 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.760+0000 7f15ca4c3700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c415ab70 0x7f15c40c4640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00efc0 tx=0x7f15bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.760+0000 7f15ba7fc700 1 -- 172.21.15.179:0/3719313368 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00cc90 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.760+0000 7f15ba7fc700 1 -- 172.21.15.179:0/3719313368 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc00f040 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.760+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c40c89f0 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.760+0000 7f15ba7fc700 1 -- 172.21.15.179:0/3719313368 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0146c0 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.760+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c40c9c20 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.761+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c40c4440 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.761+0000 7f15ba7fc700 1 -- 172.21.15.179:0/3719313368 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15bc014820 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.762+0000 7f15ba7fc700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f15a806aed0 0x7f15a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.762+0000 7f15ba7fc700 1 -- 172.21.15.179:0/3719313368 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15bc08a400 con 0x7f15c415ab70 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.762+0000 7f15c9cc2700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f15a806aed0 0x7f15a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:39.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.762+0000 7f15c9cc2700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f15a806aed0 0x7f15a806d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f15b4000f60 tx=0x7f15b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:39.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.766+0000 7f15ba7fc700 1 -- 172.21.15.179:0/3719313368 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15bc055250 con 0x7f15c415ab70 2023-12-07T00:14:39.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.957+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f15c40aebe0 con 0x7f15c415ab70 2023-12-07T00:14:39.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.958+0000 7f15ba7fc700 1 -- 172.21.15.179:0/3719313368 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f15bc009ca0 con 0x7f15c415ab70 2023-12-07T00:14:39.957 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:39.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f15a806aed0 msgr2=0x7f15a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f15a806aed0 0x7f15a806d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f15b4000f60 tx=0x7f15b4009040 comp rx=0 tx=0).stop 2023-12-07T00:14:39.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c415ab70 msgr2=0x7f15c40c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:39.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c415ab70 0x7f15c40c4640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00efc0 tx=0x7f15bc00c3a0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 shutdown_connections 2023-12-07T00:14:39.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f15a806aed0 0x7f15a806d390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f15c415ab70 0x7f15c40c4640 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f15c40ce770 0x7f15c414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 --2- 172.21.15.179:0/3719313368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f15c40d0ed0 0x7f15c40ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:39.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 >> 172.21.15.179:0/3719313368 conn(0x7f15c4099a40 msgr2=0x7f15c40ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:39.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 shutdown_connections 2023-12-07T00:14:39.960 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:39.960+0000 7f15cbf26700 1 -- 172.21.15.179:0/3719313368 wait complete. 2023-12-07T00:14:39.971 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:14:40.091 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.092+0000 7f75e069f700 1 Processor -- start 2023-12-07T00:14:40.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.092+0000 7f75e069f700 1 -- start start 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.093+0000 7f75e069f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75d80b1170 0x7f75d8099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.093+0000 7f75e069f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d80b07f0 con 0x7f75d815ad10 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.093+0000 7f75e069f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d80cc690 con 0x7f75d80b3c50 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.093+0000 7f75e069f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d80b4080 con 0x7f75d80b1170 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.093+0000 7f75ddc3a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75d80b1170 0x7f75d8099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.093+0000 7f75de43b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f75d815ad10 0x7f75d80b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46704/0 (socket says 172.21.15.179:46704) 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.093+0000 7f75de43b700 1 -- 172.21.15.179:0/3669755528 learned_addr learned my addr 172.21.15.179:0/3669755528 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.093+0000 7f75ddc3a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f75d80b1170 0x7f75d8099a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39804/0 (socket says 172.21.15.179:39804) 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75ddc3a700 1 -- 172.21.15.179:0/3669755528 >> v1:172.21.15.190:6789/0 conn(0x7f75d80b3c50 legacy=0x7f75d806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75ddc3a700 1 -- 172.21.15.179:0/3669755528 >> v1:172.21.15.179:6789/0 conn(0x7f75d815ad10 legacy=0x7f75d80b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.094 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75ddc3a700 1 -- 172.21.15.179:0/3669755528 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d80cc3f0 con 0x7f75d80b1170 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75dd439700 1 -- 172.21.15.179:0/3669755528 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011539947 0 0) 0x7f75d80b07f0 con 0x7f75d815ad10 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75ddc3a700 1 --2- 172.21.15.179:0/3669755528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d80b1170 0x7f75d8099a40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f75d80b0980 tx=0x7f75d4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c206b58a84d9b10c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75dd439700 1 -- 172.21.15.179:0/3669755528 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4011830 con 0x7f75d80b1170 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75dd439700 1 -- 172.21.15.179:0/3669755528 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4011990 con 0x7f75d80b1170 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75dd439700 1 -- 172.21.15.179:0/3669755528 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4011d20 con 0x7f75d80b1170 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75e069f700 1 -- 172.21.15.179:0/3669755528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d80b1170 msgr2=0x7f75d8099a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.094+0000 7f75e069f700 1 --2- 172.21.15.179:0/3669755528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d80b1170 0x7f75d8099a40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f75d80b0980 tx=0x7f75d4009b20 comp rx=0 tx=0).stop 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.095+0000 7f75e069f700 1 -- 172.21.15.179:0/3669755528 shutdown_connections 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.095+0000 7f75e069f700 1 --2- 172.21.15.179:0/3669755528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d80b1170 0x7f75d8099a40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.095+0000 7f75e069f700 1 -- 172.21.15.179:0/3669755528 >> 172.21.15.179:0/3669755528 conn(0x7f75d8072660 msgr2=0x7f75d80b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.095+0000 7f75e069f700 1 -- 172.21.15.179:0/3669755528 shutdown_connections 2023-12-07T00:14:40.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.095+0000 7f75e069f700 1 -- 172.21.15.179:0/3669755528 wait complete. 2023-12-07T00:14:40.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.096+0000 7f75e069f700 1 Processor -- start 2023-12-07T00:14:40.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.096+0000 7f75e069f700 1 -- start start 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.096+0000 7f75e069f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75d80b1170 0x7f75d80c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75e069f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75d80b3c50 0x7f75d81f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75e069f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d815ad10 0x7f75d80cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75e069f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8158650 con 0x7f75d815ad10 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75e069f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8158300 con 0x7f75d80b3c50 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75e069f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d81f3410 con 0x7f75d80b1170 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d815ad10 0x7f75d80cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d815ad10 0x7f75d80cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39812/0 (socket says 172.21.15.179:39812) 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 -- 172.21.15.179:0/3571340549 learned_addr learned my addr 172.21.15.179:0/3571340549 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75ddc3a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75d80b3c50 0x7f75d81f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75de43b700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75d80b1170 0x7f75d80c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 -- 172.21.15.179:0/3571340549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75d80b1170 msgr2=0x7f75d80c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75d80b1170 0x7f75d80c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 -- 172.21.15.179:0/3571340549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75d80b3c50 msgr2=0x7f75d81f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75d80b3c50 0x7f75d81f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 -- 172.21.15.179:0/3571340549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d40094a0 con 0x7f75d815ad10 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75dec3c700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d815ad10 0x7f75d80cb0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75d000cc10 tx=0x7f75d000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75ceffd700 1 -- 172.21.15.179:0/3571340549 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d000aa60 con 0x7f75d815ad10 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75ceffd700 1 -- 172.21.15.179:0/3571340549 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d000abc0 con 0x7f75d815ad10 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d80cb9a0 con 0x7f75d815ad10 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75ceffd700 1 -- 172.21.15.179:0/3571340549 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0012420 con 0x7f75d815ad10 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.097+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d80cbf60 con 0x7f75d815ad10 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.098+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d8158790 con 0x7f75d815ad10 2023-12-07T00:14:40.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.099+0000 7f75ceffd700 1 -- 172.21.15.179:0/3571340549 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75d0012580 con 0x7f75d815ad10 2023-12-07T00:14:40.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.099+0000 7f75ceffd700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f75bc06aed0 0x7f75bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.099+0000 7f75ceffd700 1 -- 172.21.15.179:0/3571340549 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75d0089b40 con 0x7f75d815ad10 2023-12-07T00:14:40.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.099+0000 7f75de43b700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f75bc06aed0 0x7f75bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.099+0000 7f75de43b700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f75bc06aed0 0x7f75bc06d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75c8000f60 tx=0x7f75c8007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.103+0000 7f75ceffd700 1 -- 172.21.15.179:0/3571340549 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75d8158790 con 0x7f75d815ad10 2023-12-07T00:14:40.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.336+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75d8158790 con 0x7f75d815ad10 2023-12-07T00:14:40.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.337+0000 7f75ceffd700 1 -- 172.21.15.179:0/3571340549 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f75d8158790 con 0x7f75d815ad10 2023-12-07T00:14:40.336 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:40.336 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:31.106814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T00:14:40.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f75bc06aed0 msgr2=0x7f75bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f75bc06aed0 0x7f75bc06d390 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75c8000f60 tx=0x7f75c8007e70 comp rx=0 tx=0).stop 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d815ad10 msgr2=0x7f75d80cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d815ad10 0x7f75d80cb0c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75d000cc10 tx=0x7f75d000cf20 comp rx=0 tx=0).stop 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 shutdown_connections 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f75bc06aed0 0x7f75bc06d390 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f75d815ad10 0x7f75d80cb0c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75d80b1170 0x7f75d80c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 --2- 172.21.15.179:0/3571340549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75d80b3c50 0x7f75d81f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 >> 172.21.15.179:0/3571340549 conn(0x7f75d8072660 msgr2=0x7f75d80b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 shutdown_connections 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.339+0000 7f75e069f700 1 -- 172.21.15.179:0/3571340549 wait complete. 2023-12-07T00:14:40.339 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 9 2023-12-07T00:14:40.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:40.471 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.472+0000 7fe040624700 1 Processor -- start 2023-12-07T00:14:40.471 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.472+0000 7fe040624700 1 -- start start 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe040624700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe03815de40 0x7fe0380b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe040624700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03815f330 con 0x7fe0380b2c70 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe040624700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03815e720 con 0x7fe03815e220 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe040624700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380d1820 con 0x7fe03815de40 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe03ebc1700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe0380b2c70 0x7fe03815f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46722/0 (socket says 172.21.15.179:46722) 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe03ebc1700 1 -- 172.21.15.179:0/3350162116 learned_addr learned my addr 172.21.15.179:0/3350162116 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe03e3c0700 1 --2- 172.21.15.179:0/3350162116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe03815de40 0x7fe0380b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe03d3be700 1 -- 172.21.15.179:0/3350162116 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2587907584 0 0) 0x7fe03815f330 con 0x7fe0380b2c70 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.473+0000 7fe03d3be700 1 -- 172.21.15.179:0/3350162116 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0240035b0 con 0x7fe0380b2c70 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03d3be700 1 -- 172.21.15.179:0/3350162116 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928802377 0 0) 0x7fe03815e720 con 0x7fe03815e220 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03d3be700 1 -- 172.21.15.179:0/3350162116 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03815f330 con 0x7fe03815e220 2023-12-07T00:14:40.474 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03d3be700 1 -- 172.21.15.179:0/3350162116 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3161786893 0 0) 0x7fe0240035b0 con 0x7fe0380b2c70 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03e3c0700 1 -- 172.21.15.179:0/3350162116 >> v1:172.21.15.190:6789/0 conn(0x7fe03815e220 legacy=0x7fe0380b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03e3c0700 1 -- 172.21.15.179:0/3350162116 >> v1:172.21.15.179:6789/0 conn(0x7fe0380b2c70 legacy=0x7fe03815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03e3c0700 1 -- 172.21.15.179:0/3350162116 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03815ea00 con 0x7fe03815de40 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03e3c0700 1 --2- 172.21.15.179:0/3350162116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe03815de40 0x7fe0380b46e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe028009870 tx=0x7fe028009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee31b658cab20731 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03d3be700 1 -- 172.21.15.179:0/3350162116 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0300019f0 con 0x7fe03815de40 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03d3be700 1 -- 172.21.15.179:0/3350162116 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe028004030 con 0x7fe03815de40 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe03d3be700 1 -- 172.21.15.179:0/3350162116 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0280043a0 con 0x7fe03815de40 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe040624700 1 -- 172.21.15.179:0/3350162116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe03815de40 msgr2=0x7fe0380b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.474+0000 7fe040624700 1 --2- 172.21.15.179:0/3350162116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe03815de40 0x7fe0380b46e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe028009870 tx=0x7fe028009b80 comp rx=0 tx=0).stop 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.475+0000 7fe040624700 1 -- 172.21.15.179:0/3350162116 shutdown_connections 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.475+0000 7fe040624700 1 --2- 172.21.15.179:0/3350162116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe03815de40 0x7fe0380b46e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.475+0000 7fe040624700 1 -- 172.21.15.179:0/3350162116 >> 172.21.15.179:0/3350162116 conn(0x7fe038072970 msgr2=0x7fe038072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.475+0000 7fe040624700 1 -- 172.21.15.179:0/3350162116 shutdown_connections 2023-12-07T00:14:40.475 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.475+0000 7fe040624700 1 -- 172.21.15.179:0/3350162116 wait complete. 2023-12-07T00:14:40.478 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.476+0000 7fe040624700 1 Processor -- start 2023-12-07T00:14:40.478 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.476+0000 7fe040624700 1 -- start start 2023-12-07T00:14:40.478 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.476+0000 7fe040624700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0380b2c70 0x7fe03814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe040624700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe03815de40 0x7fe03815ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.481 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe040624700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe03815e220 0x7fe03815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe040624700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe038155fe0 con 0x7fe03815de40 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe040624700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03815a420 con 0x7fe03815e220 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe040624700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03815a700 con 0x7fe0380b2c70 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe03815de40 0x7fe03815ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe03815de40 0x7fe03815ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39824/0 (socket says 172.21.15.179:39824) 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 -- 172.21.15.179:0/44950504 learned_addr learned my addr 172.21.15.179:0/44950504 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03ebc1700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe03815e220 0x7fe03815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03e3c0700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0380b2c70 0x7fe03814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 -- 172.21.15.179:0/44950504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0380b2c70 msgr2=0x7fe03814b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0380b2c70 0x7fe03814b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.482 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 -- 172.21.15.179:0/44950504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe03815e220 msgr2=0x7fe03815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe03815e220 0x7fe03815b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 -- 172.21.15.179:0/44950504 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0280094a0 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe03dbbf700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe03815de40 0x7fe03815ae90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c700 tx=0x7fe03400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe02effd700 1 -- 172.21.15.179:0/44950504 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0340052d0 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe02effd700 1 -- 172.21.15.179:0/44950504 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe034005430 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03815a9e0 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe02effd700 1 -- 172.21.15.179:0/44950504 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0340038f0 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.477+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0381596b0 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.478+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03804f290 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.479+0000 7fe02effd700 1 -- 172.21.15.179:0/44950504 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe034003a50 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.479+0000 7fe02effd700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe01c06aed0 0x7fe01c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.479+0000 7fe02effd700 1 -- 172.21.15.179:0/44950504 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe034088eb0 con 0x7fe03815de40 2023-12-07T00:14:40.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.479+0000 7fe03e3c0700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe01c06aed0 0x7fe01c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.484 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.480+0000 7fe03e3c0700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe01c06aed0 0x7fe01c06d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe0280090b0 tx=0x7fe028008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.484 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.483+0000 7fe02effd700 1 -- 172.21.15.179:0/44950504 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe034053c70 con 0x7fe03815de40 2023-12-07T00:14:40.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.676+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0380685f0 con 0x7fe03815de40 2023-12-07T00:14:40.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.677+0000 7fe02effd700 1 -- 172.21.15.179:0/44950504 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fe034017090 con 0x7fe03815de40 2023-12-07T00:14:40.677 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:40.677 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe01c06aed0 msgr2=0x7fe01c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe01c06aed0 0x7fe01c06d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe0280090b0 tx=0x7fe028008030 comp rx=0 tx=0).stop 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe03815de40 msgr2=0x7fe03815ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe03815de40 0x7fe03815ae90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c700 tx=0x7fe03400cac0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 shutdown_connections 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe01c06aed0 0x7fe01c06d390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe03815e220 0x7fe03815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe0380b2c70 0x7fe03814b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 --2- 172.21.15.179:0/44950504 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe03815de40 0x7fe03815ae90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.679+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 >> 172.21.15.179:0/44950504 conn(0x7fe038072970 msgr2=0x7fe0380b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:40.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.680+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 shutdown_connections 2023-12-07T00:14:40.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.680+0000 7fe040624700 1 -- 172.21.15.179:0/44950504 wait complete. 2023-12-07T00:14:40.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:40.692 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:40.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.816+0000 7f9b25033700 1 Processor -- start 2023-12-07T00:14:40.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.816+0000 7f9b25033700 1 -- start start 2023-12-07T00:14:40.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b25033700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9b200ccee0 0x7f9b2015fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b25033700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b201602f0 0x7f9b200cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b25033700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2015c690 con 0x7f9b2015bba0 2023-12-07T00:14:40.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b25033700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b200b03e0 con 0x7f9b201602f0 2023-12-07T00:14:40.818 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b25033700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2015f640 con 0x7f9b200ccee0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b1f59e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9b201602f0 0x7f9b200cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b1ed9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9b2015bba0 0x7f9b2015bf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46732/0 (socket says 172.21.15.179:46732) 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b1ed9d700 1 -- 172.21.15.179:0/3450921962 learned_addr learned my addr 172.21.15.179:0/3450921962 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.817+0000 7f9b1e59c700 1 --2- 172.21.15.179:0/3450921962 >> v2:172.21.15.190:3300/0 conn(0x7f9b200ccee0 0x7f9b2015fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1f59e700 1 -- 172.21.15.179:0/3450921962 >> v2:172.21.15.190:3300/0 conn(0x7f9b200ccee0 msgr2=0x7f9b2015fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1f59e700 1 --2- 172.21.15.179:0/3450921962 >> v2:172.21.15.190:3300/0 conn(0x7f9b200ccee0 0x7f9b2015fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1f59e700 1 -- 172.21.15.179:0/3450921962 >> v1:172.21.15.179:6789/0 conn(0x7f9b2015bba0 legacy=0x7f9b2015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1f59e700 1 -- 172.21.15.179:0/3450921962 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2015c8c0 con 0x7f9b201602f0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1dd9b700 1 -- 172.21.15.179:0/3450921962 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092160202 0 0) 0x7f9b2015c690 con 0x7f9b2015bba0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1e59c700 1 --2- 172.21.15.179:0/3450921962 >> v2:172.21.15.190:3300/0 conn(0x7f9b200ccee0 0x7f9b2015fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1f59e700 1 --2- 172.21.15.179:0/3450921962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b201602f0 0x7f9b200cf890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b20072f10 tx=0x7f9b1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634babfc6ce358f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1dd9b700 1 -- 172.21.15.179:0/3450921962 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800e070 con 0x7f9b201602f0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1dd9b700 1 -- 172.21.15.179:0/3450921962 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1800bbd0 con 0x7f9b201602f0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b1dd9b700 1 -- 172.21.15.179:0/3450921962 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18012430 con 0x7f9b201602f0 2023-12-07T00:14:40.819 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b25033700 1 -- 172.21.15.179:0/3450921962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b201602f0 msgr2=0x7f9b200cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b25033700 1 --2- 172.21.15.179:0/3450921962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b201602f0 0x7f9b200cf890 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9b20072f10 tx=0x7f9b1800b330 comp rx=0 tx=0).stop 2023-12-07T00:14:40.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b25033700 1 -- 172.21.15.179:0/3450921962 shutdown_connections 2023-12-07T00:14:40.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b25033700 1 --2- 172.21.15.179:0/3450921962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b201602f0 0x7f9b200cf890 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b25033700 1 --2- 172.21.15.179:0/3450921962 >> v2:172.21.15.190:3300/0 conn(0x7f9b200ccee0 0x7f9b2015fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b25033700 1 -- 172.21.15.179:0/3450921962 >> 172.21.15.179:0/3450921962 conn(0x7f9b20099a40 msgr2=0x7f9b20099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:40.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b25033700 1 -- 172.21.15.179:0/3450921962 shutdown_connections 2023-12-07T00:14:40.820 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.818+0000 7f9b25033700 1 -- 172.21.15.179:0/3450921962 wait complete. 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.820+0000 7f9b25033700 1 Processor -- start 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.820+0000 7f9b25033700 1 -- start start 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b25033700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b200ccee0 0x7f9b200ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b25033700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b2015bba0 0x7f9b200aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b25033700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20156700 0x7f9b20155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b25033700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20156b90 con 0x7f9b2015bba0 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b25033700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2015b2c0 con 0x7f9b20156700 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b25033700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b20156d70 con 0x7f9b200ccee0 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b2015bba0 0x7f9b200aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.823 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b2015bba0 0x7f9b200aeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39836/0 (socket says 172.21.15.179:39836) 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 -- 172.21.15.179:0/3077976033 learned_addr learned my addr 172.21.15.179:0/3077976033 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1f59e700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20156700 0x7f9b20155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1ed9d700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b200ccee0 0x7f9b200ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 -- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b200ccee0 msgr2=0x7f9b200ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b200ccee0 0x7f9b200ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 -- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20156700 msgr2=0x7f9b20155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20156700 0x7f9b20155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 -- 172.21.15.179:0/3077976033 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18009a70 con 0x7f9b2015bba0 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1ed9d700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b200ccee0 0x7f9b200ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b1e59c700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b2015bba0 0x7f9b200aeb70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400c750 tx=0x7f9b1400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b077fe700 1 -- 172.21.15.179:0/3077976033 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011800 con 0x7f9b2015bba0 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b077fe700 1 -- 172.21.15.179:0/3077976033 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b14011960 con 0x7f9b2015bba0 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b20157050 con 0x7f9b2015bba0 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.821+0000 7f9b077fe700 1 -- 172.21.15.179:0/3077976033 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011cd0 con 0x7f9b2015bba0 2023-12-07T00:14:40.824 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.822+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b200af0b0 con 0x7f9b2015bba0 2023-12-07T00:14:40.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.822+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b200685f0 con 0x7f9b2015bba0 2023-12-07T00:14:40.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.823+0000 7f9b077fe700 1 -- 172.21.15.179:0/3077976033 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b14021350 con 0x7f9b2015bba0 2023-12-07T00:14:40.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.824+0000 7f9b077fe700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9b0c06aed0 0x7f9b0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:40.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.824+0000 7f9b077fe700 1 -- 172.21.15.179:0/3077976033 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b14089840 con 0x7f9b2015bba0 2023-12-07T00:14:40.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.824+0000 7f9b1ed9d700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9b0c06aed0 0x7f9b0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:40.825 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.824+0000 7f9b1ed9d700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9b0c06aed0 0x7f9b0c06d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b10000f60 tx=0x7f9b10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:40.827 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:40.828+0000 7f9b077fe700 1 -- 172.21.15.179:0/3077976033 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b14054690 con 0x7f9b2015bba0 2023-12-07T00:14:41.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.017+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b200b6a20 con 0x7f9b2015bba0 2023-12-07T00:14:41.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.017+0000 7f9b077fe700 1 -- 172.21.15.179:0/3077976033 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b14057cb0 con 0x7f9b2015bba0 2023-12-07T00:14:41.017 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.019+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9b0c06aed0 msgr2=0x7f9b0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.019+0000 7f9b25033700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9b0c06aed0 0x7f9b0c06d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b10000f60 tx=0x7f9b10009040 comp rx=0 tx=0).stop 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.019+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b2015bba0 msgr2=0x7f9b200aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.019+0000 7f9b25033700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b2015bba0 0x7f9b200aeb70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400c750 tx=0x7f9b1400cb10 comp rx=0 tx=0).stop 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.020+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 shutdown_connections 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.020+0000 7f9b25033700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9b0c06aed0 0x7f9b0c06d390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.020+0000 7f9b25033700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20156700 0x7f9b20155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.020+0000 7f9b25033700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b200ccee0 0x7f9b200ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.020+0000 7f9b25033700 1 --2- 172.21.15.179:0/3077976033 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9b2015bba0 0x7f9b200aeb70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.020+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 >> 172.21.15.179:0/3077976033 conn(0x7f9b20099a40 msgr2=0x7f9b20099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:41.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.020+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 shutdown_connections 2023-12-07T00:14:41.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.020+0000 7f9b25033700 1 -- 172.21.15.179:0/3077976033 wait complete. 2023-12-07T00:14:41.031 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:14:41.153 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.154+0000 7efbf4de2700 1 Processor -- start 2023-12-07T00:14:41.153 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.154+0000 7efbf4de2700 1 -- start start 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbf4de2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efbf00cc590 0x7efbf00cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbf4de2700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf00ccac0 con 0x7efbf015bd70 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbf4de2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf00ccda0 con 0x7efbf0099b90 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbf4de2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf00cd740 con 0x7efbf00cc590 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbee59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7efbf015bd70 0x7efbf00d01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46744/0 (socket says 172.21.15.179:46744) 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbee59c700 1 -- 172.21.15.179:0/3547933867 learned_addr learned my addr 172.21.15.179:0/3547933867 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbedd9b700 1 --2- 172.21.15.179:0/3547933867 >> v2:172.21.15.190:3300/0 conn(0x7efbf00cc590 0x7efbf00cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054550277 0 0) 0x7efbf00ccac0 con 0x7efbf015bd70 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.155+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbd80035b0 con 0x7efbf015bd70 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508616710 0 0) 0x7efbd80035b0 con 0x7efbf015bd70 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 >> v2:172.21.15.190:3300/0 conn(0x7efbf00cc590 msgr2=0x7efbf00cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 --2- 172.21.15.179:0/3547933867 >> v2:172.21.15.190:3300/0 conn(0x7efbf00cc590 0x7efbf00cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 >> v1:172.21.15.190:6789/0 conn(0x7efbf0099b90 legacy=0x7efbf00c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf00cd080 con 0x7efbf015bd70 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7efbe0001670 con 0x7efbf015bd70 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbedd9b700 1 --2- 172.21.15.179:0/3547933867 >> v2:172.21.15.190:3300/0 conn(0x7efbf00cc590 0x7efbf00cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 >> v1:172.21.15.179:6789/0 conn(0x7efbf015bd70 legacy=0x7efbf00d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbd8003a00 0x7efbd8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8004850 0x7efbd8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbd8005210 0x7efbd800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00cd740 con 0x7efbd8005210 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbd800c1b0 con 0x7efbd8003a00 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbd800c370 con 0x7efbd8004850 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbeed9d700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbd8005210 0x7efbd800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbee59c700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbd8003a00 0x7efbd8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbedd9b700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8004850 0x7efbd8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbeed9d700 1 -- 172.21.15.179:0/3547933867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8004850 msgr2=0x7efbd8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:41.158 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbeed9d700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8004850 0x7efbd8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbeed9d700 1 -- 172.21.15.179:0/3547933867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbd8003a00 msgr2=0x7efbd8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbeed9d700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbd8003a00 0x7efbd8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbeed9d700 1 -- 172.21.15.179:0/3547933867 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbd80035b0 con 0x7efbd8005210 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbeed9d700 1 -- 172.21.15.179:0/3547933867 reap_dead start 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbeed9d700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbd8005210 0x7efbd800ba10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efbe800c190 tx=0x7efbd8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47cfeb0427908e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8001db0 con 0x7efbd8005210 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe800ccf0 con 0x7efbd8005210 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.156+0000 7efbed59a700 1 -- 172.21.15.179:0/3547933867 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8003c40 con 0x7efbd8005210 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.157+0000 7efbf4de2700 1 -- 172.21.15.179:0/3547933867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbd8005210 msgr2=0x7efbd800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.157+0000 7efbf4de2700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbd8005210 0x7efbd800ba10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efbe800c190 tx=0x7efbd8005880 comp rx=0 tx=0).stop 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.157+0000 7efbf4de2700 1 -- 172.21.15.179:0/3547933867 shutdown_connections 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.157+0000 7efbf4de2700 1 --2- 172.21.15.179:0/3547933867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbd8005210 0x7efbd800ba10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.157+0000 7efbf4de2700 1 -- 172.21.15.179:0/3547933867 >> 172.21.15.179:0/3547933867 conn(0x7efbf00b34e0 msgr2=0x7efbf00b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.157+0000 7efbf4de2700 1 -- 172.21.15.179:0/3547933867 shutdown_connections 2023-12-07T00:14:41.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.157+0000 7efbf4de2700 1 -- 172.21.15.179:0/3547933867 wait complete. 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.158+0000 7efbf4de2700 1 Processor -- start 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.158+0000 7efbf4de2700 1 -- start start 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbf4de2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8005210 0x7efbf015d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbf4de2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbf00c9d70 0x7efbf00ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbf4de2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbf00c8ac0 0x7efbf00c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbf4de2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00caa80 con 0x7efbf00c8ac0 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbf4de2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00cad60 con 0x7efbf00c9d70 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbf4de2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf00cb040 con 0x7efbd8005210 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbeed9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbf00c8ac0 0x7efbf00c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbeed9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbf00c8ac0 0x7efbf00c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39858/0 (socket says 172.21.15.179:39858) 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.159+0000 7efbeed9d700 1 -- 172.21.15.179:0/3032178006 learned_addr learned my addr 172.21.15.179:0/3032178006 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbedd9b700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbf00c9d70 0x7efbf00ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.163 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbee59c700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8005210 0x7efbf015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbeed9d700 1 -- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8005210 msgr2=0x7efbf015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbeed9d700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8005210 0x7efbf015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbeed9d700 1 -- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbf00c9d70 msgr2=0x7efbf00ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbeed9d700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbf00c9d70 0x7efbf00ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbeed9d700 1 -- 172.21.15.179:0/3032178006 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf00cb320 con 0x7efbf00c8ac0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbedd9b700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbf00c9d70 0x7efbf00ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbee59c700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8005210 0x7efbf015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbeed9d700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbf00c8ac0 0x7efbf00c8f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efbe8005040 tx=0x7efbe80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbdeffd700 1 -- 172.21.15.179:0/3032178006 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80052d0 con 0x7efbf00c8ac0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbdeffd700 1 -- 172.21.15.179:0/3032178006 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8005430 con 0x7efbf00c8ac0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf00cb600 con 0x7efbf00c8ac0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbdeffd700 1 -- 172.21.15.179:0/3032178006 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80057a0 con 0x7efbf00c8ac0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.160+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf015db40 con 0x7efbf00c8ac0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.161+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf00685f0 con 0x7efbf00c8ac0 2023-12-07T00:14:41.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.161+0000 7efbdeffd700 1 -- 172.21.15.179:0/3032178006 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efbe801d480 con 0x7efbf00c8ac0 2023-12-07T00:14:41.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.162+0000 7efbdeffd700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efbd006aed0 0x7efbd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.162+0000 7efbdeffd700 1 -- 172.21.15.179:0/3032178006 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efbe808a490 con 0x7efbf00c8ac0 2023-12-07T00:14:41.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.162+0000 7efbee59c700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efbd006aed0 0x7efbd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.162+0000 7efbee59c700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efbd006aed0 0x7efbd006d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbe0000c00 tx=0x7efbe0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.166+0000 7efbdeffd700 1 -- 172.21.15.179:0/3032178006 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efbe8055390 con 0x7efbf00c8ac0 2023-12-07T00:14:41.356 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.357+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efbf01f1bf0 con 0x7efbf00c8ac0 2023-12-07T00:14:41.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.358+0000 7efbdeffd700 1 -- 172.21.15.179:0/3032178006 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7efbf01f1bf0 con 0x7efbf00c8ac0 2023-12-07T00:14:41.357 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:41.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efbd006aed0 msgr2=0x7efbd006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efbd006aed0 0x7efbd006d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbe0000c00 tx=0x7efbe0009040 comp rx=0 tx=0).stop 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbf00c8ac0 msgr2=0x7efbf00c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbf00c8ac0 0x7efbf00c8f70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efbe8005040 tx=0x7efbe80014a0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 shutdown_connections 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7efbd006aed0 0x7efbd006d390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efbf00c8ac0 0x7efbf00c8f70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efbd8005210 0x7efbf015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 --2- 172.21.15.179:0/3032178006 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efbf00c9d70 0x7efbf00ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 >> 172.21.15.179:0/3032178006 conn(0x7efbf00b34e0 msgr2=0x7efbf015ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 shutdown_connections 2023-12-07T00:14:41.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.360+0000 7efbf4de2700 1 -- 172.21.15.179:0/3032178006 wait complete. 2023-12-07T00:14:41.372 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:14:41.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.496+0000 7f8839da7700 1 Processor -- start 2023-12-07T00:14:41.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.496+0000 7f8839da7700 1 -- start start 2023-12-07T00:14:41.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8839da7700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f883409a2a0 0x7f88340cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8839da7700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340ccac0 con 0x7f883415bd70 2023-12-07T00:14:41.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8839da7700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340ccda0 con 0x7f88340cc590 2023-12-07T00:14:41.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8839da7700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88340cd740 con 0x7f883409a2a0 2023-12-07T00:14:41.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8833fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f883409a2a0 0x7f88340cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f88337fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f883415bd70 0x7f88340d01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46764/0 (socket says 172.21.15.179:46764) 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8833fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f883409a2a0 0x7f88340cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39866/0 (socket says 172.21.15.179:39866) 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f88337fe700 1 -- 172.21.15.179:0/1769492987 learned_addr learned my addr 172.21.15.179:0/1769492987 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8833fff700 1 -- 172.21.15.179:0/1769492987 >> v1:172.21.15.190:6789/0 conn(0x7f88340cc590 legacy=0x7f8834099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8833fff700 1 -- 172.21.15.179:0/1769492987 >> v1:172.21.15.179:6789/0 conn(0x7f883415bd70 legacy=0x7f88340d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f88327fc700 1 -- 172.21.15.179:0/1769492987 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983066936 0 0) 0x7f88340ccac0 con 0x7f883415bd70 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8833fff700 1 -- 172.21.15.179:0/1769492987 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340cd080 con 0x7f883409a2a0 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f8833fff700 1 --2- 172.21.15.179:0/1769492987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340cdb60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f882c009d90 tx=0x7f882c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c636b7cb4be15d7c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f88327fc700 1 -- 172.21.15.179:0/1769492987 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c00e070 con 0x7f883409a2a0 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f88327fc700 1 -- 172.21.15.179:0/1769492987 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c00bb90 con 0x7f883409a2a0 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.497+0000 7f88327fc700 1 -- 172.21.15.179:0/1769492987 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c003a20 con 0x7f883409a2a0 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.498+0000 7f8839da7700 1 -- 172.21.15.179:0/1769492987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 msgr2=0x7f88340cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.498+0000 7f8839da7700 1 --2- 172.21.15.179:0/1769492987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340cdb60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f882c009d90 tx=0x7f882c00b330 comp rx=0 tx=0).stop 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.498+0000 7f8839da7700 1 -- 172.21.15.179:0/1769492987 shutdown_connections 2023-12-07T00:14:41.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.498+0000 7f8839da7700 1 --2- 172.21.15.179:0/1769492987 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340cdb60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.498+0000 7f8839da7700 1 -- 172.21.15.179:0/1769492987 >> 172.21.15.179:0/1769492987 conn(0x7f88340b34e0 msgr2=0x7f88340b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:41.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.498+0000 7f8839da7700 1 -- 172.21.15.179:0/1769492987 shutdown_connections 2023-12-07T00:14:41.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.498+0000 7f8839da7700 1 -- 172.21.15.179:0/1769492987 wait complete. 2023-12-07T00:14:41.500 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.499+0000 7f8839da7700 1 Processor -- start 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.499+0000 7f8839da7700 1 -- start start 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8839da7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340b6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8839da7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88340cc590 0x7f88340c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8839da7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883415bd70 0x7f88341f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8839da7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88341f1530 con 0x7f883409a2a0 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8839da7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88340b5880 con 0x7f88340cc590 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8839da7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88340c9150 con 0x7f883415bd70 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f88337fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340b6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f88337fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340b6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39868/0 (socket says 172.21.15.179:39868) 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f88337fe700 1 -- 172.21.15.179:0/2212670108 learned_addr learned my addr 172.21.15.179:0/2212670108 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8833fff700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883415bd70 0x7f88341f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8832ffd700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88340cc590 0x7f88340c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f88337fe700 1 -- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883415bd70 msgr2=0x7f88341f0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f88337fe700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883415bd70 0x7f88341f0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f88337fe700 1 -- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88340cc590 msgr2=0x7f88340c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f88337fe700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88340cc590 0x7f88340c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f88337fe700 1 -- 172.21.15.179:0/2212670108 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c009a70 con 0x7f883409a2a0 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8833fff700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883415bd70 0x7f88341f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.500+0000 7f8832ffd700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88340cc590 0x7f88340c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.501+0000 7f88337fe700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340b6e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f882400c520 tx=0x7f882400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.501+0000 7f881bfff700 1 -- 172.21.15.179:0/2212670108 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824004c80 con 0x7f883409a2a0 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.501+0000 7f881bfff700 1 -- 172.21.15.179:0/2212670108 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8824004e20 con 0x7f883409a2a0 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.501+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88340c9430 con 0x7f883409a2a0 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.501+0000 7f881bfff700 1 -- 172.21.15.179:0/2212670108 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824007310 con 0x7f883409a2a0 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.501+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88340c99f0 con 0x7f883409a2a0 2023-12-07T00:14:41.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.502+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88340685f0 con 0x7f883409a2a0 2023-12-07T00:14:41.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.502+0000 7f881bfff700 1 -- 172.21.15.179:0/2212670108 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8824007470 con 0x7f883409a2a0 2023-12-07T00:14:41.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.503+0000 7f881bfff700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f882006aed0 0x7f882006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.503+0000 7f8832ffd700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f882006aed0 0x7f882006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.503+0000 7f881bfff700 1 -- 172.21.15.179:0/2212670108 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88240896c0 con 0x7f883409a2a0 2023-12-07T00:14:41.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.503+0000 7f8832ffd700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f882006aed0 0x7f882006d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88340b75f0 tx=0x7f8828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.506 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.507+0000 7f881bfff700 1 -- 172.21.15.179:0/2212670108 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8824054360 con 0x7f883409a2a0 2023-12-07T00:14:41.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.697+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88340b43d0 con 0x7f883409a2a0 2023-12-07T00:14:41.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.698+0000 7f881bfff700 1 -- 172.21.15.179:0/2212670108 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8824057980 con 0x7f883409a2a0 2023-12-07T00:14:41.697 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:14:41.699 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f882006aed0 msgr2=0x7f882006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f882006aed0 0x7f882006d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f88340b75f0 tx=0x7f8828009040 comp rx=0 tx=0).stop 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 msgr2=0x7f88340b6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340b6e00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f882400c520 tx=0x7f882400c8e0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 shutdown_connections 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f882006aed0 0x7f882006d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f883415bd70 0x7f88341f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f883409a2a0 0x7f88340b6e00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 --2- 172.21.15.179:0/2212670108 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88340cc590 0x7f88340c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 >> 172.21.15.179:0/2212670108 conn(0x7f88340b34e0 msgr2=0x7f8834070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 shutdown_connections 2023-12-07T00:14:41.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.700+0000 7f8839da7700 1 -- 172.21.15.179:0/2212670108 wait complete. 2023-12-07T00:14:41.712 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:14:41.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.836+0000 7fcab2ce7700 1 Processor -- start 2023-12-07T00:14:41.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.836+0000 7fcab2ce7700 1 -- start start 2023-12-07T00:14:41.837 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcab2ce7700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcaac1624e0 0x7fcaac099b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcab2ce7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac09a0d0 0x7fcaac15d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcab2ce7700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac162970 con 0x7fcaac162100 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcab2ce7700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac09a560 con 0x7fcaac1624e0 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcab2ce7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0d03d0 con 0x7fcaac09a0d0 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcab0a83700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fcaac162100 0x7fcaac0cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46778/0 (socket says 172.21.15.179:46778) 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcaabfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcaac1624e0 0x7fcaac099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcab0a83700 1 -- 172.21.15.179:0/3202981938 learned_addr learned my addr 172.21.15.179:0/3202981938 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcab1284700 1 --2- 172.21.15.179:0/3202981938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac09a0d0 0x7fcaac15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcaabfff700 1 -- 172.21.15.179:0/3202981938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac09a0d0 msgr2=0x7fcaac15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcaabfff700 1 --2- 172.21.15.179:0/3202981938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac09a0d0 0x7fcaac15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcaabfff700 1 -- 172.21.15.179:0/3202981938 >> v1:172.21.15.179:6789/0 conn(0x7fcaac162100 legacy=0x7fcaac0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcaab7fe700 1 -- 172.21.15.179:0/3202981938 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498098898 0 0) 0x7fcaac162970 con 0x7fcaac162100 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcaabfff700 1 -- 172.21.15.179:0/3202981938 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0d06a0 con 0x7fcaac1624e0 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.837+0000 7fcaabfff700 1 --2- 172.21.15.179:0/3202981938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac1624e0 0x7fcaac099b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca98009870 tx=0x7fca98009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9aae84d6053386 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcaab7fe700 1 -- 172.21.15.179:0/3202981938 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98011830 con 0x7fcaac1624e0 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcaab7fe700 1 -- 172.21.15.179:0/3202981938 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca98011990 con 0x7fcaac1624e0 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcaab7fe700 1 -- 172.21.15.179:0/3202981938 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98011d20 con 0x7fcaac1624e0 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3202981938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac1624e0 msgr2=0x7fcaac099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3202981938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac1624e0 0x7fcaac099b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fca98009870 tx=0x7fca98009b80 comp rx=0 tx=0).stop 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3202981938 shutdown_connections 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3202981938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac09a0d0 0x7fcaac15d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3202981938 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac1624e0 0x7fcaac099b90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3202981938 >> 172.21.15.179:0/3202981938 conn(0x7fcaac0b34e0 msgr2=0x7fcaac0b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3202981938 shutdown_connections 2023-12-07T00:14:41.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.838+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3202981938 wait complete. 2023-12-07T00:14:41.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.839+0000 7fcab2ce7700 1 Processor -- start 2023-12-07T00:14:41.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.839+0000 7fcab2ce7700 1 -- start start 2023-12-07T00:14:41.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcab2ce7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaac09a0d0 0x7fcaac0c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcab2ce7700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac162100 0x7fcaac1f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcab2ce7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac1624e0 0x7fcaac15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcab2ce7700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac1f7d10 con 0x7fcaac162100 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcab2ce7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac15d480 con 0x7fcaac09a0d0 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcab2ce7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0c8f50 con 0x7fcaac1624e0 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcaabfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac162100 0x7fcaac1f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcaabfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac162100 0x7fcaac1f77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39884/0 (socket says 172.21.15.179:39884) 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.840+0000 7fcaabfff700 1 -- 172.21.15.179:0/3583908475 learned_addr learned my addr 172.21.15.179:0/3583908475 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcab0a83700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaac09a0d0 0x7fcaac0c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcab1284700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac1624e0 0x7fcaac15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaabfff700 1 -- 172.21.15.179:0/3583908475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac1624e0 msgr2=0x7fcaac15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaabfff700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac1624e0 0x7fcaac15cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaabfff700 1 -- 172.21.15.179:0/3583908475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaac09a0d0 msgr2=0x7fcaac0c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaabfff700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaac09a0d0 0x7fcaac0c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaabfff700 1 -- 172.21.15.179:0/3583908475 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca980094a0 con 0x7fcaac162100 2023-12-07T00:14:41.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaabfff700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac162100 0x7fcaac1f77d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca98014040 tx=0x7fca98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.843 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaa97fa700 1 -- 172.21.15.179:0/3583908475 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca98004510 con 0x7fcaac162100 2023-12-07T00:14:41.843 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaa97fa700 1 -- 172.21.15.179:0/3583908475 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9801f070 con 0x7fcaac162100 2023-12-07T00:14:41.843 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac0ccbc0 con 0x7fcaac162100 2023-12-07T00:14:41.843 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcaa97fa700 1 -- 172.21.15.179:0/3583908475 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca980038c0 con 0x7fcaac162100 2023-12-07T00:14:41.843 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.841+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac0cb260 con 0x7fcaac162100 2023-12-07T00:14:41.843 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.842+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0685f0 con 0x7fcaac162100 2023-12-07T00:14:41.844 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.843+0000 7fcaa97fa700 1 -- 172.21.15.179:0/3583908475 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca98003a20 con 0x7fcaac162100 2023-12-07T00:14:41.844 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.843+0000 7fcaa97fa700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fca9006af00 0x7fca9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:41.844 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.843+0000 7fcaa97fa700 1 -- 172.21.15.179:0/3583908475 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca98021070 con 0x7fcaac162100 2023-12-07T00:14:41.844 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.843+0000 7fcab0a83700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fca9006af00 0x7fca9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:41.844 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.844+0000 7fcab0a83700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fca9006af00 0x7fca9006d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0007fd0 tx=0x7fcaa0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:41.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:41.848+0000 7fcaa97fa700 1 -- 172.21.15.179:0/3583908475 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca98055cf0 con 0x7fcaac162100 2023-12-07T00:14:42.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.036+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fcaac0b43d0 con 0x7fcaac162100 2023-12-07T00:14:42.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.037+0000 7fcaa97fa700 1 -- 172.21.15.179:0/3583908475 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fca98015020 con 0x7fcaac162100 2023-12-07T00:14:42.036 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.038+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fca9006af00 msgr2=0x7fca9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.038+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fca9006af00 0x7fca9006d3c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0007fd0 tx=0x7fcaa0007de0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.038+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac162100 msgr2=0x7fcaac1f77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.038+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac162100 0x7fcaac1f77d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca98014040 tx=0x7fca98004750 comp rx=0 tx=0).stop 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.039+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 shutdown_connections 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.039+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fca9006af00 0x7fca9006d3c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.039+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcaac1624e0 0x7fcaac15cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.039+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcaac09a0d0 0x7fcaac0c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.038 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.039+0000 7fcab2ce7700 1 --2- 172.21.15.179:0/3583908475 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcaac162100 0x7fcaac1f77d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.039 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.039+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 >> 172.21.15.179:0/3583908475 conn(0x7fcaac0b34e0 msgr2=0x7fcaac06d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:42.039 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.039+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 shutdown_connections 2023-12-07T00:14:42.039 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.039+0000 7fcab2ce7700 1 -- 172.21.15.179:0/3583908475 wait complete. 2023-12-07T00:14:42.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:14:42.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.171+0000 7f24a3b92700 1 Processor -- start 2023-12-07T00:14:42.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.171+0000 7f24a3b92700 1 -- start start 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.172+0000 7f24a3b92700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f249c15e220 0x7f249c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.172+0000 7f24a3b92700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f249c0b2aa0 0x7f249c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.172+0000 7f24a3b92700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f249c15f330 con 0x7f249c15de40 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.172+0000 7f24a3b92700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c0d1820 con 0x7f249c0b2aa0 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.172+0000 7f24a3b92700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f249c0b2ed0 con 0x7f249c15e220 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.172+0000 7f24a212f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f249c0b2aa0 0x7f249c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a212f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f249c0b2aa0 0x7f249c15f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39894/0 (socket says 172.21.15.179:39894) 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a212f700 1 -- 172.21.15.179:0/3875681345 learned_addr learned my addr 172.21.15.179:0/3875681345 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a112d700 1 --2- 172.21.15.179:0/3875681345 >> v2:172.21.15.190:3300/0 conn(0x7f249c15e220 0x7f249c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a212f700 1 -- 172.21.15.179:0/3875681345 >> v2:172.21.15.190:3300/0 conn(0x7f249c15e220 msgr2=0x7f249c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a212f700 1 --2- 172.21.15.179:0/3875681345 >> v2:172.21.15.190:3300/0 conn(0x7f249c15e220 0x7f249c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a212f700 1 -- 172.21.15.179:0/3875681345 >> v1:172.21.15.190:6789/0 conn(0x7f249c15de40 legacy=0x7f249c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a212f700 1 -- 172.21.15.179:0/3875681345 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c15e720 con 0x7f249c0b2aa0 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a212f700 1 --2- 172.21.15.179:0/3875681345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b2aa0 0x7f249c15f870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f249c06ef30 tx=0x7f249400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a09e85bf8c59123 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a092c700 1 -- 172.21.15.179:0/3875681345 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400e070 con 0x7f249c0b2aa0 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a092c700 1 -- 172.21.15.179:0/3875681345 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249400b910 con 0x7f249c0b2aa0 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.173+0000 7f24a092c700 1 -- 172.21.15.179:0/3875681345 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249400bcc0 con 0x7f249c0b2aa0 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.174+0000 7f24a3b92700 1 -- 172.21.15.179:0/3875681345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b2aa0 msgr2=0x7f249c15f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.174+0000 7f24a3b92700 1 --2- 172.21.15.179:0/3875681345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b2aa0 0x7f249c15f870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f249c06ef30 tx=0x7f249400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.174+0000 7f24a3b92700 1 -- 172.21.15.179:0/3875681345 shutdown_connections 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.174+0000 7f24a3b92700 1 --2- 172.21.15.179:0/3875681345 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c0b2aa0 0x7f249c15f870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.174+0000 7f24a3b92700 1 --2- 172.21.15.179:0/3875681345 >> v2:172.21.15.190:3300/0 conn(0x7f249c15e220 0x7f249c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.174+0000 7f24a3b92700 1 -- 172.21.15.179:0/3875681345 >> 172.21.15.179:0/3875681345 conn(0x7f249c072970 msgr2=0x7f249c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.174+0000 7f24a3b92700 1 -- 172.21.15.179:0/3875681345 shutdown_connections 2023-12-07T00:14:42.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.174+0000 7f24a3b92700 1 -- 172.21.15.179:0/3875681345 wait complete. 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.175+0000 7f24a3b92700 1 Processor -- start 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.175+0000 7f24a3b92700 1 -- start start 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a3b92700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249c0b2aa0 0x7f249c159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a3b92700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249c15de40 0x7f249c0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a3b92700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c15e220 0x7f249c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a3b92700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c1e6570 con 0x7f249c15e220 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a3b92700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c1e61d0 con 0x7f249c15de40 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a3b92700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249c0ceaf0 con 0x7f249c0b2aa0 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c15e220 0x7f249c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c15e220 0x7f249c0cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39900/0 (socket says 172.21.15.179:39900) 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 -- 172.21.15.179:0/2367270410 learned_addr learned my addr 172.21.15.179:0/2367270410 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a112d700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249c15de40 0x7f249c0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a192e700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249c0b2aa0 0x7f249c159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 -- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249c0b2aa0 msgr2=0x7f249c159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249c0b2aa0 0x7f249c159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 -- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249c15de40 msgr2=0x7f249c0cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249c15de40 0x7f249c0cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 -- 172.21.15.179:0/2367270410 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494009b30 con 0x7f249c15e220 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a192e700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249c0b2aa0 0x7f249c159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a212f700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c15e220 0x7f249c0cc360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f249c072210 tx=0x7f2494004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24927fc700 1 -- 172.21.15.179:0/2367270410 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2494004930 con 0x7f249c15e220 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24927fc700 1 -- 172.21.15.179:0/2367270410 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940099b0 con 0x7f249c15e220 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249c0cedd0 con 0x7f249c15e220 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24927fc700 1 -- 172.21.15.179:0/2367270410 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249401c680 con 0x7f249c15e220 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.176+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249c159bd0 con 0x7f249c15e220 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.177+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249c04f290 con 0x7f249c15e220 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.178+0000 7f24927fc700 1 -- 172.21.15.179:0/2367270410 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f249401c7e0 con 0x7f249c15e220 2023-12-07T00:14:42.181 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.178+0000 7f24927fc700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f248006aed0 0x7f248006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.178+0000 7f24927fc700 1 -- 172.21.15.179:0/2367270410 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f249408b520 con 0x7f249c15e220 2023-12-07T00:14:42.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.178+0000 7f24a192e700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f248006aed0 0x7f248006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.178+0000 7f24a192e700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f248006aed0 0x7f248006d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2498000f60 tx=0x7f2498009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.183+0000 7f24927fc700 1 -- 172.21.15.179:0/2367270410 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2494056370 con 0x7f249c15e220 2023-12-07T00:14:42.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.417+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f249c159d60 con 0x7f249c15e220 2023-12-07T00:14:42.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.418+0000 7f24927fc700 1 -- 172.21.15.179:0/2367270410 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f249c159d60 con 0x7f249c15e220 2023-12-07T00:14:42.417 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:42.417 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:31.106814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T00:14:42.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f248006aed0 msgr2=0x7f248006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f248006aed0 0x7f248006d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2498000f60 tx=0x7f2498009040 comp rx=0 tx=0).stop 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c15e220 msgr2=0x7f249c0cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c15e220 0x7f249c0cc360 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f249c072210 tx=0x7f2494004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 shutdown_connections 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f248006aed0 0x7f248006d390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f249c15e220 0x7f249c0cc360 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f249c0b2aa0 0x7f249c159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 --2- 172.21.15.179:0/2367270410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f249c15de40 0x7f249c0cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 >> 172.21.15.179:0/2367270410 conn(0x7f249c072970 msgr2=0x7f249c0b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 shutdown_connections 2023-12-07T00:14:42.420 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.420+0000 7f24a3b92700 1 -- 172.21.15.179:0/2367270410 wait complete. 2023-12-07T00:14:42.421 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 9 2023-12-07T00:14:42.432 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:42.476 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:14:42.478 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:14:42.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.556+0000 7f6cb34bb700 1 Processor -- start 2023-12-07T00:14:42.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.557+0000 7f6cb34bb700 1 -- start start 2023-12-07T00:14:42.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.557+0000 7f6cb34bb700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 0x7f6cac0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.557+0000 7f6cb34bb700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6cac0cd020 0x7f6cac0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb34bb700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac09ab50 con 0x7f6cac099c00 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb34bb700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac0cf630 con 0x7f6cac0cd020 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb34bb700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0cf8f0 con 0x7f6cac15bde0 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb0a56700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6cac0cd020 0x7f6cac0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb1a58700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6cac099c00 0x7f6cac15f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46810/0 (socket says 172.21.15.179:46810) 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb1a58700 1 -- 172.21.15.179:0/1300810279 learned_addr learned my addr 172.21.15.179:0/1300810279 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb1257700 1 --2- 172.21.15.179:0/1300810279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 0x7f6cac0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb0a56700 1 -- 172.21.15.179:0/1300810279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 msgr2=0x7f6cac0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb0a56700 1 --2- 172.21.15.179:0/1300810279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 0x7f6cac0d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb0a56700 1 -- 172.21.15.179:0/1300810279 >> v1:172.21.15.179:6789/0 conn(0x7f6cac099c00 legacy=0x7f6cac15f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb0a56700 1 -- 172.21.15.179:0/1300810279 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0cfbd0 con 0x7f6cac0cd020 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6ca3fff700 1 -- 172.21.15.179:0/1300810279 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753956175 0 0) 0x7f6cac09ab50 con 0x7f6cac099c00 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6cb0a56700 1 --2- 172.21.15.179:0/1300810279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0cd490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009840 tx=0x7f6ca8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d168ec93396702c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6ca3fff700 1 -- 172.21.15.179:0/1300810279 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8011830 con 0x7f6cac0cd020 2023-12-07T00:14:42.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6ca3fff700 1 -- 172.21.15.179:0/1300810279 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca8011990 con 0x7f6cac0cd020 2023-12-07T00:14:42.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.558+0000 7f6ca3fff700 1 -- 172.21.15.179:0/1300810279 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8011d20 con 0x7f6cac0cd020 2023-12-07T00:14:42.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.559+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1300810279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 msgr2=0x7f6cac0cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.559+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1300810279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0cd490 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009840 tx=0x7f6ca8009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:42.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.559+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1300810279 shutdown_connections 2023-12-07T00:14:42.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.559+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1300810279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 0x7f6cac0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.559+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1300810279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0cd490 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.559+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1300810279 >> 172.21.15.179:0/1300810279 conn(0x7f6cac0b3550 msgr2=0x7f6cac0b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:42.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.559+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1300810279 shutdown_connections 2023-12-07T00:14:42.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.559+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1300810279 wait complete. 2023-12-07T00:14:42.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.560+0000 7f6cb34bb700 1 Processor -- start 2023-12-07T00:14:42.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.560+0000 7f6cb34bb700 1 -- start start 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.561+0000 7f6cb34bb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cac099c00 0x7f6cac145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.561+0000 7f6cb34bb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.561+0000 7f6cb34bb700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 0x7f6cac0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.561+0000 7f6cb34bb700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0b6480 con 0x7f6cac0cd020 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.561+0000 7f6cb34bb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0b6720 con 0x7f6cac099c00 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.561+0000 7f6cb34bb700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac0b6a00 con 0x7f6cac15bde0 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.561+0000 7f6cb0a56700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb0a56700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39912/0 (socket says 172.21.15.179:39912) 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb0a56700 1 -- 172.21.15.179:0/1003294535 learned_addr learned my addr 172.21.15.179:0/1003294535 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb1a58700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 0x7f6cac0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb1257700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cac099c00 0x7f6cac145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb0a56700 1 -- 172.21.15.179:0/1003294535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 msgr2=0x7f6cac0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb0a56700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 0x7f6cac0b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb0a56700 1 -- 172.21.15.179:0/1003294535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cac099c00 msgr2=0x7f6cac145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb0a56700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cac099c00 0x7f6cac145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb0a56700 1 -- 172.21.15.179:0/1003294535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca80094a0 con 0x7f6cac0cd020 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb0a56700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0b4960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80090b0 tx=0x7f6ca8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6ca1ffb700 1 -- 172.21.15.179:0/1003294535 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8004510 con 0x7f6cac0cd020 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6ca1ffb700 1 -- 172.21.15.179:0/1003294535 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca801f070 con 0x7f6cac0cd020 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac0b6ce0 con 0x7f6cac0cd020 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6ca1ffb700 1 -- 172.21.15.179:0/1003294535 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca80038e0 con 0x7f6cac0cd020 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.562+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac0b72a0 con 0x7f6cac0cd020 2023-12-07T00:14:42.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.563+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac0b7610 con 0x7f6cac0cd020 2023-12-07T00:14:42.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.564+0000 7f6ca1ffb700 1 -- 172.21.15.179:0/1003294535 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ca8003a40 con 0x7f6cac0cd020 2023-12-07T00:14:42.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.564+0000 7f6ca1ffb700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6c9006aed0 0x7f6c9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.564+0000 7f6ca1ffb700 1 -- 172.21.15.179:0/1003294535 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ca8021070 con 0x7f6cac0cd020 2023-12-07T00:14:42.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.564+0000 7f6cb1257700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6c9006aed0 0x7f6c9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.565+0000 7f6cb1257700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6c9006aed0 0x7f6c9006d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c006b20 tx=0x7f6c9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.569+0000 7f6ca1ffb700 1 -- 172.21.15.179:0/1003294535 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ca8055df0 con 0x7f6cac0cd020 2023-12-07T00:14:42.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.765+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6cac0b7430 con 0x7f6cac0cd020 2023-12-07T00:14:42.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.766+0000 7f6ca1ffb700 1 -- 172.21.15.179:0/1003294535 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f6ca8015020 con 0x7f6cac0cd020 2023-12-07T00:14:42.766 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:42.766 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6c9006aed0 msgr2=0x7f6c9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6c9006aed0 0x7f6c9006d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c006b20 tx=0x7f6c9c008040 comp rx=0 tx=0).stop 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 msgr2=0x7f6cac0b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0b4960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80090b0 tx=0x7f6ca8004750 comp rx=0 tx=0).stop 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 shutdown_connections 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6c9006aed0 0x7f6c9006d390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6cac15bde0 0x7f6cac0b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6cac099c00 0x7f6cac145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 --2- 172.21.15.179:0/1003294535 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6cac0cd020 0x7f6cac0b4960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.768+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 >> 172.21.15.179:0/1003294535 conn(0x7f6cac0b3550 msgr2=0x7f6cac15b040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.769+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 shutdown_connections 2023-12-07T00:14:42.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.769+0000 7f6cb34bb700 1 -- 172.21.15.179:0/1003294535 wait complete. 2023-12-07T00:14:42.780 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:14:42.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.942+0000 7fcfbf8ec700 1 Processor -- start 2023-12-07T00:14:42.942 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.943+0000 7fcfbf8ec700 1 -- start start 2023-12-07T00:14:42.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.943+0000 7fcfbf8ec700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcfb815e220 0x7fcfb80b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.943+0000 7fcfbf8ec700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 0x7fcfb815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.943+0000 7fcfbf8ec700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb815f330 con 0x7fcfb815de40 2023-12-07T00:14:42.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.943+0000 7fcfbf8ec700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80d1820 con 0x7fcfb815e220 2023-12-07T00:14:42.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.943+0000 7fcfbf8ec700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80b2ed0 con 0x7fcfb80b2aa0 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.943+0000 7fcfbce87700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcfb815e220 0x7fcfb80b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbd688700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fcfb815de40 0x7fcfb80b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46820/0 (socket says 172.21.15.179:46820) 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbd688700 1 -- 172.21.15.179:0/2279157782 learned_addr learned my addr 172.21.15.179:0/2279157782 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbce87700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcfb815e220 0x7fcfb80b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39920/0 (socket says 172.21.15.179:39920) 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbde89700 1 --2- 172.21.15.179:0/2279157782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 0x7fcfb815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbce87700 1 -- 172.21.15.179:0/2279157782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 msgr2=0x7fcfb815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbce87700 1 --2- 172.21.15.179:0/2279157782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 0x7fcfb815f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbce87700 1 -- 172.21.15.179:0/2279157782 >> v1:172.21.15.179:6789/0 conn(0x7fcfb815de40 legacy=0x7fcfb80b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfaffff700 1 -- 172.21.15.179:0/2279157782 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148407580 0 0) 0x7fcfb815f330 con 0x7fcfb815de40 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbce87700 1 -- 172.21.15.179:0/2279157782 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb815e720 con 0x7fcfb815e220 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfbce87700 1 --2- 172.21.15.179:0/2279157782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815e220 0x7fcfb80b2560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009820 tx=0x7fcfb4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac93361d3746dde server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfaffff700 1 -- 172.21.15.179:0/2279157782 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4005e30 con 0x7fcfb815e220 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfaffff700 1 -- 172.21.15.179:0/2279157782 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4006030 con 0x7fcfb815e220 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.944+0000 7fcfaffff700 1 -- 172.21.15.179:0/2279157782 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40063e0 con 0x7fcfb815e220 2023-12-07T00:14:42.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.945+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2279157782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815e220 msgr2=0x7fcfb80b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.945+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2279157782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815e220 0x7fcfb80b2560 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009820 tx=0x7fcfb4009b30 comp rx=0 tx=0).stop 2023-12-07T00:14:42.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.945+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2279157782 shutdown_connections 2023-12-07T00:14:42.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.945+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2279157782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 0x7fcfb815f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.945+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2279157782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815e220 0x7fcfb80b2560 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.945+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2279157782 >> 172.21.15.179:0/2279157782 conn(0x7fcfb8072970 msgr2=0x7fcfb8072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:42.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.945+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2279157782 shutdown_connections 2023-12-07T00:14:42.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.945+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2279157782 wait complete. 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.946+0000 7fcfbf8ec700 1 Processor -- start 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.946+0000 7fcfbf8ec700 1 -- start start 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbf8ec700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 0x7fcfb8158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbf8ec700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815de40 0x7fcfb80cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbf8ec700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb815e220 0x7fcfb80cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbf8ec700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb815a150 con 0x7fcfb815de40 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbf8ec700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb81590b0 con 0x7fcfb815e220 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbf8ec700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8159390 con 0x7fcfb80b2aa0 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815de40 0x7fcfb80cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815de40 0x7fcfb80cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39926/0 (socket says 172.21.15.179:39926) 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 -- 172.21.15.179:0/2007062560 learned_addr learned my addr 172.21.15.179:0/2007062560 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 -- 172.21.15.179:0/2007062560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 msgr2=0x7fcfb8158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 0x7fcfb8158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 -- 172.21.15.179:0/2007062560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb815e220 msgr2=0x7fcfb80cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb815e220 0x7fcfb80cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 -- 172.21.15.179:0/2007062560 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009430 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbce87700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815de40 0x7fcfb80cc220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009b70 tx=0x7fcfb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfadffb700 1 -- 172.21.15.179:0/2007062560 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40069f0 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfadffb700 1 -- 172.21.15.179:0/2007062560 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4020070 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb8159670 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.947+0000 7fcfadffb700 1 -- 172.21.15.179:0/2007062560 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4004280 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.948+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb8159c30 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.949+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb804f290 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.949+0000 7fcfadffb700 1 -- 172.21.15.179:0/2007062560 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfb4022030 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.949+0000 7fcfadffb700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcf9c06aed0 0x7fcf9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.949+0000 7fcfadffb700 1 -- 172.21.15.179:0/2007062560 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfb408adf0 con 0x7fcfb815de40 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.949+0000 7fcfbd688700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcf9c06aed0 0x7fcf9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:42.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.950+0000 7fcfbd688700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcf9c06aed0 0x7fcf9c06d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80011e0 tx=0x7fcfa80079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:42.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:42.954+0000 7fcfadffb700 1 -- 172.21.15.179:0/2007062560 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfb4055ba0 con 0x7fcfb815de40 2023-12-07T00:14:43.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.190+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfb81594d0 con 0x7fcfb815de40 2023-12-07T00:14:43.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.191+0000 7fcfadffb700 1 -- 172.21.15.179:0/2007062560 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fcfb81594d0 con 0x7fcfb815de40 2023-12-07T00:14:43.190 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:43.190 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:31.106814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcf9c06aed0 msgr2=0x7fcf9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcf9c06aed0 0x7fcf9c06d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80011e0 tx=0x7fcfa80079b0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815de40 msgr2=0x7fcfb80cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815de40 0x7fcfb80cc220 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009b70 tx=0x7fcfb4004750 comp rx=0 tx=0).stop 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 shutdown_connections 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcf9c06aed0 0x7fcf9c06d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfb815e220 0x7fcfb80cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfb80b2aa0 0x7fcfb8158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 --2- 172.21.15.179:0/2007062560 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfb815de40 0x7fcfb80cc220 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 >> 172.21.15.179:0/2007062560 conn(0x7fcfb8072970 msgr2=0x7fcfb80b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 shutdown_connections 2023-12-07T00:14:43.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.193+0000 7fcfbf8ec700 1 -- 172.21.15.179:0/2007062560 wait complete. 2023-12-07T00:14:43.194 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 9 2023-12-07T00:14:43.608 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-07T00:14:14.021089+0000', 'modified': '2023-12-07T00:14:31.106814+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6837/4041424409', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 4041424409}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 4041424409}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-07T00:14:43.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-07T00:14:43.609 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-07T00:14:43.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.732+0000 7facce497700 1 Processor -- start 2023-12-07T00:14:43.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.732+0000 7facce497700 1 -- start start 2023-12-07T00:14:43.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.733+0000 7facce497700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7facc815bde0 0x7facc80d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.733+0000 7facce497700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 0x7facc80cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.733+0000 7facce497700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc809ab50 con 0x7facc80cd020 2023-12-07T00:14:43.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.733+0000 7facce497700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80cf630 con 0x7facc815bde0 2023-12-07T00:14:43.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.733+0000 7facce497700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80cf8f0 con 0x7facc809a310 2023-12-07T00:14:43.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.733+0000 7facc7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7facc815bde0 0x7facc80d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.733+0000 7facc7fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7facc815bde0 0x7facc80d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39932/0 (socket says 172.21.15.179:39932) 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.733+0000 7facc7fff700 1 -- 172.21.15.179:0/3647428704 learned_addr learned my addr 172.21.15.179:0/3647428704 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7faccca34700 1 --2- 172.21.15.179:0/3647428704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 0x7facc80cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7facc7fff700 1 -- 172.21.15.179:0/3647428704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 msgr2=0x7facc80cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7facc7fff700 1 --2- 172.21.15.179:0/3647428704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 0x7facc80cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7facc7fff700 1 -- 172.21.15.179:0/3647428704 >> v1:172.21.15.190:6789/0 conn(0x7facc80cd020 legacy=0x7facc8099c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7facc7fff700 1 -- 172.21.15.179:0/3647428704 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc80cfbd0 con 0x7facc815bde0 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7facc7fff700 1 --2- 172.21.15.179:0/3647428704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80d06b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7facbc0098f0 tx=0x7facbc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab74d479588254af server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7facc6ffd700 1 -- 172.21.15.179:0/3647428704 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc004230 con 0x7facc815bde0 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7facc6ffd700 1 -- 172.21.15.179:0/3647428704 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc004390 con 0x7facc815bde0 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.734+0000 7facc6ffd700 1 -- 172.21.15.179:0/3647428704 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc0036a0 con 0x7facc815bde0 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.735+0000 7facce497700 1 -- 172.21.15.179:0/3647428704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 msgr2=0x7facc80d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.735+0000 7facce497700 1 --2- 172.21.15.179:0/3647428704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80d06b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7facbc0098f0 tx=0x7facbc009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.735+0000 7facce497700 1 -- 172.21.15.179:0/3647428704 shutdown_connections 2023-12-07T00:14:43.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.735+0000 7facce497700 1 --2- 172.21.15.179:0/3647428704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 0x7facc80cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.735+0000 7facce497700 1 --2- 172.21.15.179:0/3647428704 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80d06b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.735+0000 7facce497700 1 -- 172.21.15.179:0/3647428704 >> 172.21.15.179:0/3647428704 conn(0x7facc80b3550 msgr2=0x7facc80b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:43.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.735+0000 7facce497700 1 -- 172.21.15.179:0/3647428704 shutdown_connections 2023-12-07T00:14:43.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.735+0000 7facce497700 1 -- 172.21.15.179:0/3647428704 wait complete. 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.736+0000 7facce497700 1 Processor -- start 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.736+0000 7facce497700 1 -- start start 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7facce497700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 0x7facc80cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7facce497700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc80cd020 0x7facc80c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7facce497700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7facce497700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80b3160 con 0x7facc815bde0 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7facce497700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc80b2cd0 con 0x7facc80cd020 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7facce497700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc80b2110 con 0x7facc809a310 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7faccca34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7faccca34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39942/0 (socket says 172.21.15.179:39942) 2023-12-07T00:14:43.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.737+0000 7faccca34700 1 -- 172.21.15.179:0/3346041175 learned_addr learned my addr 172.21.15.179:0/3346041175 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7facc77fe700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc80cd020 0x7facc80c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7facc7fff700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 0x7facc80cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7faccca34700 1 -- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 msgr2=0x7facc80cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7faccca34700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 0x7facc80cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7faccca34700 1 -- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc80cd020 msgr2=0x7facc80c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7faccca34700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc80cd020 0x7facc80c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7faccca34700 1 -- 172.21.15.179:0/3346041175 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc009550 con 0x7facc815bde0 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7facc77fe700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc80cd020 0x7facc80c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:43.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7faccca34700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80c9a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7facc000cd60 tx=0x7facc000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:43.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7facc4ff9700 1 -- 172.21.15.179:0/3346041175 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0003a20 con 0x7facc815bde0 2023-12-07T00:14:43.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7facc4ff9700 1 -- 172.21.15.179:0/3346041175 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc0003ba0 con 0x7facc815bde0 2023-12-07T00:14:43.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7facce497700 1 -- 172.21.15.179:0/3346041175 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc80b23a0 con 0x7facc815bde0 2023-12-07T00:14:43.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7facc4ff9700 1 -- 172.21.15.179:0/3346041175 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0004020 con 0x7facc815bde0 2023-12-07T00:14:43.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.738+0000 7facce497700 1 -- 172.21.15.179:0/3346041175 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc80b2960 con 0x7facc815bde0 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.739+0000 7facc4ff9700 1 -- 172.21.15.179:0/3346041175 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7facc0004180 con 0x7facc815bde0 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.740+0000 7facc4ff9700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7facb406aed0 0x7facb406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.740+0000 7facc4ff9700 1 -- 172.21.15.179:0/3346041175 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facc0012070 con 0x7facc815bde0 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.740+0000 7facc7fff700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7facb406aed0 0x7facb406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.740+0000 7facc7fff700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7facb406aed0 0x7facb406d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7facbc009130 tx=0x7facbc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.742+0000 7facda690b80 1 Processor -- start 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.742+0000 7facda690b80 1 -- start start 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facda690b80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563047001840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facda690b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fd0ed0 0x563047001d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facda690b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fb8490 0x563046fe4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facda690b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563046f2e770 con 0x563046fb8490 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facda690b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563046f15750 con 0x563046fd0ed0 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facda690b80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563046f13070 con 0x563046fbb080 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fb8490 0x563046fe4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fb8490 0x563046fe4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39950/0 (socket says 172.21.15.179:39950) 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 -- 172.21.15.179:0/1952295527 learned_addr learned my addr 172.21.15.179:0/1952295527 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facc77fe700 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fd0ed0 0x563047001d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facc7fff700 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563047001840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 -- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 msgr2=0x563047001840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563047001840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 -- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fd0ed0 msgr2=0x563047001d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fd0ed0 0x563047001d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 -- 172.21.15.179:0/1952295527 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563046d8b5e0 con 0x563046fb8490 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facc7fff700 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563047001840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7faccca34700 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fb8490 0x563046fe4e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7facc0060910 tx=0x7facc0058570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f82125a2aff063a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:43.745 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facadffb700 1 -- 172.21.15.179:0/1952295527 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0058b40 con 0x563046fb8490 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facadffb700 1 -- 172.21.15.179:0/1952295527 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc005cc90 con 0x563046fb8490 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.743+0000 7facadffb700 1 -- 172.21.15.179:0/1952295527 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0060e40 con 0x563046fb8490 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 -- 172.21.15.179:0/1952295527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fb8490 msgr2=0x563046fe4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fb8490 0x563046fe4e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7facc0060910 tx=0x7facc0058570 comp rx=0 tx=0).stop 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 -- 172.21.15.179:0/1952295527 shutdown_connections 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fb8490 0x563046fe4e70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563047001840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 --2- 172.21.15.179:0/1952295527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fd0ed0 0x563047001d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 -- 172.21.15.179:0/1952295527 >> 172.21.15.179:0/1952295527 conn(0x563046ee9310 msgr2=0x563046fffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 -- 172.21.15.179:0/1952295527 shutdown_connections 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 -- 172.21.15.179:0/1952295527 wait complete. 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.744+0000 7facda690b80 1 -- start start 2023-12-07T00:14:43.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.745+0000 7facda690b80 1 Processor -- start 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.745+0000 7facda690b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x56304700eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.745+0000 7facda690b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fbb080 0x56304700fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.745+0000 7facda690b80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fd0ed0 0x563046faf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.745+0000 7facda690b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563046f0e960 con 0x563046fbb080 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.745+0000 7facda690b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563046ec8510 con 0x563046fb8490 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.745+0000 7facda690b80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563046ec81b0 con 0x563046fd0ed0 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facda690b80 10 client.0 _ll_register_callbacks cb 0x563046df3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fbb080 0x56304700fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.751 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fbb080 0x56304700fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39954/0 (socket says 172.21.15.179:39954) 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 -- 172.21.15.179:0/3026921020 learned_addr learned my addr 172.21.15.179:0/3026921020 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc7fff700 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x56304700eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7faccca34700 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fd0ed0 0x563046faf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 -- 172.21.15.179:0/3026921020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fd0ed0 msgr2=0x563046faf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fd0ed0 0x563046faf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 -- 172.21.15.179:0/3026921020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 msgr2=0x56304700eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x56304700eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 -- 172.21.15.179:0/3026921020 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc0059e70 con 0x563046fbb080 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facc77fe700 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fbb080 0x56304700fc10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7facb80104c0 tx=0x7facb80107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479863b62d1444a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7faca6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7faca6ffd700 1 -- 172.21.15.179:0/3026921020 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8003ae0 con 0x563046fbb080 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7faca6ffd700 1 -- 172.21.15.179:0/3026921020 <== mon.0 v2:172.21.15.179:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facb8003c40 con 0x563046fbb080 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facda690b80 1 -- 172.21.15.179:0/3026921020 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563046fada40 con 0x563046fbb080 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7faca6ffd700 1 -- 172.21.15.179:0/3026921020 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7facb8003e00 con 0x563046fbb080 2023-12-07T00:14:43.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facda690b80 10 client.4809 fetch_fsmap learned FSMap version 9 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7facda690b80 1 -- 172.21.15.179:0/3026921020 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563046d37d90 con 0x563046fbb080 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7faca6ffd700 1 -- 172.21.15.179:0/3026921020 <== mon.0 v2:172.21.15.179:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563046fada40 con 0x563046fbb080 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.746+0000 7faca6ffd700 1 -- 172.21.15.179:0/3026921020 <== mon.0 v2:172.21.15.179:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7facb8012040 con 0x563046fbb080 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7facda690b80 10 client.4809 fetch_fsmap finished waiting for FSMap version 9 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7facda690b80 10 client.4809 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7facda690b80 20 client.4809 populate_metadata read hostname 'smithi179' 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7facda690b80 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x563046fe8d80 0x563046fd1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7facda690b80 4 client.4809 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7facda690b80 1 -- 172.21.15.179:0/3026921020 --> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563046f89840 con 0x563046fe8d80 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7facc7fff700 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x563046fe8d80 0x563046fd1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7faca6ffd700 10 client.4809 ms_handle_connect on v2:172.21.15.179:6836/4041424409 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.747+0000 7facc7fff700 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x563046fe8d80 0x563046fd1790 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cab49e0a05182d4e server_cookie=cb769de9831b8330 in_seq=0 out_seq=0 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7faca6ffd700 1 -- 172.21.15.179:0/3026921020 <== mds.0 v2:172.21.15.179:6836/4041424409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x563046f89840 con 0x563046fe8d80 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7faca6ffd700 10 client.4809 handle_command_reply: tid=0 2023-12-07T00:14:43.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 client.4809 shutdown 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 -- 172.21.15.179:0/3026921020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fbb080 msgr2=0x56304700fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fbb080 0x56304700fc10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7facb80104c0 tx=0x7facb80107d0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 -- 172.21.15.179:0/3026921020 shutdown_connections 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x563046fe8d80 0x563046fd1790 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fd0ed0 0x563046faf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7faca6ffd700 0 client.4809 ms_handle_reset on v2:172.21.15.179:6836/4041424409 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x56304700eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 --2- 172.21.15.179:0/3026921020 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fbb080 0x56304700fc10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 -- 172.21.15.179:0/3026921020 >> 172.21.15.179:0/3026921020 conn(0x563046ee9310 msgr2=0x563047003c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 -- 172.21.15.179:0/3026921020 shutdown_connections 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 1 -- 172.21.15.179:0/3026921020 wait complete. 2023-12-07T00:14:43.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.748+0000 7facda690b80 20 client.4809 trim_cache size 0 max 16384 2023-12-07T00:14:43.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.766+0000 7facda690b80 1 Processor -- start 2023-12-07T00:14:43.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.766+0000 7facda690b80 1 -- start start 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facda690b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x563047021d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facda690b80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563046ffa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facda690b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563046fd4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facda690b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563046d8d8d0 con 0x563046fd0ed0 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facda690b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563046ffb520 con 0x563046fb8490 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facda690b80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563046ffb320 con 0x563046fbb080 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563046fd4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563046fd4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39964/0 (socket says 172.21.15.179:39964) 2023-12-07T00:14:43.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 -- 172.21.15.179:0/1140691865 learned_addr learned my addr 172.21.15.179:0/1140691865 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facc7fff700 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x563047021d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facc77fe700 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563046ffa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 -- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 msgr2=0x563046ffa000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563046ffa000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 -- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 msgr2=0x563047021d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x563047021d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 -- 172.21.15.179:0/1140691865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563046d20c10 con 0x563046fd0ed0 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facc77fe700 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563046ffa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facc7fff700 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x563047021d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7faccca34700 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563046fd4e80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7facc000a970 tx=0x7facc000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6218223bb4800490 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facae7fc700 1 -- 172.21.15.179:0/1140691865 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0076040 con 0x563046fd0ed0 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facae7fc700 1 -- 172.21.15.179:0/1140691865 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc0058b40 con 0x563046fd0ed0 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.767+0000 7facae7fc700 1 -- 172.21.15.179:0/1140691865 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0060e40 con 0x563046fd0ed0 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 -- 172.21.15.179:0/1140691865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 msgr2=0x563046fd4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563046fd4e80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7facc000a970 tx=0x7facc000f000 comp rx=0 tx=0).stop 2023-12-07T00:14:43.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 -- 172.21.15.179:0/1140691865 shutdown_connections 2023-12-07T00:14:43.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563046fd4e80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fb8490 0x563047021d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 --2- 172.21.15.179:0/1140691865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fbb080 0x563046ffa000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 -- 172.21.15.179:0/1140691865 >> 172.21.15.179:0/1140691865 conn(0x563046ee9310 msgr2=0x5630470026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:43.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 -- 172.21.15.179:0/1140691865 shutdown_connections 2023-12-07T00:14:43.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 -- 172.21.15.179:0/1140691865 wait complete. 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.768+0000 7facda690b80 1 -- start start 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.769+0000 7facda690b80 1 Processor -- start 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.769+0000 7facda690b80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fb8490 0x5630470690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.769+0000 7facda690b80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fbb080 0x5630470033f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.769+0000 7facda690b80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563047003930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.769+0000 7facda690b80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x563046fe5400 con 0x563046fd0ed0 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.769+0000 7facda690b80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x563047004120 con 0x563046fbb080 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.769+0000 7facda690b80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x563047002730 con 0x563046fb8490 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.769+0000 7facda690b80 10 client.0 _ll_register_callbacks cb 0x563046df3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563047003930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563047003930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39970/0 (socket says 172.21.15.179:39970) 2023-12-07T00:14:43.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 -- 172.21.15.179:0/1705414414 learned_addr learned my addr 172.21.15.179:0/1705414414 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:43.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facc7fff700 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fb8490 0x5630470690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facc77fe700 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fbb080 0x5630470033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 -- 172.21.15.179:0/1705414414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fb8490 msgr2=0x5630470690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fb8490 0x5630470690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 -- 172.21.15.179:0/1705414414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fbb080 msgr2=0x5630470033f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:43.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fbb080 0x5630470033f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 -- 172.21.15.179:0/1705414414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563046d8b5e0 con 0x563046fd0ed0 2023-12-07T00:14:43.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faccca34700 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563047003930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7facc000afd0 tx=0x7facc005b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af214b8aa9505c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:43.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faca6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2023-12-07T00:14:43.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faca6ffd700 1 -- 172.21.15.179:0/1705414414 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc0076070 con 0x563046fd0ed0 2023-12-07T00:14:43.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 1 -- 172.21.15.179:0/1705414414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facc005cc90 con 0x563046fd0ed0 2023-12-07T00:14:43.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faca6ffd700 1 -- 172.21.15.179:0/1705414414 <== mon.0 v2:172.21.15.179:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facc0058fa0 con 0x563046fd0ed0 2023-12-07T00:14:43.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faca6ffd700 1 -- 172.21.15.179:0/1705414414 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7facc0058030 con 0x563046fd0ed0 2023-12-07T00:14:43.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 10 client.4815 fetch_fsmap learned FSMap version 9 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 1 -- 172.21.15.179:0/1705414414 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563046d5e200 con 0x563046fd0ed0 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faca6ffd700 1 -- 172.21.15.179:0/1705414414 <== mon.0 v2:172.21.15.179:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc005cc90 con 0x563046fd0ed0 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7faca6ffd700 1 -- 172.21.15.179:0/1705414414 <== mon.0 v2:172.21.15.179:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7facc007e070 con 0x563046fd0ed0 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 10 client.4815 fetch_fsmap finished waiting for FSMap version 9 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 10 client.4815 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 20 client.4815 populate_metadata read hostname 'smithi179' 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x563047021ce0 0x563046fe42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 4 client.4815 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.770+0000 7facda690b80 1 -- 172.21.15.179:0/1705414414 --> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563046ed4f80 con 0x563047021ce0 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facc7fff700 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x563047021ce0 0x563046fe42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7faca6ffd700 10 client.4815 ms_handle_connect on v2:172.21.15.179:6836/4041424409 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facc7fff700 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x563047021ce0 0x563046fe42f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efca6b036549819d server_cookie=d8e289ed9e1417c2 in_seq=0 out_seq=0 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7faca6ffd700 1 -- 172.21.15.179:0/1705414414 <== mds.0 v2:172.21.15.179:6836/4041424409 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563046ed4f80 con 0x563047021ce0 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7faca6ffd700 10 client.4815 handle_command_reply: tid=0 2023-12-07T00:14:43.778 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 client.4815 shutdown 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 -- 172.21.15.179:0/1705414414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 msgr2=0x563047003930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563047003930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7facc000afd0 tx=0x7facc005b040 comp rx=0 tx=0).stop 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 -- 172.21.15.179:0/1705414414 shutdown_connections 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.179:6836/4041424409,v1:172.21.15.179:6837/4041424409] conn(0x563047021ce0 0x563046fe42f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x563046fd0ed0 0x563047003930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x563046fb8490 0x5630470690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 --2- 172.21.15.179:0/1705414414 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x563046fbb080 0x5630470033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 -- 172.21.15.179:0/1705414414 >> 172.21.15.179:0/1705414414 conn(0x563046ee9310 msgr2=0x563046faeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7faca6ffd700 0 client.4815 ms_handle_reset on v2:172.21.15.179:6836/4041424409 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 -- 172.21.15.179:0/1705414414 shutdown_connections 2023-12-07T00:14:43.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.771+0000 7facda690b80 1 -- 172.21.15.179:0/1705414414 wait complete. 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facda690b80 20 client.4815 trim_cache size 0 max 16384 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout: "cluster_fsid": "4803447b-a0af-4501-a3c6-e46974a67250", 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout: "whoami": 0, 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 4266, 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout: "want_state": "up:active", 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout: "state": "up:active", 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs", 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout: "rank_uptime": 29.137823569999998, 2023-12-07T00:14:43.780 INFO:teuthology.orchestra.run.smithi179.stdout: "mdsmap_epoch": 9, 2023-12-07T00:14:43.781 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_epoch": 27, 2023-12-07T00:14:43.781 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_epoch_barrier": 27, 2023-12-07T00:14:43.781 INFO:teuthology.orchestra.run.smithi179.stdout: "uptime": 36.617894958999997 2023-12-07T00:14:43.781 INFO:teuthology.orchestra.run.smithi179.stdout:} 2023-12-07T00:14:43.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 -- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7facb406aed0 msgr2=0x7facb406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7facb406aed0 0x7facb406d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7facbc009130 tx=0x7facbc008030 comp rx=0 tx=0).stop 2023-12-07T00:14:43.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 -- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 msgr2=0x7facc80c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:43.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80c9a10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7facc000cd60 tx=0x7facc000a570 comp rx=0 tx=0).stop 2023-12-07T00:14:43.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 -- 172.21.15.179:0/3346041175 shutdown_connections 2023-12-07T00:14:43.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7facb406aed0 0x7facb406d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7facc815bde0 0x7facc80c9a10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7facc809a310 0x7facc80cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 --2- 172.21.15.179:0/3346041175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7facc80cd020 0x7facc80c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:43.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 -- 172.21.15.179:0/3346041175 >> 172.21.15.179:0/3346041175 conn(0x7facc80b3550 msgr2=0x7facc80d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:43.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 -- 172.21.15.179:0/3346041175 shutdown_connections 2023-12-07T00:14:43.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:43.772+0000 7facce497700 1 -- 172.21.15.179:0/3346041175 wait complete. 2023-12-07T00:14:43.784 INFO:teuthology.run_tasks:Running task kclient... 2023-12-07T00:14:43.797 INFO:tasks.kclient:Mounting kernel clients... 2023-12-07T00:14:43.798 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-07T00:14:43.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:43.798 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-12-07T00:14:43.815 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-07T00:14:43.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:43.815 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-07T00:14:43.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:43.888 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-12-07T00:14:43.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:43.998 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-12-07T00:14:44.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.015 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link delete ceph-brx 2023-12-07T00:14:44.084 INFO:teuthology.orchestra.run.smithi179.stderr:Cannot find device "ceph-brx" 2023-12-07T00:14:44.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T00:14:44.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.086 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-12-07T00:14:44.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.107 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-12-07T00:14:44.180 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2023-12-07T00:14:44.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T00:14:44.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.182 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-12-07T00:14:44.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.241 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-12-07T00:14:44.310 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2023-12-07T00:14:44.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T00:14:44.311 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-07T00:14:44.311 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T00:14:44.312 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T00:14:44.312 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T00:14:44.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.434+0000 7f9e07103700 1 Processor -- start 2023-12-07T00:14:44.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.434+0000 7f9e07103700 1 -- start start 2023-12-07T00:14:44.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9e07103700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9e00159690 0x7f9e0015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:44.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9e07103700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e00159a70 con 0x7f9e0006eee0 2023-12-07T00:14:44.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9e07103700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0015e560 con 0x7f9e000722a0 2023-12-07T00:14:44.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9e07103700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e00160090 con 0x7f9e00159690 2023-12-07T00:14:44.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9dfffff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9e0006eee0 0x7f9e00071b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46876/0 (socket says 172.21.15.179:46876) 2023-12-07T00:14:44.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9dfffff700 1 -- 172.21.15.179:0/1852482420 learned_addr learned my addr 172.21.15.179:0/1852482420 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:44.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9e04e9f700 1 --2- 172.21.15.179:0/1852482420 >> v2:172.21.15.190:3300/0 conn(0x7f9e00159690 0x7f9e0015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:44.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9dff7fe700 1 -- 172.21.15.179:0/1852482420 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288699781 0 0) 0x7f9e00159a70 con 0x7f9e0006eee0 2023-12-07T00:14:44.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9dff7fe700 1 -- 172.21.15.179:0/1852482420 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df00035b0 con 0x7f9e0006eee0 2023-12-07T00:14:44.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9e04e9f700 1 -- 172.21.15.179:0/1852482420 >> v1:172.21.15.190:6789/0 conn(0x7f9e000722a0 legacy=0x7f9e00144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:44.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9e04e9f700 1 -- 172.21.15.179:0/1852482420 >> v1:172.21.15.179:6789/0 conn(0x7f9e0006eee0 legacy=0x7f9e00071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:44.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.435+0000 7f9e04e9f700 1 -- 172.21.15.179:0/1852482420 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0006f6d0 con 0x7f9e00159690 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9e04e9f700 1 --2- 172.21.15.179:0/1852482420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e00159690 0x7f9e0015cc50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009840 tx=0x7f9df4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78e6c7420aae2356 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9dff7fe700 1 -- 172.21.15.179:0/1852482420 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011830 con 0x7f9e00159690 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9dff7fe700 1 -- 172.21.15.179:0/1852482420 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4011990 con 0x7f9e00159690 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9dff7fe700 1 -- 172.21.15.179:0/1852482420 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011d00 con 0x7f9e00159690 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9e07103700 1 -- 172.21.15.179:0/1852482420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e00159690 msgr2=0x7f9e0015cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9e07103700 1 --2- 172.21.15.179:0/1852482420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e00159690 0x7f9e0015cc50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009840 tx=0x7f9df4009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9e07103700 1 -- 172.21.15.179:0/1852482420 shutdown_connections 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9e07103700 1 --2- 172.21.15.179:0/1852482420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e00159690 0x7f9e0015cc50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9e07103700 1 -- 172.21.15.179:0/1852482420 >> 172.21.15.179:0/1852482420 conn(0x7f9e0006b150 msgr2=0x7f9e0006b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9e07103700 1 -- 172.21.15.179:0/1852482420 shutdown_connections 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.436+0000 7f9e07103700 1 -- 172.21.15.179:0/1852482420 wait complete. 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.438+0000 7f9e07103700 1 Processor -- start 2023-12-07T00:14:44.439 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.438+0000 7f9e07103700 1 -- start start 2023-12-07T00:14:44.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.438+0000 7f9e07103700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e0006eee0 0x7f9e00151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:44.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.438+0000 7f9e07103700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e000722a0 0x7f9e00153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:44.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.438+0000 7f9e07103700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e00159690 0x7f9e0013fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:44.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.438+0000 7f9e07103700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001521f0 con 0x7f9e00159690 2023-12-07T00:14:44.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e07103700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00154e30 con 0x7f9e0006eee0 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e07103700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001523e0 con 0x7f9e000722a0 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e00159690 0x7f9e0013fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e00159690 0x7f9e0013fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39984/0 (socket says 172.21.15.179:39984) 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 -- 172.21.15.179:0/2676323745 learned_addr learned my addr 172.21.15.179:0/2676323745 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e04e9f700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e0006eee0 0x7f9e00151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9dfffff700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e000722a0 0x7f9e00153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 -- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e000722a0 msgr2=0x7f9e00153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e000722a0 0x7f9e00153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 -- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e0006eee0 msgr2=0x7f9e00151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e0006eee0 0x7f9e00151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 -- 172.21.15.179:0/2676323745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df40094a0 con 0x7f9e00159690 2023-12-07T00:14:44.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9dfffff700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e000722a0 0x7f9e00153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e056a0700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e00159690 0x7f9e0013fdc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cb50 tx=0x7f9df800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9dfd7fa700 1 -- 172.21.15.179:0/2676323745 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df8003c00 con 0x7f9e00159690 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9dfd7fa700 1 -- 172.21.15.179:0/2676323745 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df8003d60 con 0x7f9e00159690 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e00154500 con 0x7f9e00159690 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9dfd7fa700 1 -- 172.21.15.179:0/2676323745 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df800aac0 con 0x7f9e00159690 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.439+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e00154ac0 con 0x7f9e00159690 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.440+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e00154fc0 con 0x7f9e00159690 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.441+0000 7f9dfd7fa700 1 -- 172.21.15.179:0/2676323745 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9df800ac20 con 0x7f9e00159690 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.441+0000 7f9dfd7fa700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9de406aed0 0x7f9de406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.441+0000 7f9dfd7fa700 1 -- 172.21.15.179:0/2676323745 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9df8089870 con 0x7f9e00159690 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.441+0000 7f9e04e9f700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9de406aed0 0x7f9de406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:44.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.442+0000 7f9e04e9f700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9de406aed0 0x7f9de406d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c00 tx=0x7f9df401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:44.445 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.446+0000 7f9dfd7fa700 1 -- 172.21.15.179:0/2676323745 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9df8054630 con 0x7f9e00159690 2023-12-07T00:14:44.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.687+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e00067ee0 con 0x7f9e00159690 2023-12-07T00:14:44.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.687+0000 7f9dfd7fa700 1 -- 172.21.15.179:0/2676323745 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9df8057c50 con 0x7f9e00159690 2023-12-07T00:14:44.687 INFO:teuthology.orchestra.run.smithi179.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9de406aed0 msgr2=0x7f9de406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9de406aed0 0x7f9de406d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9df4000c00 tx=0x7f9df401c040 comp rx=0 tx=0).stop 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e00159690 msgr2=0x7f9e0013fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e00159690 0x7f9e0013fdc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9df800cb50 tx=0x7f9df800ce60 comp rx=0 tx=0).stop 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 shutdown_connections 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9de406aed0 0x7f9de406d390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e00159690 0x7f9e0013fdc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e0006eee0 0x7f9e00151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:44.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.689+0000 7f9e07103700 1 --2- 172.21.15.179:0/2676323745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e000722a0 0x7f9e00153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:44.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.690+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 >> 172.21.15.179:0/2676323745 conn(0x7f9e0006b150 msgr2=0x7f9e0015c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:44.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.690+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 shutdown_connections 2023-12-07T00:14:44.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:44.690+0000 7f9e07103700 1 -- 172.21.15.179:0/2676323745 wait complete. 2023-12-07T00:14:44.701 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-07T00:14:44.701 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T00:14:44.701 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-12-07T00:14:44.702 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-07T00:14:44.702 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T00:14:44.702 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-07T00:14:44.702 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T00:14:44.702 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T00:14:44.702 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T00:14:44.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.702 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-12-07T00:14:44.719 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:44.719 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42323sec preferred_lft 42323sec 2023-12-07T00:14:44.720 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::3535:d433:7794:9e23/64 scope link noprefixroute 2023-12-07T00:14:44.721 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:44.721 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-07T00:14:44.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.721 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:44.721 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:44.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add name ceph-brx type bridge 2023-12-07T00:14:44.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr flush dev ceph-brx 2023-12-07T00:14:44.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set ceph-brx up 2023-12-07T00:14:44.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-07T00:14:44.721 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:44.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.836 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T00:14:44.862 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-12-07T00:14:44.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.863 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-12-07T00:14:44.922 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-12-07T00:14:44.922 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T00:14:44.922 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T00:14:44.922 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T00:14:44.922 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T00:14:44.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:44.923 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:44.923 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:44.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T00:14:44.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T00:14:44.923 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T00:14:44.923 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:45.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:45.029 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-12-07T00:14:45.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:45.047 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-12-07T00:14:45.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:45.103 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:45.103 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:45.103 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T00:14:45.104 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-07T00:14:45.104 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:45.197 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-07T00:14:45.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:45.198 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:45.198 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:45.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-07T00:14:45.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-07T00:14:45.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-07T00:14:45.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-07T00:14:45.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-07T00:14:45.198 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:45.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:45.414 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:45.414 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:45.414 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-12-07T00:14:45.414 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.0 master ceph-brx 2023-12-07T00:14:45.414 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:45.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:45.534 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T00:14:45.556 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-07T00:14:45.556 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:45.556 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T00:14:45.612 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-07T00:14:45.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:45.612 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:45.699 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:45.699 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:45.820 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:14:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 0@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:14:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:14:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:14:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:14:45.821 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:14:45.901 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 0@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790" 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2023-12-07T00:14:45.902 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4803447b-a0af-4501-a3c6-e46974a67250" will pass to kernel 2023-12-07T00:14:45.904 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T00:14:45.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:45.905 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-07T00:14:45.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:45.972 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:46.045 INFO:teuthology.orchestra.run.smithi179.stdout:client4729 2023-12-07T00:14:46.045 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:14:46.045 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:14:46.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:46.102 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:46.173 INFO:teuthology.orchestra.run.smithi179.stdout:client4729 2023-12-07T00:14:46.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:46.174 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:46.245 INFO:teuthology.orchestra.run.smithi179.stdout:client4729 2023-12-07T00:14:46.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:46.246 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4803447b-a0af-4501-a3c6-e46974a67250.client4729/status') 2023-12-07T00:14:46.326 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4729 (3)172.21.15.179:0/376987531 2023-12-07T00:14:46.326 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2023-12-07T00:14:46.326 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2023-12-07T00:14:46.326 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2023-12-07T00:14:46.326 INFO:teuthology.orchestra.run.smithi179.stderr:70 bytes copied, 2.2488e-05 s, 3.1 MB/s 2023-12-07T00:14:46.327 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-12-07T00:14:46.328 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T00:14:46.328 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-07T00:14:46.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T00:14:46.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.490+0000 7f2a2e226700 1 Processor -- start 2023-12-07T00:14:46.489 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.490+0000 7f2a2e226700 1 -- start start 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a2e226700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a2815a170 0x7f2a280ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a2e226700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2a280ce950 0x7f2a280cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a2e226700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a28071b90 0x7f2a2806e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a2e226700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a280ccf80 con 0x7f2a2815a170 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a2e226700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a280cf300 con 0x7f2a280ce950 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a2e226700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a280cc9c0 con 0x7f2a28071b90 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a2815a170 0x7f2a280ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a2815a170 0x7f2a280ce410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39992/0 (socket says 172.21.15.179:39992) 2023-12-07T00:14:46.492 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 -- 172.21.15.179:0/2463895777 learned_addr learned my addr 172.21.15.179:0/2463895777 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a26ffd700 1 --2- 172.21.15.179:0/2463895777 >> v2:172.21.15.190:3300/0 conn(0x7f2a280ce950 0x7f2a280cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a27fff700 1 --2- 172.21.15.179:0/2463895777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a28071b90 0x7f2a2806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 -- 172.21.15.179:0/2463895777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a28071b90 msgr2=0x7f2a2806e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 --2- 172.21.15.179:0/2463895777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a28071b90 0x7f2a2806e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 -- 172.21.15.179:0/2463895777 >> v2:172.21.15.190:3300/0 conn(0x7f2a280ce950 msgr2=0x7f2a280cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 --2- 172.21.15.179:0/2463895777 >> v2:172.21.15.190:3300/0 conn(0x7f2a280ce950 0x7f2a280cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 -- 172.21.15.179:0/2463895777 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280ccca0 con 0x7f2a2815a170 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a26ffd700 1 --2- 172.21.15.179:0/2463895777 >> v2:172.21.15.190:3300/0 conn(0x7f2a280ce950 0x7f2a280cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a277fe700 1 --2- 172.21.15.179:0/2463895777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2815a170 0x7f2a280ce410 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2a2806fc10 tx=0x7f2a1000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b77a01f47ab0b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.491+0000 7f2a267fc700 1 -- 172.21.15.179:0/2463895777 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000dd30 con 0x7f2a2815a170 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a267fc700 1 -- 172.21.15.179:0/2463895777 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1000de90 con 0x7f2a2815a170 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a267fc700 1 -- 172.21.15.179:0/2463895777 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10010690 con 0x7f2a2815a170 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 -- 172.21.15.179:0/2463895777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2815a170 msgr2=0x7f2a280ce410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:46.493 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 --2- 172.21.15.179:0/2463895777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2815a170 0x7f2a280ce410 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2a2806fc10 tx=0x7f2a1000be70 comp rx=0 tx=0).stop 2023-12-07T00:14:46.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 -- 172.21.15.179:0/2463895777 shutdown_connections 2023-12-07T00:14:46.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 --2- 172.21.15.179:0/2463895777 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a28071b90 0x7f2a2806e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 --2- 172.21.15.179:0/2463895777 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2815a170 0x7f2a280ce410 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 --2- 172.21.15.179:0/2463895777 >> v2:172.21.15.190:3300/0 conn(0x7f2a280ce950 0x7f2a280cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 -- 172.21.15.179:0/2463895777 >> 172.21.15.179:0/2463895777 conn(0x7f2a2806b150 msgr2=0x7f2a2806b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:46.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 -- 172.21.15.179:0/2463895777 shutdown_connections 2023-12-07T00:14:46.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.492+0000 7f2a2e226700 1 -- 172.21.15.179:0/2463895777 wait complete. 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.494+0000 7f2a2e226700 1 Processor -- start 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.494+0000 7f2a2e226700 1 -- start start 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a2e226700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a28071b90 0x7f2a2813cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a2e226700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a280ce950 0x7f2a28155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a2e226700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2815a170 0x7f2a28156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a2e226700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a281e3c00 con 0x7f2a280ce950 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a2e226700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a28158fa0 con 0x7f2a28071b90 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a2e226700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a28159280 con 0x7f2a2815a170 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a280ce950 0x7f2a28155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:46.497 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a280ce950 0x7f2a28155f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:39998/0 (socket says 172.21.15.179:39998) 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 -- 172.21.15.179:0/1935816505 learned_addr learned my addr 172.21.15.179:0/1935816505 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a277fe700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a28071b90 0x7f2a2813cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a27fff700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2815a170 0x7f2a28156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 -- 172.21.15.179:0/1935816505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2815a170 msgr2=0x7f2a28156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2815a170 0x7f2a28156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 -- 172.21.15.179:0/1935816505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a28071b90 msgr2=0x7f2a2813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a28071b90 0x7f2a2813cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 -- 172.21.15.179:0/1935816505 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1000b7f0 con 0x7f2a280ce950 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a26ffd700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a280ce950 0x7f2a28155f00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800e810 tx=0x7f2a1800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.495+0000 7f2a1ffff700 1 -- 172.21.15.179:0/1935816505 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a18004230 con 0x7f2a280ce950 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.496+0000 7f2a1ffff700 1 -- 172.21.15.179:0/1935816505 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a18004390 con 0x7f2a280ce950 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.496+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a281e3e10 con 0x7f2a280ce950 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.496+0000 7f2a1ffff700 1 -- 172.21.15.179:0/1935816505 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a180036a0 con 0x7f2a280ce950 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.496+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a281f0930 con 0x7f2a280ce950 2023-12-07T00:14:46.498 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.497+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a28067ee0 con 0x7f2a280ce950 2023-12-07T00:14:46.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.497+0000 7f2a1ffff700 1 -- 172.21.15.179:0/1935816505 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a18003800 con 0x7f2a280ce950 2023-12-07T00:14:46.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.497+0000 7f2a1ffff700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a0806aed0 0x7f2a0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:46.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.497+0000 7f2a1ffff700 1 -- 172.21.15.179:0/1935816505 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a18089440 con 0x7f2a280ce950 2023-12-07T00:14:46.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.497+0000 7f2a277fe700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a0806aed0 0x7f2a0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:46.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.498+0000 7f2a277fe700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a0806aed0 0x7f2a0806d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000beb0 tx=0x7f2a10012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:46.501 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.502+0000 7f2a1ffff700 1 -- 172.21.15.179:0/1935816505 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a18054160 con 0x7f2a280ce950 2023-12-07T00:14:46.743 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.743+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2a28072b70 con 0x7f2a280ce950 2023-12-07T00:14:46.743 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.744+0000 7f2a1ffff700 1 -- 172.21.15.179:0/1935816505 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2a18057780 con 0x7f2a280ce950 2023-12-07T00:14:46.743 INFO:teuthology.orchestra.run.smithi179.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-07T00:14:46.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a0806aed0 msgr2=0x7f2a0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:46.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a0806aed0 0x7f2a0806d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000beb0 tx=0x7f2a10012000 comp rx=0 tx=0).stop 2023-12-07T00:14:46.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a280ce950 msgr2=0x7f2a28155f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:46.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a280ce950 0x7f2a28155f00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800e810 tx=0x7f2a1800ebd0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.746 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 shutdown_connections 2023-12-07T00:14:46.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a0806aed0 0x7f2a0806d390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2815a170 0x7f2a28156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a28071b90 0x7f2a2813cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 --2- 172.21.15.179:0/1935816505 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a280ce950 0x7f2a28155f00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:46.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 >> 172.21.15.179:0/1935816505 conn(0x7f2a2806b150 msgr2=0x7f2a2815ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:46.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 shutdown_connections 2023-12-07T00:14:46.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:46.746+0000 7f2a2e226700 1 -- 172.21.15.179:0/1935816505 wait complete. 2023-12-07T00:14:46.758 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-07T00:14:46.758 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T00:14:46.758 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-12-07T00:14:46.758 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-07T00:14:46.758 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-07T00:14:46.758 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-07T00:14:46.759 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T00:14:46.759 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T00:14:46.759 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-07T00:14:46.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:46.759 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-12-07T00:14:46.778 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T00:14:46.779 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42320sec preferred_lft 42320sec 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::3535:d433:7794:9e23/64 scope link noprefixroute 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether f6:e4:1a:8f:23:1f brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::b831:a8ff:fe91:569/64 scope link 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether f6:e4:1a:8f:23:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::f4e4:1aff:fe8f:231f/64 scope link tentative 2023-12-07T00:14:46.780 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:46.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:46.781 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T00:14:46.844 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-12-07T00:14:46.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:46.846 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-12-07T00:14:46.905 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-12-07T00:14:46.905 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T00:14:46.906 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T00:14:46.906 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T00:14:46.906 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T00:14:46.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:46.906 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:46.906 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:46.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T00:14:46.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T00:14:46.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T00:14:46.907 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:47.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:47.011 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-12-07T00:14:47.027 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T00:14:47.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:47.028 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list-id 2023-12-07T00:14:47.086 INFO:teuthology.orchestra.run.smithi179.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-07T00:14:47.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:47.086 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:47.087 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:47.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-07T00:14:47.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-07T00:14:47.087 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:47.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:47.326 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-07T00:14:47.362 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:47.362 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:47.362 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:47.362 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:47.362 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:47.363 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:47.363 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T00:14:47.363 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 22:6d:b7:2d:fd:d0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-07T00:14:47.363 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-07T00:14:47.363 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:47.363 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::206d:b7ff:fe2d:fdd0/64 scope link 2023-12-07T00:14:47.363 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:47.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:47.375 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-07T00:14:47.454 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:47.454 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:47.455 INFO:teuthology.orchestra.run.smithi179.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T00:14:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 22:6d:b7:2d:fd:d0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-07T00:14:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-07T00:14:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::206d:b7ff:fe2d:fdd0/64 scope link 2023-12-07T00:14:47.455 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:47.467 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-07T00:14:47.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:47.468 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:47.468 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:47.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-07T00:14:47.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-07T00:14:47.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-07T00:14:47.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-07T00:14:47.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-07T00:14:47.468 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:47.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:47.707 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:14:47.707 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:14:47.707 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.1 up 2023-12-07T00:14:47.707 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set dev brx.1 master ceph-brx 2023-12-07T00:14:47.707 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:14:47.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:47.816 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-07T00:14:47.835 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-07T00:14:47.835 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:47.836 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-07T00:14:47.892 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-12-07T00:14:47.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:47.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:47.978 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:47.978 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:48.005 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:48.006 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:48.006 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:14:48.006 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 2@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:14:48.006 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:14:48.006 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:14:48.006 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:14:48.006 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:14:48.082 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:48.082 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:48.082 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:14:48.083 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 2@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:14:48.083 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:14:48.083 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:14:48.083 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:14:48.083 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:14:48.083 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790" 2023-12-07T00:14:48.083 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2023-12-07T00:14:48.083 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=4803447b-a0af-4501-a3c6-e46974a67250" will pass to kernel 2023-12-07T00:14:48.085 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T00:14:48.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:48.085 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-07T00:14:48.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:48.111 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:48.185 INFO:teuthology.orchestra.run.smithi179.stdout:client4738 2023-12-07T00:14:48.185 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:14:48.185 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:14:48.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:48.243 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:48.314 INFO:teuthology.orchestra.run.smithi179.stdout:client4738 2023-12-07T00:14:48.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:48.314 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:48.387 INFO:teuthology.orchestra.run.smithi179.stdout:client4738 2023-12-07T00:14:48.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:48.387 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4803447b-a0af-4501-a3c6-e46974a67250.client4738/status') 2023-12-07T00:14:48.467 INFO:teuthology.orchestra.run.smithi179.stdout:instance: client.4738 (3)172.21.15.179:0/3103783361 2023-12-07T00:14:48.467 INFO:teuthology.orchestra.run.smithi179.stdout:blocklisted: false 2023-12-07T00:14:48.467 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records in 2023-12-07T00:14:48.467 INFO:teuthology.orchestra.run.smithi179.stderr:0+1 records out 2023-12-07T00:14:48.468 INFO:teuthology.orchestra.run.smithi179.stderr:71 bytes copied, 2.2311e-05 s, 3.2 MB/s 2023-12-07T00:14:48.468 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-07T00:14:48.469 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T00:14:48.469 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T00:14:48.469 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T00:14:48.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.632+0000 7f81f2953700 1 Processor -- start 2023-12-07T00:14:48.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.632+0000 7f81f2953700 1 -- start start 2023-12-07T00:14:48.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.633+0000 7f81f2953700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f81ec158560 0x7f81ec0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:48.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.633+0000 7f81f2953700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81ec15b010 0x7f81ec0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:48.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.633+0000 7f81f2953700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ec0b2ef0 con 0x7f81ec0b2aa0 2023-12-07T00:14:48.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.633+0000 7f81f2953700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec15b8d0 con 0x7f81ec15b010 2023-12-07T00:14:48.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.633+0000 7f81f2953700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ec15bbb0 con 0x7f81ec158560 2023-12-07T00:14:48.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.633+0000 7f81eb7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f81ec15b010 0x7f81ec0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:48.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.633+0000 7f81f0ef0700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f81ec0b2aa0 0x7f81ec06e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46914/0 (socket says 172.21.15.179:46914) 2023-12-07T00:14:48.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.633+0000 7f81f0ef0700 1 -- 172.21.15.179:0/1309627911 learned_addr learned my addr 172.21.15.179:0/1309627911 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81ebfff700 1 --2- 172.21.15.179:0/1309627911 >> v2:172.21.15.190:3300/0 conn(0x7f81ec158560 0x7f81ec0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eb7fe700 1 -- 172.21.15.179:0/1309627911 >> v2:172.21.15.190:3300/0 conn(0x7f81ec158560 msgr2=0x7f81ec0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eb7fe700 1 --2- 172.21.15.179:0/1309627911 >> v2:172.21.15.190:3300/0 conn(0x7f81ec158560 0x7f81ec0b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eb7fe700 1 -- 172.21.15.179:0/1309627911 >> v1:172.21.15.179:6789/0 conn(0x7f81ec0b2aa0 legacy=0x7f81ec06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eaffd700 1 -- 172.21.15.179:0/1309627911 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297045998 0 0) 0x7f81e4001490 con 0x7f81ec0b2aa0 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eb7fe700 1 -- 172.21.15.179:0/1309627911 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ec15be90 con 0x7f81ec15b010 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eb7fe700 1 --2- 172.21.15.179:0/1309627911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec15b010 0x7f81ec0b2560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b5da0 tx=0x7f81dc009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5ebb93ab5f6706 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eaffd700 1 -- 172.21.15.179:0/1309627911 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc005e30 con 0x7f81ec15b010 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eaffd700 1 -- 172.21.15.179:0/1309627911 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc006030 con 0x7f81ec15b010 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81eaffd700 1 -- 172.21.15.179:0/1309627911 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0063c0 con 0x7f81ec15b010 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81f2953700 1 -- 172.21.15.179:0/1309627911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec15b010 msgr2=0x7f81ec0b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81f2953700 1 --2- 172.21.15.179:0/1309627911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec15b010 0x7f81ec0b2560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b5da0 tx=0x7f81dc009b00 comp rx=0 tx=0).stop 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81f2953700 1 -- 172.21.15.179:0/1309627911 shutdown_connections 2023-12-07T00:14:48.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81f2953700 1 --2- 172.21.15.179:0/1309627911 >> v2:172.21.15.190:3300/0 conn(0x7f81ec158560 0x7f81ec0b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81f2953700 1 --2- 172.21.15.179:0/1309627911 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec15b010 0x7f81ec0b2560 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.634+0000 7f81f2953700 1 -- 172.21.15.179:0/1309627911 >> 172.21.15.179:0/1309627911 conn(0x7f81ec072970 msgr2=0x7f81ec072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:48.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.635+0000 7f81f2953700 1 -- 172.21.15.179:0/1309627911 shutdown_connections 2023-12-07T00:14:48.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.635+0000 7f81f2953700 1 -- 172.21.15.179:0/1309627911 wait complete. 2023-12-07T00:14:48.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.636+0000 7f81f2953700 1 Processor -- start 2023-12-07T00:14:48.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.636+0000 7f81f2953700 1 -- start start 2023-12-07T00:14:48.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f2953700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81ec0b2aa0 0x7f81ec15d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:48.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f2953700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec158560 0x7f81ec1403e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:48.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f2953700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81ec15b010 0x7f81ec14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:48.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f2953700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec15d4b0 con 0x7f81ec158560 2023-12-07T00:14:48.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f2953700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec14eb60 con 0x7f81ec15b010 2023-12-07T00:14:48.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f2953700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ec15cb80 con 0x7f81ec0b2aa0 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec158560 0x7f81ec1403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec158560 0x7f81ec1403e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40016/0 (socket says 172.21.15.179:40016) 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 -- 172.21.15.179:0/194798411 learned_addr learned my addr 172.21.15.179:0/194798411 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f0ef0700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81ec15b010 0x7f81ec14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81ebfff700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81ec0b2aa0 0x7f81ec15d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 -- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81ec0b2aa0 msgr2=0x7f81ec15d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81ec0b2aa0 0x7f81ec15d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 -- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81ec15b010 msgr2=0x7f81ec14e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81ec15b010 0x7f81ec14e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 -- 172.21.15.179:0/194798411 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc009430 con 0x7f81ec158560 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f0ef0700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81ec15b010 0x7f81ec14e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81eb7fe700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec158560 0x7f81ec1403e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009fd0 tx=0x7f81dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81e8ff9700 1 -- 172.21.15.179:0/194798411 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc004040 con 0x7f81ec158560 2023-12-07T00:14:48.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81e8ff9700 1 -- 172.21.15.179:0/194798411 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc020070 con 0x7f81ec158560 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ec15ce60 con 0x7f81ec158560 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81e8ff9700 1 -- 172.21.15.179:0/194798411 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc004400 con 0x7f81ec158560 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.637+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ec140920 con 0x7f81ec158560 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.638+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ec04f290 con 0x7f81ec158560 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.639+0000 7f81e8ff9700 1 -- 172.21.15.179:0/194798411 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81dc022030 con 0x7f81ec158560 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.639+0000 7f81e8ff9700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f81d806aed0 0x7f81d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.639+0000 7f81e8ff9700 1 -- 172.21.15.179:0/194798411 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f81dc08ac30 con 0x7f81ec158560 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.639+0000 7f81ebfff700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f81d806aed0 0x7f81d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:48.642 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.639+0000 7f81ebfff700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f81d806aed0 0x7f81d806d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81e00099d0 tx=0x7f81e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:48.643 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.643+0000 7f81e8ff9700 1 -- 172.21.15.179:0/194798411 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81dc055a80 con 0x7f81ec158560 2023-12-07T00:14:48.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.882+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81ec15b4c0 con 0x7f81ec158560 2023-12-07T00:14:48.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.882+0000 7f81e8ff9700 1 -- 172.21.15.179:0/194798411 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f81dc0590a0 con 0x7f81ec158560 2023-12-07T00:14:48.881 INFO:teuthology.orchestra.run.smithi179.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-07T00:14:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f81d806aed0 msgr2=0x7f81d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:48.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f81d806aed0 0x7f81d806d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f81e00099d0 tx=0x7f81e0008040 comp rx=0 tx=0).stop 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec158560 msgr2=0x7f81ec1403e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec158560 0x7f81ec1403e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f81dc009fd0 tx=0x7f81dc004750 comp rx=0 tx=0).stop 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 shutdown_connections 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f81d806aed0 0x7f81d806d390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81ec15b010 0x7f81ec14e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81ec0b2aa0 0x7f81ec15d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 --2- 172.21.15.179:0/194798411 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81ec158560 0x7f81ec1403e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 >> 172.21.15.179:0/194798411 conn(0x7f81ec072970 msgr2=0x7f81ec0b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 shutdown_connections 2023-12-07T00:14:48.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:48.884+0000 7f81f2953700 1 -- 172.21.15.179:0/194798411 wait complete. 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T00:14:48.896 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-07T00:14:48.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:48.896 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2023-12-07T00:14:48.917 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:48.918 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-07T00:14:48.919 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42321sec preferred_lft 42321sec 2023-12-07T00:14:48.919 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::b9a6:d503:49ae:9958/64 scope link noprefixroute 2023-12-07T00:14:48.919 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:48.919 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-07T00:14:48.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:48.919 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:48.919 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:48.919 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add name ceph-brx type bridge 2023-12-07T00:14:48.919 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr flush dev ceph-brx 2023-12-07T00:14:48.919 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set ceph-brx up 2023-12-07T00:14:48.920 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-07T00:14:48.920 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:49.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:49.108 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T00:14:49.137 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-12-07T00:14:49.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:49.138 DEBUG:teuthology.orchestra.run.smithi190:> route 2023-12-07T00:14:49.208 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2023-12-07T00:14:49.208 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T00:14:49.208 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T00:14:49.208 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T00:14:49.208 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T00:14:49.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:49.209 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:49.209 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:49.209 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T00:14:49.209 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T00:14:49.209 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T00:14:49.209 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:49.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:49.464 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-12-07T00:14:49.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:49.481 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2023-12-07T00:14:49.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:49.537 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:49.537 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:49.537 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T00:14:49.537 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-07T00:14:49.537 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:49.632 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-07T00:14:49.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:49.632 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:49.632 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:49.632 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-07T00:14:49.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-07T00:14:49.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-07T00:14:49.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-07T00:14:49.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-07T00:14:49.633 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:49.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:49.845 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:49.845 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:49.845 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.0 up 2023-12-07T00:14:49.845 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.0 master ceph-brx 2023-12-07T00:14:49.845 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:49.948 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:49.948 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-07T00:14:49.967 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-07T00:14:49.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:49.968 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-07T00:14:50.024 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-07T00:14:50.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:50.024 DEBUG:teuthology.orchestra.run.smithi190:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:50.114 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:50.114 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:50.224 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:50.225 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:50.225 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:14:50.225 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with new device syntax: 1@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:14:50.225 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:14:50.225 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:14:50.225 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:14:50.225 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:14:50.251 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:50.251 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:50.251 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:14:50.251 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with new device syntax: 1@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:14:50.251 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:14:50.251 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:14:50.251 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:14:50.251 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:14:50.252 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790" 2023-12-07T00:14:50.252 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2023-12-07T00:14:50.252 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=4803447b-a0af-4501-a3c6-e46974a67250" will pass to kernel 2023-12-07T00:14:50.253 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T00:14:50.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:50.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-07T00:14:50.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:50.287 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:50.360 INFO:teuthology.orchestra.run.smithi190.stdout:client4747 2023-12-07T00:14:50.360 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:14:50.360 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:14:50.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:50.418 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:50.489 INFO:teuthology.orchestra.run.smithi190.stdout:client4747 2023-12-07T00:14:50.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:50.490 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:50.562 INFO:teuthology.orchestra.run.smithi190.stdout:client4747 2023-12-07T00:14:50.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:50.563 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4803447b-a0af-4501-a3c6-e46974a67250.client4747/status') 2023-12-07T00:14:50.643 INFO:teuthology.orchestra.run.smithi190.stdout:instance: client.4747 (3)192.168.0.1:0/2675856383 2023-12-07T00:14:50.644 INFO:teuthology.orchestra.run.smithi190.stdout:blocklisted: false 2023-12-07T00:14:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records in 2023-12-07T00:14:50.644 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records out 2023-12-07T00:14:50.645 INFO:teuthology.orchestra.run.smithi190.stderr:69 bytes copied, 2.6284e-05 s, 2.6 MB/s 2023-12-07T00:14:50.645 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-12-07T00:14:50.645 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-07T00:14:50.645 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-07T00:14:50.645 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T00:14:50.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.780+0000 7f26d43fa700 1 Processor -- start 2023-12-07T00:14:50.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.781+0000 7f26d43fa700 1 -- start start 2023-12-07T00:14:50.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.781+0000 7f26d43fa700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f26cc15dd50 0x7f26cc1624c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:50.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.781+0000 7f26d43fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc15e130 0x7f26cc0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:50.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d43fa700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26cc162a00 con 0x7f26cc0ce430 2023-12-07T00:14:50.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d43fa700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26cc0d1dc0 con 0x7f26cc15dd50 2023-12-07T00:14:50.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d43fa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc0ce9f0 con 0x7f26cc15e130 2023-12-07T00:14:50.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d2196700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f26cc15dd50 0x7f26cc1624c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:50.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d2196700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f26cc15dd50 0x7f26cc1624c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40022/0 (socket says 172.21.15.179:40022) 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d2196700 1 -- 172.21.15.179:0/2147501820 learned_addr learned my addr 172.21.15.179:0/2147501820 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d1995700 1 --2- 172.21.15.179:0/2147501820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc15e130 0x7f26cc0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d2196700 1 -- 172.21.15.179:0/2147501820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc15e130 msgr2=0x7f26cc0d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d2196700 1 --2- 172.21.15.179:0/2147501820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc15e130 0x7f26cc0d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d2196700 1 -- 172.21.15.179:0/2147501820 >> v1:172.21.15.190:6789/0 conn(0x7f26cc0ce430 legacy=0x7f26cc0b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d2196700 1 -- 172.21.15.179:0/2147501820 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0cecd0 con 0x7f26cc15dd50 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d1995700 1 --2- 172.21.15.179:0/2147501820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc15e130 0x7f26cc0d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d2196700 1 --2- 172.21.15.179:0/2147501820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc1624c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f26c80098f0 tx=0x7f26c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8e2153902505df server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d1194700 1 -- 172.21.15.179:0/2147501820 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c800b8a0 con 0x7f26cc15dd50 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d1194700 1 -- 172.21.15.179:0/2147501820 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c800ba00 con 0x7f26cc15dd50 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.782+0000 7f26d1194700 1 -- 172.21.15.179:0/2147501820 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c800bd90 con 0x7f26cc15dd50 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.783+0000 7f26d43fa700 1 -- 172.21.15.179:0/2147501820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 msgr2=0x7f26cc1624c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.783+0000 7f26d43fa700 1 --2- 172.21.15.179:0/2147501820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc1624c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f26c80098f0 tx=0x7f26c8009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:50.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.783+0000 7f26d43fa700 1 -- 172.21.15.179:0/2147501820 shutdown_connections 2023-12-07T00:14:50.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.783+0000 7f26d43fa700 1 --2- 172.21.15.179:0/2147501820 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc1624c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:50.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.783+0000 7f26d43fa700 1 --2- 172.21.15.179:0/2147501820 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc15e130 0x7f26cc0d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:50.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.783+0000 7f26d43fa700 1 -- 172.21.15.179:0/2147501820 >> 172.21.15.179:0/2147501820 conn(0x7f26cc06c8e0 msgr2=0x7f26cc06ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:50.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.783+0000 7f26d43fa700 1 -- 172.21.15.179:0/2147501820 shutdown_connections 2023-12-07T00:14:50.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.783+0000 7f26d43fa700 1 -- 172.21.15.179:0/2147501820 wait complete. 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.784+0000 7f26d43fa700 1 Processor -- start 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.784+0000 7f26d43fa700 1 -- start start 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d43fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc0ce430 0x7f26cc1f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d43fa700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d43fa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26cc15e130 0x7f26cc0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d43fa700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc15aa10 con 0x7f26cc15dd50 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d43fa700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc1f3700 con 0x7f26cc15e130 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d43fa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc160c40 con 0x7f26cc0ce430 2023-12-07T00:14:50.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc15f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40028/0 (socket says 172.21.15.179:40028) 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 -- 172.21.15.179:0/604388696 learned_addr learned my addr 172.21.15.179:0/604388696 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d2196700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc0ce430 0x7f26cc1f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d2997700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26cc15e130 0x7f26cc0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 -- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc0ce430 msgr2=0x7f26cc1f31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc0ce430 0x7f26cc1f31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 -- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26cc15e130 msgr2=0x7f26cc0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26cc15e130 0x7f26cc0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 -- 172.21.15.179:0/604388696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c8009550 con 0x7f26cc15dd50 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d2196700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc0ce430 0x7f26cc1f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.785+0000 7f26d1995700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc15f9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e810 tx=0x7f26bc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.786+0000 7f26c2ffd700 1 -- 172.21.15.179:0/604388696 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00c020 con 0x7f26cc15dd50 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.786+0000 7f26c2ffd700 1 -- 172.21.15.179:0/604388696 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc004250 con 0x7f26cc15dd50 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.786+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc1f3970 con 0x7f26cc15dd50 2023-12-07T00:14:50.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.786+0000 7f26c2ffd700 1 -- 172.21.15.179:0/604388696 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc0036a0 con 0x7f26cc15dd50 2023-12-07T00:14:50.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.786+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc160680 con 0x7f26cc15dd50 2023-12-07T00:14:50.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.787+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26cc067ee0 con 0x7f26cc15dd50 2023-12-07T00:14:50.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.787+0000 7f26c2ffd700 1 -- 172.21.15.179:0/604388696 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26bc003800 con 0x7f26cc15dd50 2023-12-07T00:14:50.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.788+0000 7f26c2ffd700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f26b006aed0 0x7f26b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:50.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.788+0000 7f26c2ffd700 1 -- 172.21.15.179:0/604388696 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26bc089170 con 0x7f26cc15dd50 2023-12-07T00:14:50.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.788+0000 7f26d2196700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f26b006aed0 0x7f26b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:50.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.788+0000 7f26d2196700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f26b006aed0 0x7f26b006d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009c40 tx=0x7f26c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:50.791 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:50.792+0000 7f26c2ffd700 1 -- 172.21.15.179:0/604388696 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26bc053fc0 con 0x7f26cc15dd50 2023-12-07T00:14:51.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.027+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f26cc0d18e0 con 0x7f26cc15dd50 2023-12-07T00:14:51.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.027+0000 7f26c2ffd700 1 -- 172.21.15.179:0/604388696 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f26bc0575e0 con 0x7f26cc15dd50 2023-12-07T00:14:51.026 INFO:teuthology.orchestra.run.smithi179.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-07T00:14:51.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f26b006aed0 msgr2=0x7f26b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:51.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f26b006aed0 0x7f26b006d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009c40 tx=0x7f26c8008030 comp rx=0 tx=0).stop 2023-12-07T00:14:51.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 msgr2=0x7f26cc15f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc15f9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f26bc00e810 tx=0x7f26bc00eb20 comp rx=0 tx=0).stop 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 shutdown_connections 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f26b006aed0 0x7f26b006d390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26cc15e130 0x7f26cc0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26cc0ce430 0x7f26cc1f31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 --2- 172.21.15.179:0/604388696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f26cc15dd50 0x7f26cc15f9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 >> 172.21.15.179:0/604388696 conn(0x7f26cc06c8e0 msgr2=0x7f26cc0b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 shutdown_connections 2023-12-07T00:14:51.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:51.029+0000 7f26d43fa700 1 -- 172.21.15.179:0/604388696 wait complete. 2023-12-07T00:14:51.040 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-07T00:14:51.040 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T00:14:51.040 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi190.front.sepia.ceph.com 2023-12-07T00:14:51.040 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-07T00:14:51.041 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-07T00:14:51.041 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-07T00:14:51.041 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-07T00:14:51.041 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T00:14:51.041 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-07T00:14:51.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.041 DEBUG:teuthology.orchestra.run.smithi190:> ip addr 2023-12-07T00:14:51.059 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:51.059 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:51.059 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:51.059 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.059 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:51.059 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.059 INFO:teuthology.orchestra.run.smithi190.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:51.059 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d0 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:d9:36:d1 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:62 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether 0c:c4:7a:88:77:63 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: inet 172.21.15.190/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft 42319sec preferred_lft 42319sec 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::b9a6:d503:49ae:9958/64 scope link noprefixroute 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether f2:a9:86:da:77:e7 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T00:14:51.060 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.061 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::a02a:3dff:fece:aa94/64 scope link 2023-12-07T00:14:51.061 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.061 INFO:teuthology.orchestra.run.smithi190.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T00:14:51.061 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether f2:a9:86:da:77:e7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-07T00:14:51.061 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::f0a9:86ff:feda:77e7/64 scope link tentative 2023-12-07T00:14:51.061 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.061 DEBUG:teuthology.orchestra.run.smithi190:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T00:14:51.126 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-12-07T00:14:51.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.128 DEBUG:teuthology.orchestra.run.smithi190:> route 2023-12-07T00:14:51.186 INFO:teuthology.orchestra.run.smithi190.stdout:Kernel IP routing table 2023-12-07T00:14:51.186 INFO:teuthology.orchestra.run.smithi190.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T00:14:51.186 INFO:teuthology.orchestra.run.smithi190.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T00:14:51.187 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T00:14:51.187 INFO:teuthology.orchestra.run.smithi190.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T00:14:51.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.187 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:51.187 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:51.187 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T00:14:51.187 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T00:14:51.187 DEBUG:teuthology.orchestra.run.smithi190:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T00:14:51.187 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:51.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.291 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-12-07T00:14:51.308 INFO:teuthology.orchestra.run.smithi190.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-07T00:14:51.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.309 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list-id 2023-12-07T00:14:51.365 INFO:teuthology.orchestra.run.smithi190.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-07T00:14:51.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.366 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:51.366 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:51.366 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-07T00:14:51.366 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-07T00:14:51.366 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:51.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.459 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-07T00:14:51.491 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:51.491 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:51.491 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:51.491 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.491 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:51.491 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.491 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T00:14:51.492 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether ae:d4:df:92:2c:1d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-07T00:14:51.492 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-07T00:14:51.492 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.492 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::acd4:dfff:fe92:2c1d/64 scope link tentative 2023-12-07T00:14:51.492 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.499 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-07T00:14:51.577 INFO:teuthology.orchestra.run.smithi190.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 ::1/128 scope host 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: link/ether ae:d4:df:92:2c:1d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: inet6 fe80::acd4:dfff:fe92:2c1d/64 scope link tentative 2023-12-07T00:14:51.578 INFO:teuthology.orchestra.run.smithi190.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:14:51.590 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-07T00:14:51.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.591 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:51.591 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:51.591 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-07T00:14:51.591 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-07T00:14:51.591 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-07T00:14:51.591 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-07T00:14:51.591 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-07T00:14:51.591 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:51.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:51.833 DEBUG:teuthology.orchestra.run.smithi190:> (cd / && exec bash -c ' 2023-12-07T00:14:51.834 DEBUG:teuthology.orchestra.run.smithi190:> set -e 2023-12-07T00:14:51.834 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set brx.1 up 2023-12-07T00:14:51.834 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link set dev brx.1 master ceph-brx 2023-12-07T00:14:51.834 DEBUG:teuthology.orchestra.run.smithi190:> ') 2023-12-07T00:14:51.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:51.968 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-07T00:14:51.989 INFO:teuthology.orchestra.run.smithi190.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-07T00:14:51.989 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:14:51.989 DEBUG:teuthology.orchestra.run.smithi190:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-07T00:14:52.045 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-12-07T00:14:52.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:52.045 DEBUG:teuthology.orchestra.run.smithi190:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:52.130 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:52.130 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:52.157 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:52.157 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:52.157 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:14:52.157 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with new device syntax: 3@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:14:52.157 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:14:52.158 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:14:52.158 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:14:52.158 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:14:52.227 INFO:teuthology.orchestra.run.smithi190.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:14:52.227 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:14:52.227 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:14:52.227 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with new device syntax: 3@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:14:52.227 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:14:52.227 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:14:52.228 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:14:52.228 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:14:52.228 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: resolved to: "172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790" 2023-12-07T00:14:52.228 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2023-12-07T00:14:52.228 INFO:teuthology.orchestra.run.smithi190.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=4803447b-a0af-4501-a3c6-e46974a67250" will pass to kernel 2023-12-07T00:14:52.229 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T00:14:52.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:52.230 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-07T00:14:52.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:52.256 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:52.329 INFO:teuthology.orchestra.run.smithi190.stdout:client4756 2023-12-07T00:14:52.329 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:14:52.329 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:14:52.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:52.387 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:52.460 INFO:teuthology.orchestra.run.smithi190.stdout:client4756 2023-12-07T00:14:52.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:52.460 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:14:52.532 INFO:teuthology.orchestra.run.smithi190.stdout:client4756 2023-12-07T00:14:52.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:14:52.533 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4803447b-a0af-4501-a3c6-e46974a67250.client4756/status') 2023-12-07T00:14:52.613 INFO:teuthology.orchestra.run.smithi190.stdout:instance: client.4756 (3)192.168.0.2:0/949437360 2023-12-07T00:14:52.613 INFO:teuthology.orchestra.run.smithi190.stdout:blocklisted: false 2023-12-07T00:14:52.613 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records in 2023-12-07T00:14:52.613 INFO:teuthology.orchestra.run.smithi190.stderr:0+1 records out 2023-12-07T00:14:52.614 INFO:teuthology.orchestra.run.smithi190.stderr:68 bytes copied, 2.2439e-05 s, 3.0 MB/s 2023-12-07T00:14:52.618 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-07T00:14:52.735 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:52.869 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.870+0000 7f7e0e2c9700 1 Processor -- start 2023-12-07T00:14:52.870 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.870+0000 7f7e0e2c9700 1 -- start start 2023-12-07T00:14:52.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e0e2c9700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e0815de40 0x7f7e080b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e0e2c9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7e0815e220 0x7f7e080b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e0e2c9700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0815f330 con 0x7f7e080b4c20 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e0e2c9700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e080d1820 con 0x7f7e0815de40 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e0e2c9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0815e720 con 0x7f7e0815e220 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e07fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e0815de40 0x7f7e080b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e07fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7e0815de40 0x7f7e080b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40036/0 (socket says 172.21.15.179:40036) 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e07fff700 1 -- 172.21.15.179:0/1055562962 learned_addr learned my addr 172.21.15.179:0/1055562962 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e0c866700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f7e080b4c20 0x7f7e0806af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46940/0 (socket says 172.21.15.179:46940) 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e077fe700 1 --2- 172.21.15.179:0/1055562962 >> v2:172.21.15.190:3300/0 conn(0x7f7e0815e220 0x7f7e080b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e07fff700 1 -- 172.21.15.179:0/1055562962 >> v2:172.21.15.190:3300/0 conn(0x7f7e0815e220 msgr2=0x7f7e080b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e07fff700 1 --2- 172.21.15.179:0/1055562962 >> v2:172.21.15.190:3300/0 conn(0x7f7e0815e220 0x7f7e080b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e07fff700 1 -- 172.21.15.179:0/1055562962 >> v1:172.21.15.179:6789/0 conn(0x7f7e080b4c20 legacy=0x7f7e0806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e07fff700 1 -- 172.21.15.179:0/1055562962 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0815ea00 con 0x7f7e0815de40 2023-12-07T00:14:52.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.871+0000 7f7e06ffd700 1 -- 172.21.15.179:0/1055562962 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826255064 0 0) 0x7f7e0815f330 con 0x7f7e080b4c20 2023-12-07T00:14:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e07fff700 1 --2- 172.21.15.179:0/1055562962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815de40 0x7f7e080b46e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e0815f2a0 tx=0x7f7dfc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fa12e569f7aa97 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e06ffd700 1 -- 172.21.15.179:0/1055562962 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00b870 con 0x7f7e0815de40 2023-12-07T00:14:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e06ffd700 1 -- 172.21.15.179:0/1055562962 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc00b9d0 con 0x7f7e0815de40 2023-12-07T00:14:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e06ffd700 1 -- 172.21.15.179:0/1055562962 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc00bd60 con 0x7f7e0815de40 2023-12-07T00:14:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/1055562962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815de40 msgr2=0x7f7e080b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/1055562962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815de40 0x7f7e080b46e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e0815f2a0 tx=0x7f7dfc009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:52.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/1055562962 shutdown_connections 2023-12-07T00:14:52.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/1055562962 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815de40 0x7f7e080b46e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:52.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/1055562962 >> v2:172.21.15.190:3300/0 conn(0x7f7e0815e220 0x7f7e080b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:52.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/1055562962 >> 172.21.15.179:0/1055562962 conn(0x7f7e08072970 msgr2=0x7f7e08072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:52.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/1055562962 shutdown_connections 2023-12-07T00:14:52.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.872+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/1055562962 wait complete. 2023-12-07T00:14:52.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.874+0000 7f7e0e2c9700 1 Processor -- start 2023-12-07T00:14:52.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.874+0000 7f7e0e2c9700 1 -- start start 2023-12-07T00:14:52.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0e2c9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e080b4c20 0x7f7e0814ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:52.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0e2c9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0815de40 0x7f7e0814ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:52.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0e2c9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815e220 0x7f7e081f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:52.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0e2c9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081f7040 con 0x7f7e0815e220 2023-12-07T00:14:52.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0e2c9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081f72e0 con 0x7f7e0815de40 2023-12-07T00:14:52.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0e2c9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0814b350 con 0x7f7e080b4c20 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0c866700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815e220 0x7f7e081f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0c866700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815e220 0x7f7e081f3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40044/0 (socket says 172.21.15.179:40044) 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0c866700 1 -- 172.21.15.179:0/2574200935 learned_addr learned my addr 172.21.15.179:0/2574200935 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e07fff700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e080b4c20 0x7f7e0814ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e077fe700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0815de40 0x7f7e0814ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0c866700 1 -- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e080b4c20 msgr2=0x7f7e0814ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0c866700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e080b4c20 0x7f7e0814ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0c866700 1 -- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0815de40 msgr2=0x7f7e0814ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0c866700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0815de40 0x7f7e0814ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e0c866700 1 -- 172.21.15.179:0/2574200935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc009550 con 0x7f7e0815e220 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.875+0000 7f7e07fff700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e080b4c20 0x7f7e0814ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:52.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.876+0000 7f7e0c866700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815e220 0x7f7e081f3380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000cba0 tx=0x7f7e0000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.876+0000 7f7e04ff9700 1 -- 172.21.15.179:0/2574200935 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0000ab80 con 0x7f7e0815e220 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.876+0000 7f7e04ff9700 1 -- 172.21.15.179:0/2574200935 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0000ad00 con 0x7f7e0815e220 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.876+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0814b620 con 0x7f7e0815e220 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.876+0000 7f7e04ff9700 1 -- 172.21.15.179:0/2574200935 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00007310 con 0x7f7e0815e220 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.876+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0814bbe0 con 0x7f7e0815e220 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.877+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0804f290 con 0x7f7e0815e220 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.877+0000 7f7e04ff9700 1 -- 172.21.15.179:0/2574200935 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e00007470 con 0x7f7e0815e220 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.878+0000 7f7e04ff9700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7df406af20 0x7f7df406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.878+0000 7f7e07fff700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7df406af20 0x7f7df406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.878+0000 7f7e04ff9700 1 -- 172.21.15.179:0/2574200935 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e00089790 con 0x7f7e0815e220 2023-12-07T00:14:52.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.878+0000 7f7e07fff700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7df406af20 0x7f7df406d3e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc000c00 tx=0x7f7dfc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:52.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:52.882+0000 7f7e04ff9700 1 -- 172.21.15.179:0/2574200935 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e00054630 con 0x7f7e0815e220 2023-12-07T00:14:53.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.072+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e081f7450 con 0x7f7e0815e220 2023-12-07T00:14:53.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.073+0000 7f7e04ff9700 1 -- 172.21.15.179:0/2574200935 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f7e00018020 con 0x7f7e0815e220 2023-12-07T00:14:53.073 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:53.073 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":27,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:20.677943+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7df406af20 msgr2=0x7f7df406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7df406af20 0x7f7df406d3e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc000c00 tx=0x7f7dfc008030 comp rx=0 tx=0).stop 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815e220 msgr2=0x7f7e081f3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815e220 0x7f7e081f3380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000cba0 tx=0x7f7e0000cf60 comp rx=0 tx=0).stop 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 shutdown_connections 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f7df406af20 0x7f7df406d3e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7e0815e220 0x7f7e081f3380 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7e080b4c20 0x7f7e0814ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.076 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 --2- 172.21.15.179:0/2574200935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7e0815de40 0x7f7e0814ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 >> 172.21.15.179:0/2574200935 conn(0x7f7e08072970 msgr2=0x7f7e080b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 shutdown_connections 2023-12-07T00:14:53.077 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.076+0000 7f7e0e2c9700 1 -- 172.21.15.179:0/2574200935 wait complete. 2023-12-07T00:14:53.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:53.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:53.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.215+0000 7f6d6d8c5700 1 Processor -- start 2023-12-07T00:14:53.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.215+0000 7f6d6d8c5700 1 -- start start 2023-12-07T00:14:53.216 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d6d8c5700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d6806c020 0x7f6d6806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.216 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d6d8c5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6730 0x7f6d6806af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d6d8c5700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6815dce0 con 0x7f6d680c6bb0 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d6d8c5700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d680c70f0 con 0x7f6d6806c020 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d6d8c5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6806c940 con 0x7f6d680c6730 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d66ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d6806c020 0x7f6d6806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d66ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6d6806c020 0x7f6d6806c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40048/0 (socket says 172.21.15.179:40048) 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d66ffd700 1 -- 172.21.15.179:0/1282528318 learned_addr learned my addr 172.21.15.179:0/1282528318 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d667fc700 1 --2- 172.21.15.179:0/1282528318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6730 0x7f6d6806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d66ffd700 1 -- 172.21.15.179:0/1282528318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6730 msgr2=0x7f6d6806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d66ffd700 1 --2- 172.21.15.179:0/1282528318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6730 0x7f6d6806af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d66ffd700 1 -- 172.21.15.179:0/1282528318 >> v1:172.21.15.190:6789/0 conn(0x7f6d680c6bb0 legacy=0x7f6d6806b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d66ffd700 1 -- 172.21.15.179:0/1282528318 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6806ee90 con 0x7f6d6806c020 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.216+0000 7f6d66ffd700 1 --2- 172.21.15.179:0/1282528318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6806c020 0x7f6d6806c400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0098f0 tx=0x7f6d5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e087d4406906f4d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d65ffb700 1 -- 172.21.15.179:0/1282528318 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c011830 con 0x7f6d6806c020 2023-12-07T00:14:53.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d65ffb700 1 -- 172.21.15.179:0/1282528318 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c011990 con 0x7f6d6806c020 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d65ffb700 1 -- 172.21.15.179:0/1282528318 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c011d20 con 0x7f6d6806c020 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/1282528318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6806c020 msgr2=0x7f6d6806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/1282528318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6806c020 0x7f6d6806c400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0098f0 tx=0x7f6d5c009c00 comp rx=0 tx=0).stop 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/1282528318 shutdown_connections 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/1282528318 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d6806c020 0x7f6d6806c400 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/1282528318 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6730 0x7f6d6806af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/1282528318 >> 172.21.15.179:0/1282528318 conn(0x7f6d680b3270 msgr2=0x7f6d680b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/1282528318 shutdown_connections 2023-12-07T00:14:53.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.217+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/1282528318 wait complete. 2023-12-07T00:14:53.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.219+0000 7f6d6d8c5700 1 Processor -- start 2023-12-07T00:14:53.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.219+0000 7f6d6d8c5700 1 -- start start 2023-12-07T00:14:53.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d6d8c5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6806c020 0x7f6d681536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d6d8c5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d680c6730 0x7f6d680b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d6d8c5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6bb0 0x7f6d680b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d6d8c5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680c9b80 con 0x7f6d680c6730 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d6d8c5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68153c30 con 0x7f6d6806c020 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d6d8c5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680b0ad0 con 0x7f6d680c6bb0 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d680c6730 0x7f6d680b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d680c6730 0x7f6d680b2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40056/0 (socket says 172.21.15.179:40056) 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 -- 172.21.15.179:0/886936744 learned_addr learned my addr 172.21.15.179:0/886936744 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d66ffd700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6806c020 0x7f6d681536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d677fe700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6bb0 0x7f6d680b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 -- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6bb0 msgr2=0x7f6d680b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6bb0 0x7f6d680b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 -- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6806c020 msgr2=0x7f6d681536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6806c020 0x7f6d681536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 -- 172.21.15.179:0/886936744 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c009550 con 0x7f6d680c6730 2023-12-07T00:14:53.221 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d66ffd700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6806c020 0x7f6d681536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:53.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d677fe700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6bb0 0x7f6d680b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:53.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d667fc700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d680c6730 0x7f6d680b2960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800f930 tx=0x7f6d5800fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d4ffff700 1 -- 172.21.15.179:0/886936744 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5800a6c0 con 0x7f6d680c6730 2023-12-07T00:14:53.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d4ffff700 1 -- 172.21.15.179:0/886936744 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5800d850 con 0x7f6d680c6730 2023-12-07T00:14:53.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d4ffff700 1 -- 172.21.15.179:0/886936744 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5800dc00 con 0x7f6d680c6730 2023-12-07T00:14:53.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d680b0db0 con 0x7f6d680c6730 2023-12-07T00:14:53.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.220+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d680b1650 con 0x7f6d680c6730 2023-12-07T00:14:53.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.221+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d680685f0 con 0x7f6d680c6730 2023-12-07T00:14:53.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.222+0000 7f6d4ffff700 1 -- 172.21.15.179:0/886936744 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d58014470 con 0x7f6d680c6730 2023-12-07T00:14:53.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.222+0000 7f6d4ffff700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6d5406aed0 0x7f6d5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.222+0000 7f6d4ffff700 1 -- 172.21.15.179:0/886936744 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6d5808a980 con 0x7f6d680c6730 2023-12-07T00:14:53.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.222+0000 7f6d66ffd700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6d5406aed0 0x7f6d5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.222+0000 7f6d66ffd700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6d5406aed0 0x7f6d5406d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c014040 tx=0x7f6d5c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.225 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.227+0000 7f6d4ffff700 1 -- 172.21.15.179:0/886936744 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d58055740 con 0x7f6d680c6730 2023-12-07T00:14:53.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.414+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d681542e0 con 0x7f6d680c6730 2023-12-07T00:14:53.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.415+0000 7f6d4ffff700 1 -- 172.21.15.179:0/886936744 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d58058d60 con 0x7f6d680c6730 2023-12-07T00:14:53.415 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:53.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6d5406aed0 msgr2=0x7f6d5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6d5406aed0 0x7f6d5406d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c014040 tx=0x7f6d5c008030 comp rx=0 tx=0).stop 2023-12-07T00:14:53.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d680c6730 msgr2=0x7f6d680b2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d680c6730 0x7f6d680b2960 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800f930 tx=0x7f6d5800fcf0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 shutdown_connections 2023-12-07T00:14:53.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6d5406aed0 0x7f6d5406d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d680c6bb0 0x7f6d680b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d6806c020 0x7f6d681536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 --2- 172.21.15.179:0/886936744 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6d680c6730 0x7f6d680b2960 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 >> 172.21.15.179:0/886936744 conn(0x7f6d680b3270 msgr2=0x7f6d680ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:53.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 shutdown_connections 2023-12-07T00:14:53.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.417+0000 7f6d6d8c5700 1 -- 172.21.15.179:0/886936744 wait complete. 2023-12-07T00:14:53.429 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:14:53.553 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.554+0000 7fb1ffd12700 1 Processor -- start 2023-12-07T00:14:53.554 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.554+0000 7fb1ffd12700 1 -- start start 2023-12-07T00:14:53.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1ffd12700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f815de50 0x7fb1f80cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1ffd12700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f80cc550 con 0x7fb1f80ccc90 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1ffd12700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f80cd1c0 con 0x7fb1f806b680 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1ffd12700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80cd4a0 con 0x7fb1f815de50 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fd2ad700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb1f80ccc90 0x7fb1f806af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46964/0 (socket says 172.21.15.179:46964) 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fd2ad700 1 -- 172.21.15.179:0/1176481570 learned_addr learned my addr 172.21.15.179:0/1176481570 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fdaae700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f815de50 0x7fb1f80cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147239230 0 0) 0x7fb1f80cc550 con 0x7fb1f80ccc90 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e40035b0 con 0x7fb1f80ccc90 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2503501817 0 0) 0x7fb1e40035b0 con 0x7fb1f80ccc90 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f815de50 msgr2=0x7fb1f80cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f815de50 0x7fb1f80cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 >> v1:172.21.15.190:6789/0 conn(0x7fb1f806b680 legacy=0x7fb1f80cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80cd780 con 0x7fb1f80ccc90 2023-12-07T00:14:53.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fb1e8001670 con 0x7fb1f80ccc90 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 >> v1:172.21.15.179:6789/0 conn(0x7fb1f80ccc90 legacy=0x7fb1f806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4003a30 0x7fb1e4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.555+0000 7fb1fcaac700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fcaac700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f815de50 0x7fb1e4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80cd4a0 con 0x7fb1e4004850 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e400bac0 con 0x7fb1e4003a30 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e400bc80 con 0x7fb1f815de50 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fd2ad700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fdaae700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4003a30 0x7fb1e4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fe2af700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f815de50 0x7fb1e4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fd2ad700 1 -- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f815de50 msgr2=0x7fb1e4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fd2ad700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f815de50 0x7fb1e4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fd2ad700 1 -- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4003a30 msgr2=0x7fb1e4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:53.563 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fd2ad700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4003a30 0x7fb1e4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fd2ad700 1 -- 172.21.15.179:0/1176481570 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40035b0 con 0x7fb1e4004850 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fd2ad700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80cd0f0 tx=0x7fb1e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321fc71b4013572a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8007c10 con 0x7fb1e4004850 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e800cda0 con 0x7fb1e4004850 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.556+0000 7fb1fcaac700 1 -- 172.21.15.179:0/1176481570 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e8005ba0 con 0x7fb1e4004850 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.557+0000 7fb1ffd12700 1 -- 172.21.15.179:0/1176481570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e4004850 msgr2=0x7fb1e4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.557+0000 7fb1ffd12700 1 --2- 172.21.15.179:0/1176481570 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb1f80cd0f0 tx=0x7fb1e4005880 comp rx=0 tx=0).stop 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.557+0000 7fb1fe2af700 1 -- 172.21.15.179:0/1176481570 reap_dead start 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.557+0000 7fb1ffd12700 1 -- 172.21.15.179:0/1176481570 shutdown_connections 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.557+0000 7fb1ffd12700 1 -- 172.21.15.179:0/1176481570 >> 172.21.15.179:0/1176481570 conn(0x7fb1f8099a40 msgr2=0x7fb1f8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.557+0000 7fb1ffd12700 1 -- 172.21.15.179:0/1176481570 shutdown_connections 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.557+0000 7fb1ffd12700 1 -- 172.21.15.179:0/1176481570 wait complete. 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.558+0000 7fb1ffd12700 1 Processor -- start 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.558+0000 7fb1ffd12700 1 -- start start 2023-12-07T00:14:53.564 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ffd12700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4004850 0x7fb1f8152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ffd12700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f80b5bf0 0x7fb1f80b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ffd12700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1f80c63f0 0x7fb1f80c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ffd12700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80b47c0 con 0x7fb1f80c63f0 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ffd12700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f80c5f60 con 0x7fb1e4004850 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ffd12700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f81526b0 con 0x7fb1f80b5bf0 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1f80c63f0 0x7fb1f80c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1f80c63f0 0x7fb1f80c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40076/0 (socket says 172.21.15.179:40076) 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 -- 172.21.15.179:0/2625806869 learned_addr learned my addr 172.21.15.179:0/2625806869 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fdaae700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4004850 0x7fb1f8152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fd2ad700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f80b5bf0 0x7fb1f80b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 -- 172.21.15.179:0/2625806869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f80b5bf0 msgr2=0x7fb1f80b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f80b5bf0 0x7fb1f80b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 -- 172.21.15.179:0/2625806869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4004850 msgr2=0x7fb1f8152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4004850 0x7fb1f8152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.565 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 -- 172.21.15.179:0/2625806869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f80c5350 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1fe2af700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1f80c63f0 0x7fb1f80c68a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb1f806e8c0 tx=0x7fb1f000edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ee7fc700 1 -- 172.21.15.179:0/2625806869 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0003c10 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ee7fc700 1 -- 172.21.15.179:0/2625806869 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0003db0 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f80c5630 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.559+0000 7fb1ee7fc700 1 -- 172.21.15.179:0/2625806869 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0005310 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.560+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f80c5bf0 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.560+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f80c5d80 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.561+0000 7fb1ee7fc700 1 -- 172.21.15.179:0/2625806869 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb1f0005470 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.561+0000 7fb1ee7fc700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1dc06aed0 0x7fb1dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.561+0000 7fb1fdaae700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1dc06aed0 0x7fb1dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.561+0000 7fb1ee7fc700 1 -- 172.21.15.179:0/2625806869 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb1f00897a0 con 0x7fb1f80c63f0 2023-12-07T00:14:53.566 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.562+0000 7fb1fdaae700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1dc06aed0 0x7fb1dc06d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb1f815b560 tx=0x7fb1f4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.567 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.566+0000 7fb1ee7fc700 1 -- 172.21.15.179:0/2625806869 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1f00545f0 con 0x7fb1f80c63f0 2023-12-07T00:14:53.760 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.760+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1f80685f0 con 0x7fb1f80c63f0 2023-12-07T00:14:53.760 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.761+0000 7fb1ee7fc700 1 -- 172.21.15.179:0/2625806869 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1f0057c10 con 0x7fb1f80c63f0 2023-12-07T00:14:53.760 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:53.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1dc06aed0 msgr2=0x7fb1dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1dc06aed0 0x7fb1dc06d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb1f815b560 tx=0x7fb1f4009210 comp rx=0 tx=0).stop 2023-12-07T00:14:53.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1f80c63f0 msgr2=0x7fb1f80c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1f80c63f0 0x7fb1f80c68a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb1f806e8c0 tx=0x7fb1f000edd0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.762 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 shutdown_connections 2023-12-07T00:14:53.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb1dc06aed0 0x7fb1dc06d390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb1f80c63f0 0x7fb1f80c68a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1e4004850 0x7fb1f8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 --2- 172.21.15.179:0/2625806869 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb1f80b5bf0 0x7fb1f80b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 >> 172.21.15.179:0/2625806869 conn(0x7fb1f8099a40 msgr2=0x7fb1f80b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:53.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 shutdown_connections 2023-12-07T00:14:53.763 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.763+0000 7fb1ffd12700 1 -- 172.21.15.179:0/2625806869 wait complete. 2023-12-07T00:14:53.775 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:14:53.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.899+0000 7fea23276700 1 Processor -- start 2023-12-07T00:14:53.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.899+0000 7fea23276700 1 -- start start 2023-12-07T00:14:53.900 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea23276700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 0x7fea1c0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.900 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea23276700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fea1c0ccc90 0x7fea1c06af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea23276700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea1c06b4b0 0x7fea1c1619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea23276700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c06b910 con 0x7fea1c06b4b0 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea23276700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c0cc550 con 0x7fea1c0ccc90 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea23276700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0cd1c0 con 0x7fea1c15de50 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea1c06b4b0 0x7fea1c1619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fea1c06b4b0 0x7fea1c1619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40082/0 (socket says 172.21.15.179:40082) 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 -- 172.21.15.179:0/2266642003 learned_addr learned my addr 172.21.15.179:0/2266642003 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 -- 172.21.15.179:0/2266642003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 msgr2=0x7fea1c0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 --2- 172.21.15.179:0/2266642003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 0x7fea1c0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 -- 172.21.15.179:0/2266642003 >> v2:172.21.15.190:3300/0 conn(0x7fea1c0ccc90 msgr2=0x7fea1c06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea20811700 1 --2- 172.21.15.179:0/2266642003 >> v2:172.21.15.190:3300/0 conn(0x7fea1c0ccc90 0x7fea1c06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 --2- 172.21.15.179:0/2266642003 >> v2:172.21.15.190:3300/0 conn(0x7fea1c0ccc90 0x7fea1c06af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 -- 172.21.15.179:0/2266642003 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c0cd4a0 con 0x7fea1c06b4b0 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.900+0000 7fea21813700 1 --2- 172.21.15.179:0/2266642003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06b4b0 0x7fea1c1619b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0d1ae0 tx=0x7fea1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f04960f905a565 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.901 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea13fff700 1 -- 172.21.15.179:0/2266642003 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400e070 con 0x7fea1c06b4b0 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea13fff700 1 -- 172.21.15.179:0/2266642003 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400b9c0 con 0x7fea1c06b4b0 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea13fff700 1 -- 172.21.15.179:0/2266642003 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400bd70 con 0x7fea1c06b4b0 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 -- 172.21.15.179:0/2266642003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06b4b0 msgr2=0x7fea1c1619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 --2- 172.21.15.179:0/2266642003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06b4b0 0x7fea1c1619b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0d1ae0 tx=0x7fea1400b330 comp rx=0 tx=0).stop 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 -- 172.21.15.179:0/2266642003 shutdown_connections 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 --2- 172.21.15.179:0/2266642003 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c06b4b0 0x7fea1c1619b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 --2- 172.21.15.179:0/2266642003 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 0x7fea1c0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 --2- 172.21.15.179:0/2266642003 >> v2:172.21.15.190:3300/0 conn(0x7fea1c0ccc90 0x7fea1c06af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 -- 172.21.15.179:0/2266642003 >> 172.21.15.179:0/2266642003 conn(0x7fea1c099a40 msgr2=0x7fea1c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 -- 172.21.15.179:0/2266642003 shutdown_connections 2023-12-07T00:14:53.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.901+0000 7fea23276700 1 -- 172.21.15.179:0/2266642003 wait complete. 2023-12-07T00:14:53.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.903+0000 7fea23276700 1 Processor -- start 2023-12-07T00:14:53.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.903+0000 7fea23276700 1 -- start start 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea23276700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea1c06b4b0 0x7fea1c0af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea23276700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c0ccc90 0x7fea1c0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea23276700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 0x7fea1c15bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea23276700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0c5860 con 0x7fea1c0ccc90 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea23276700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0afa70 con 0x7fea1c06b4b0 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea23276700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c0c5ab0 con 0x7fea1c15de50 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c0ccc90 0x7fea1c0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c0ccc90 0x7fea1c0ae330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40086/0 (socket says 172.21.15.179:40086) 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 -- 172.21.15.179:0/3625753881 learned_addr learned my addr 172.21.15.179:0/3625753881 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea21012700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea1c06b4b0 0x7fea1c0af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 -- 172.21.15.179:0/3625753881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 msgr2=0x7fea1c15bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea21813700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 0x7fea1c15bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 0x7fea1c15bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 -- 172.21.15.179:0/3625753881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea1c06b4b0 msgr2=0x7fea1c0af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:53.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea1c06b4b0 0x7fea1c0af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:53.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 -- 172.21.15.179:0/3625753881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14009b30 con 0x7fea1c0ccc90 2023-12-07T00:14:53.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea20811700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c0ccc90 0x7fea1c0ae330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c7f0 tx=0x7fea0c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea11ffb700 1 -- 172.21.15.179:0/3625753881 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c011800 con 0x7fea1c0ccc90 2023-12-07T00:14:53.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea11ffb700 1 -- 172.21.15.179:0/3625753881 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c011960 con 0x7fea1c0ccc90 2023-12-07T00:14:53.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0c5d90 con 0x7fea1c0ccc90 2023-12-07T00:14:53.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.904+0000 7fea11ffb700 1 -- 172.21.15.179:0/3625753881 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c011cf0 con 0x7fea1c0ccc90 2023-12-07T00:14:53.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.905+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c0ae870 con 0x7fea1c0ccc90 2023-12-07T00:14:53.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.906+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c0c63e0 con 0x7fea1c0ccc90 2023-12-07T00:14:53.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.906+0000 7fea11ffb700 1 -- 172.21.15.179:0/3625753881 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea0c018360 con 0x7fea1c0ccc90 2023-12-07T00:14:53.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.906+0000 7fea11ffb700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea0006aed0 0x7fea0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:53.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.906+0000 7fea11ffb700 1 -- 172.21.15.179:0/3625753881 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea0c0897f0 con 0x7fea1c0ccc90 2023-12-07T00:14:53.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.906+0000 7fea21012700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea0006aed0 0x7fea0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:53.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.907+0000 7fea21012700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea0006aed0 0x7fea0006d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea1800a810 tx=0x7fea18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:53.910 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:53.911+0000 7fea11ffb700 1 -- 172.21.15.179:0/3625753881 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea0c054640 con 0x7fea1c0ccc90 2023-12-07T00:14:54.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.100+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fea1c0685f0 con 0x7fea1c0ccc90 2023-12-07T00:14:54.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.101+0000 7fea11ffb700 1 -- 172.21.15.179:0/3625753881 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fea0c01f020 con 0x7fea1c0ccc90 2023-12-07T00:14:54.100 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:14:54.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea0006aed0 msgr2=0x7fea0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea0006aed0 0x7fea0006d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea1800a810 tx=0x7fea18008040 comp rx=0 tx=0).stop 2023-12-07T00:14:54.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c0ccc90 msgr2=0x7fea1c0ae330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c0ccc90 0x7fea1c0ae330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fea0c00c7f0 tx=0x7fea0c00cbb0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.102 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 shutdown_connections 2023-12-07T00:14:54.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea0006aed0 0x7fea0006d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea1c15de50 0x7fea1c15bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea1c06b4b0 0x7fea1c0af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 --2- 172.21.15.179:0/3625753881 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fea1c0ccc90 0x7fea1c0ae330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 >> 172.21.15.179:0/3625753881 conn(0x7fea1c099a40 msgr2=0x7fea1c099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:54.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 shutdown_connections 2023-12-07T00:14:54.103 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.103+0000 7fea23276700 1 -- 172.21.15.179:0/3625753881 wait complete. 2023-12-07T00:14:54.114 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:14:54.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.238+0000 7f2ed0ba0700 1 Processor -- start 2023-12-07T00:14:54.237 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.238+0000 7f2ed0ba0700 1 -- start start 2023-12-07T00:14:54.240 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2ed0ba0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2ecc06af70 0x7f2ecc06b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.240 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2ed0ba0700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc072fb0 con 0x7f2ecc145d30 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2ed0ba0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc1449b0 con 0x7f2ecc144190 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2ed0ba0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc06b940 con 0x7f2ecc06af70 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2ecbfff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2ecc145d30 0x7f2ecc146160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:46994/0 (socket says 172.21.15.179:46994) 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2ecbfff700 1 -- 172.21.15.179:0/3373376277 learned_addr learned my addr 172.21.15.179:0/3373376277 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2ecaffd700 1 --2- 172.21.15.179:0/3373376277 >> v2:172.21.15.190:3300/0 conn(0x7f2ecc06af70 0x7f2ecc06b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297773117 0 0) 0x7f2ecc072fb0 con 0x7f2ecc145d30 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.239+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb80035b0 con 0x7f2ecc145d30 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1348775838 0 0) 0x7f2eb80035b0 con 0x7f2ecc145d30 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 >> v2:172.21.15.190:3300/0 conn(0x7f2ecc06af70 msgr2=0x7f2ecc06b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 --2- 172.21.15.179:0/3373376277 >> v2:172.21.15.190:3300/0 conn(0x7f2ecc06af70 0x7f2ecc06b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 >> v1:172.21.15.190:6789/0 conn(0x7f2ecc144190 legacy=0x7f2ecc0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc144c90 con 0x7f2ecc145d30 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f2ebc001670 con 0x7f2ecc145d30 2023-12-07T00:14:54.241 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 >> v1:172.21.15.179:6789/0 conn(0x7f2ecc145d30 legacy=0x7f2ecc146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb8003a00 0x7f2eb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb8004850 0x7f2eb8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2eb800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc06b940 con 0x7f2eb8005210 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800c0b0 con 0x7f2eb8003a00 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb800c270 con 0x7f2eb8004850 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecbfff700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2eb800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecb7fe700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb8003a00 0x7f2eb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.242 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecaffd700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb8004850 0x7f2eb8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecbfff700 1 -- 172.21.15.179:0/3373376277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb8004850 msgr2=0x7f2eb8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:54.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecbfff700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2eb8004850 0x7f2eb8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecbfff700 1 -- 172.21.15.179:0/3373376277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb8003a00 msgr2=0x7f2eb8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:54.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecbfff700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2eb8003a00 0x7f2eb8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.243 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecbfff700 1 -- 172.21.15.179:0/3373376277 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80035b0 con 0x7f2eb8005210 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecbfff700 1 -- 172.21.15.179:0/3373376277 reap_dead start 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2ecbfff700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2eb800ba10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00c2a0 tx=0x7f2eb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4ca22e1b281e61 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc007c10 con 0x7f2eb8005210 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc00cdc0 con 0x7f2eb8005210 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.240+0000 7f2eca7fc700 1 -- 172.21.15.179:0/3373376277 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc005ba0 con 0x7f2eb8005210 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.241+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/3373376277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 msgr2=0x7f2eb800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.241+0000 7f2ed0ba0700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2eb800ba10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00c2a0 tx=0x7f2eb8005880 comp rx=0 tx=0).stop 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.241+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/3373376277 shutdown_connections 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.241+0000 7f2ed0ba0700 1 --2- 172.21.15.179:0/3373376277 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2eb800ba10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.241+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/3373376277 >> 172.21.15.179:0/3373376277 conn(0x7f2ecc0b5dd0 msgr2=0x7f2ecc099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.241+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/3373376277 shutdown_connections 2023-12-07T00:14:54.244 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.241+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/3373376277 wait complete. 2023-12-07T00:14:54.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.242+0000 7f2ed0ba0700 1 Processor -- start 2023-12-07T00:14:54.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.242+0000 7f2ed0ba0700 1 -- start start 2023-12-07T00:14:54.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ed0ba0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2ecc15d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ed0ba0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ecc1f3cd0 0x7f2ecc1f4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ed0ba0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ecc13bb70 0x7f2ecc13bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ed0ba0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc13c510 con 0x7f2eb8005210 2023-12-07T00:14:54.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ed0ba0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc13b6e0 con 0x7f2ecc13bb70 2023-12-07T00:14:54.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ed0ba0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc13add0 con 0x7f2ecc1f3cd0 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2ecc15d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2ecc15d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40104/0 (socket says 172.21.15.179:40104) 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecb7fe700 1 -- 172.21.15.179:0/764521600 learned_addr learned my addr 172.21.15.179:0/764521600 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecaffd700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ecc1f3cd0 0x7f2ecc1f4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecbfff700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ecc13bb70 0x7f2ecc13bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecb7fe700 1 -- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ecc1f3cd0 msgr2=0x7f2ecc1f4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecb7fe700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ecc1f3cd0 0x7f2ecc1f4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecb7fe700 1 -- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ecc13bb70 msgr2=0x7f2ecc13bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecb7fe700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ecc13bb70 0x7f2ecc13bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecb7fe700 1 -- 172.21.15.179:0/764521600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc13b090 con 0x7f2eb8005210 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.243+0000 7f2ecaffd700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ecc1f3cd0 0x7f2ecc1f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.244+0000 7f2ecb7fe700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2ecc15d440 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4002090 tx=0x7f2ec400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.244+0000 7f2ec3fff700 1 -- 172.21.15.179:0/764521600 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400dd10 con 0x7f2eb8005210 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.244+0000 7f2ec3fff700 1 -- 172.21.15.179:0/764521600 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec400de70 con 0x7f2eb8005210 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.244+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc13b370 con 0x7f2eb8005210 2023-12-07T00:14:54.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.244+0000 7f2ec3fff700 1 -- 172.21.15.179:0/764521600 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4003c40 con 0x7f2eb8005210 2023-12-07T00:14:54.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.244+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc13ce50 con 0x7f2eb8005210 2023-12-07T00:14:54.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.245+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc13ab40 con 0x7f2eb8005210 2023-12-07T00:14:54.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.245+0000 7f2ec3fff700 1 -- 172.21.15.179:0/764521600 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ec40050d0 con 0x7f2eb8005210 2023-12-07T00:14:54.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.246+0000 7f2ec3fff700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2eac06aed0 0x7f2eac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.246+0000 7f2ec3fff700 1 -- 172.21.15.179:0/764521600 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ec4089cf0 con 0x7f2eb8005210 2023-12-07T00:14:54.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.246+0000 7f2ecaffd700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2eac06aed0 0x7f2eac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.246+0000 7f2ecaffd700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2eac06aed0 0x7f2eac06d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc13c6c0 tx=0x7f2eb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.250+0000 7f2ec3fff700 1 -- 172.21.15.179:0/764521600 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ec408e070 con 0x7f2eb8005210 2023-12-07T00:14:54.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.440+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2ecc04f290 con 0x7f2eb8005210 2023-12-07T00:14:54.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.441+0000 7f2ec3fff700 1 -- 172.21.15.179:0/764521600 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ec4054b40 con 0x7f2eb8005210 2023-12-07T00:14:54.441 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:54.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2eac06aed0 msgr2=0x7f2eac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2eac06aed0 0x7f2eac06d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc13c6c0 tx=0x7f2eb4008040 comp rx=0 tx=0).stop 2023-12-07T00:14:54.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 msgr2=0x7f2ecc15d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2ecc15d440 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4002090 tx=0x7f2ec400d430 comp rx=0 tx=0).stop 2023-12-07T00:14:54.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 shutdown_connections 2023-12-07T00:14:54.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2eac06aed0 0x7f2eac06d390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ecc13bb70 0x7f2ecc13bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2eb8005210 0x7f2ecc15d440 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 --2- 172.21.15.179:0/764521600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ecc1f3cd0 0x7f2ecc1f4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 >> 172.21.15.179:0/764521600 conn(0x7f2ecc0b5dd0 msgr2=0x7f2ecc06f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:54.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 shutdown_connections 2023-12-07T00:14:54.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.443+0000 7f2ed0ba0700 1 -- 172.21.15.179:0/764521600 wait complete. 2023-12-07T00:14:54.458 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:54.581 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.581+0000 7fbae809c700 1 Processor -- start 2023-12-07T00:14:54.581 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.582+0000 7fbae809c700 1 -- start start 2023-12-07T00:14:54.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.582+0000 7fbae809c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbae015e220 0x7fbae00b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.582+0000 7fbae809c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae015f330 con 0x7fbae015de40 2023-12-07T00:14:54.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.582+0000 7fbae809c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae00b2ed0 con 0x7fbae00b2aa0 2023-12-07T00:14:54.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.582+0000 7fbae809c700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbae00d1820 con 0x7fbae015e220 2023-12-07T00:14:54.582 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.582+0000 7fbae5637700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbae015e220 0x7fbae00b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.582+0000 7fbae5e38700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbae015de40 0x7fbae00b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47014/0 (socket says 172.21.15.179:47014) 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae5e38700 1 -- 172.21.15.179:0/3881992460 learned_addr learned my addr 172.21.15.179:0/3881992460 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae5637700 1 -- 172.21.15.179:0/3881992460 >> v1:172.21.15.190:6789/0 conn(0x7fbae00b2aa0 legacy=0x7fbae015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae5637700 1 -- 172.21.15.179:0/3881992460 >> v1:172.21.15.179:6789/0 conn(0x7fbae015de40 legacy=0x7fbae00b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae4e36700 1 -- 172.21.15.179:0/3881992460 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926437586 0 0) 0x7fbae015f330 con 0x7fbae015de40 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae5637700 1 -- 172.21.15.179:0/3881992460 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae015e720 con 0x7fbae015e220 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae5637700 1 --2- 172.21.15.179:0/3881992460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00b2560 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009820 tx=0x7fbadc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc6bf9fc3839cae server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae4e36700 1 -- 172.21.15.179:0/3881992460 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc005e30 con 0x7fbae015e220 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae4e36700 1 -- 172.21.15.179:0/3881992460 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbadc006030 con 0x7fbae015e220 2023-12-07T00:14:54.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.583+0000 7fbae4e36700 1 -- 172.21.15.179:0/3881992460 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0063e0 con 0x7fbae015e220 2023-12-07T00:14:54.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.584+0000 7fbae809c700 1 -- 172.21.15.179:0/3881992460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 msgr2=0x7fbae00b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.584+0000 7fbae809c700 1 --2- 172.21.15.179:0/3881992460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00b2560 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009820 tx=0x7fbadc009b30 comp rx=0 tx=0).stop 2023-12-07T00:14:54.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.584+0000 7fbae809c700 1 -- 172.21.15.179:0/3881992460 shutdown_connections 2023-12-07T00:14:54.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.584+0000 7fbae809c700 1 --2- 172.21.15.179:0/3881992460 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00b2560 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.584+0000 7fbae809c700 1 -- 172.21.15.179:0/3881992460 >> 172.21.15.179:0/3881992460 conn(0x7fbae0072970 msgr2=0x7fbae0072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:54.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.584+0000 7fbae809c700 1 -- 172.21.15.179:0/3881992460 shutdown_connections 2023-12-07T00:14:54.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.584+0000 7fbae809c700 1 -- 172.21.15.179:0/3881992460 wait complete. 2023-12-07T00:14:54.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.585+0000 7fbae809c700 1 Processor -- start 2023-12-07T00:14:54.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.585+0000 7fbae809c700 1 -- start start 2023-12-07T00:14:54.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae809c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbae00b2aa0 0x7fbae00cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae809c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbae015de40 0x7fbae014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.588 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae809c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae809c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae0152e00 con 0x7fbae015e220 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae809c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae014f9d0 con 0x7fbae00b2aa0 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae809c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae00cb160 con 0x7fbae015de40 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40122/0 (socket says 172.21.15.179:40122) 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 -- 172.21.15.179:0/397995506 learned_addr learned my addr 172.21.15.179:0/397995506 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae5e38700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbae00b2aa0 0x7fbae00cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae5637700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbae015de40 0x7fbae014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 -- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbae015de40 msgr2=0x7fbae014f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbae015de40 0x7fbae014f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 -- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbae00b2aa0 msgr2=0x7fbae00cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbae00b2aa0 0x7fbae00cc200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 -- 172.21.15.179:0/397995506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc009430 con 0x7fbae015e220 2023-12-07T00:14:54.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae5637700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbae015de40 0x7fbae014f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae6639700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00aba00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbad800cc50 tx=0x7fbad800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbad27fc700 1 -- 172.21.15.179:0/397995506 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad8003c00 con 0x7fbae015e220 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbad27fc700 1 -- 172.21.15.179:0/397995506 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad8003d60 con 0x7fbae015e220 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbad27fc700 1 -- 172.21.15.179:0/397995506 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad800ab60 con 0x7fbae015e220 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae00cb440 con 0x7fbae015e220 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.586+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae00cba00 con 0x7fbae015e220 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.587+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae004f290 con 0x7fbae015e220 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.588+0000 7fbad27fc700 1 -- 172.21.15.179:0/397995506 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbad800acc0 con 0x7fbae015e220 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.588+0000 7fbad27fc700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbac406aed0 0x7fbac406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.588+0000 7fbae5e38700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbac406aed0 0x7fbac406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.588+0000 7fbad27fc700 1 -- 172.21.15.179:0/397995506 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbad8089930 con 0x7fbae015e220 2023-12-07T00:14:54.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.589+0000 7fbae5e38700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbac406aed0 0x7fbac406d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbad4007b10 tx=0x7fbad4007a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.592 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.593+0000 7fbad27fc700 1 -- 172.21.15.179:0/397995506 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbad80546f0 con 0x7fbae015e220 2023-12-07T00:14:54.793 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.794+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbae00685f0 con 0x7fbae015e220 2023-12-07T00:14:54.794 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.795+0000 7fbad27fc700 1 -- 172.21.15.179:0/397995506 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18749 (secure 0 0 0) 0x7fbad8057d10 con 0x7fbae015e220 2023-12-07T00:14:54.795 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:54.795 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":28,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:54.612197+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbac406aed0 msgr2=0x7fbac406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbac406aed0 0x7fbac406d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbad4007b10 tx=0x7fbad4007a60 comp rx=0 tx=0).stop 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 msgr2=0x7fbae00aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00aba00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbad800cc50 tx=0x7fbad800cf60 comp rx=0 tx=0).stop 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 shutdown_connections 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbac406aed0 0x7fbac406d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbae015e220 0x7fbae00aba00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbae00b2aa0 0x7fbae00cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 --2- 172.21.15.179:0/397995506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbae015de40 0x7fbae014f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.797+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 >> 172.21.15.179:0/397995506 conn(0x7fbae0072970 msgr2=0x7fbae01606c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.798+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 shutdown_connections 2023-12-07T00:14:54.797 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.798+0000 7fbae809c700 1 -- 172.21.15.179:0/397995506 wait complete. 2023-12-07T00:14:54.809 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:54.810 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:54.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.937+0000 7f31694db700 1 Processor -- start 2023-12-07T00:14:54.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.937+0000 7f31694db700 1 -- start start 2023-12-07T00:14:54.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31694db700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f316415da80 0x7f31640b9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31694db700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31640d1c00 0x7f31640ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31694db700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31640b74d0 con 0x7f316415de60 2023-12-07T00:14:54.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31694db700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31640b77b0 con 0x7f31640d1c00 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31694db700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31640b7a90 con 0x7f316415da80 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31637fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31640d1c00 0x7f31640ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31637fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f31640d1c00 0x7f31640ce890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40128/0 (socket says 172.21.15.179:40128) 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31637fe700 1 -- 172.21.15.179:0/702528542 learned_addr learned my addr 172.21.15.179:0/702528542 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f3162ffd700 1 --2- 172.21.15.179:0/702528542 >> v2:172.21.15.190:3300/0 conn(0x7f316415da80 0x7f31640b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31637fe700 1 -- 172.21.15.179:0/702528542 >> v2:172.21.15.190:3300/0 conn(0x7f316415da80 msgr2=0x7f31640b9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31637fe700 1 --2- 172.21.15.179:0/702528542 >> v2:172.21.15.190:3300/0 conn(0x7f316415da80 0x7f31640b9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31637fe700 1 -- 172.21.15.179:0/702528542 >> v1:172.21.15.190:6789/0 conn(0x7f316415de60 legacy=0x7f31640b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31637fe700 1 -- 172.21.15.179:0/702528542 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31640b7d70 con 0x7f31640d1c00 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.938+0000 7f31637fe700 1 --2- 172.21.15.179:0/702528542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31640d1c00 0x7f31640ce890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f316406bfe0 tx=0x7f315c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f98edfba3fe89f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f3161ffb700 1 -- 172.21.15.179:0/702528542 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00e070 con 0x7f31640d1c00 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f3161ffb700 1 -- 172.21.15.179:0/702528542 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c003a20 con 0x7f31640d1c00 2023-12-07T00:14:54.946 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f3161ffb700 1 -- 172.21.15.179:0/702528542 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c003dd0 con 0x7f31640d1c00 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f31694db700 1 -- 172.21.15.179:0/702528542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31640d1c00 msgr2=0x7f31640ce890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f31694db700 1 --2- 172.21.15.179:0/702528542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31640d1c00 0x7f31640ce890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f316406bfe0 tx=0x7f315c00b330 comp rx=0 tx=0).stop 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f31694db700 1 -- 172.21.15.179:0/702528542 shutdown_connections 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f31694db700 1 --2- 172.21.15.179:0/702528542 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f31640d1c00 0x7f31640ce890 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f31694db700 1 --2- 172.21.15.179:0/702528542 >> v2:172.21.15.190:3300/0 conn(0x7f316415da80 0x7f31640b9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f31694db700 1 -- 172.21.15.179:0/702528542 >> 172.21.15.179:0/702528542 conn(0x7f3164072ac0 msgr2=0x7f3164072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f31694db700 1 -- 172.21.15.179:0/702528542 shutdown_connections 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.939+0000 7f31694db700 1 -- 172.21.15.179:0/702528542 wait complete. 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31694db700 1 Processor -- start 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31694db700 1 -- start start 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31694db700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31640d1c00 0x7f3164152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31694db700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f316415da80 0x7f31640cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31694db700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316415de60 0x7f31640cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31694db700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31640cc430 con 0x7f316415de60 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31694db700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31640ca270 con 0x7f316415da80 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31694db700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31640cb800 con 0x7f31640d1c00 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31637fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316415de60 0x7f31640cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31637fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316415de60 0x7f31640cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40134/0 (socket says 172.21.15.179:40134) 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.941+0000 7f31637fe700 1 -- 172.21.15.179:0/1660141684 learned_addr learned my addr 172.21.15.179:0/1660141684 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31627fc700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f316415da80 0x7f31640cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f3162ffd700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31640d1c00 0x7f3164152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31637fe700 1 -- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31640d1c00 msgr2=0x7f3164152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31637fe700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31640d1c00 0x7f3164152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31637fe700 1 -- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f316415da80 msgr2=0x7f31640cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31637fe700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f316415da80 0x7f31640cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:54.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31637fe700 1 -- 172.21.15.179:0/1660141684 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c009b30 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f3162ffd700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31640d1c00 0x7f3164152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31637fe700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316415de60 0x7f31640cb1d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f315c009fd0 tx=0x7f315c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f314b7fe700 1 -- 172.21.15.179:0/1660141684 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c004440 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f314b7fe700 1 -- 172.21.15.179:0/1660141684 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c0045a0 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31640cbae0 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f314b7fe700 1 -- 172.21.15.179:0/1660141684 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c004910 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.942+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3164152580 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.943+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3164067ee0 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.943+0000 7f314b7fe700 1 -- 172.21.15.179:0/1660141684 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f315c012430 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.944+0000 7f314b7fe700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f315006aed0 0x7f315006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.944+0000 7f314b7fe700 1 -- 172.21.15.179:0/1660141684 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f315c08aef0 con 0x7f316415de60 2023-12-07T00:14:54.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.944+0000 7f3162ffd700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f315006aed0 0x7f315006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:54.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.944+0000 7f3162ffd700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f315006aed0 0x7f315006d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f31640d4a30 tx=0x7f3158008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:54.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:54.948+0000 7f314b7fe700 1 -- 172.21.15.179:0/1660141684 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f315c055b40 con 0x7f316415de60 2023-12-07T00:14:55.137 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.137+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3164073d50 con 0x7f316415de60 2023-12-07T00:14:55.137 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.138+0000 7f314b7fe700 1 -- 172.21.15.179:0/1660141684 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f315c059160 con 0x7f316415de60 2023-12-07T00:14:55.137 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:55.139 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f315006aed0 msgr2=0x7f315006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.139 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f315006aed0 0x7f315006d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f31640d4a30 tx=0x7f3158008040 comp rx=0 tx=0).stop 2023-12-07T00:14:55.139 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316415de60 msgr2=0x7f31640cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.139 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316415de60 0x7f31640cb1d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f315c009fd0 tx=0x7f315c004ad0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.139 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 shutdown_connections 2023-12-07T00:14:55.139 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f315006aed0 0x7f315006d390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.139 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f316415de60 0x7f31640cb1d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.139 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f31640d1c00 0x7f3164152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 --2- 172.21.15.179:0/1660141684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f316415da80 0x7f31640cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 >> 172.21.15.179:0/1660141684 conn(0x7f3164072ac0 msgr2=0x7f31640ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:55.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 shutdown_connections 2023-12-07T00:14:55.140 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.140+0000 7f31694db700 1 -- 172.21.15.179:0/1660141684 wait complete. 2023-12-07T00:14:55.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:14:55.274 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.275+0000 7fc0bcb70700 1 Processor -- start 2023-12-07T00:14:55.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.275+0000 7fc0bcb70700 1 -- start start 2023-12-07T00:14:55.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0bcb70700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0b806b680 0x7fc0b80cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0bcb70700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc0b8161c70 0x7fc0b8162100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.279 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0bcb70700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b80cb0f0 con 0x7fc0b8161360 2023-12-07T00:14:55.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0bcb70700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b8161740 con 0x7fc0b8161c70 2023-12-07T00:14:55.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0bcb70700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b80cb340 con 0x7fc0b806b680 2023-12-07T00:14:55.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0b659c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc0b8161360 0x7fc0b806af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47040/0 (socket says 172.21.15.179:47040) 2023-12-07T00:14:55.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0b659c700 1 -- 172.21.15.179:0/4103545412 learned_addr learned my addr 172.21.15.179:0/4103545412 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:55.281 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511104445 0 0) 0x7fc0b80cb0f0 con 0x7fc0b8161360 2023-12-07T00:14:55.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a00035b0 con 0x7fc0b8161360 2023-12-07T00:14:55.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0b5d9b700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0b806b680 0x7fc0b80cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.276+0000 7fc0b6d9d700 1 --2- 172.21.15.179:0/4103545412 >> v2:172.21.15.190:3300/0 conn(0x7fc0b8161c70 0x7fc0b8162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.282 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1851127188 0 0) 0x7fc0a00035b0 con 0x7fc0b8161360 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0b806b680 msgr2=0x7fc0b80cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0b806b680 0x7fc0b80cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 >> v2:172.21.15.190:3300/0 conn(0x7fc0b8161c70 msgr2=0x7fc0b8162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 --2- 172.21.15.179:0/4103545412 >> v2:172.21.15.190:3300/0 conn(0x7fc0b8161c70 0x7fc0b8162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b80cb620 con 0x7fc0b8161360 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fc0ac001670 con 0x7fc0b8161360 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 >> v1:172.21.15.179:6789/0 conn(0x7fc0b8161360 legacy=0x7fc0b806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0a0003a00 0x7fc0a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a0004850 0x7fc0a0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0b806b680 0x7fc0a0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.283 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b8161740 con 0x7fc0a0004850 2023-12-07T00:14:55.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b80cb340 con 0x7fc0a0003a00 2023-12-07T00:14:55.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a000ba90 con 0x7fc0b806b680 2023-12-07T00:14:55.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b5d9b700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a0004850 0x7fc0a0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b659c700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0a0003a00 0x7fc0a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b6d9d700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0b806b680 0x7fc0a0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.284 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b5d9b700 1 -- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0b806b680 msgr2=0x7fc0a0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b5d9b700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0b806b680 0x7fc0a0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b5d9b700 1 -- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0a0003a00 msgr2=0x7fc0a0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b5d9b700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0a0003a00 0x7fc0a0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b5d9b700 1 -- 172.21.15.179:0/4103545412 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00035b0 con 0x7fc0a0004850 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b5d9b700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a0004850 0x7fc0a0004cd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009b60 tx=0x7fc0a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a926119d602257d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800e6c0 con 0x7fc0a0004850 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a800e820 con 0x7fc0a0004850 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.277+0000 7fc0b559a700 1 -- 172.21.15.179:0/4103545412 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800eb90 con 0x7fc0a0004850 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.278+0000 7fc0bcb70700 1 -- 172.21.15.179:0/4103545412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a0004850 msgr2=0x7fc0a0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.278+0000 7fc0bcb70700 1 --2- 172.21.15.179:0/4103545412 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0a0004850 0x7fc0a0004cd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc0a8009b60 tx=0x7fc0a0005880 comp rx=0 tx=0).stop 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.278+0000 7fc0b6d9d700 1 -- 172.21.15.179:0/4103545412 reap_dead start 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.278+0000 7fc0bcb70700 1 -- 172.21.15.179:0/4103545412 shutdown_connections 2023-12-07T00:14:55.285 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.278+0000 7fc0bcb70700 1 -- 172.21.15.179:0/4103545412 >> 172.21.15.179:0/4103545412 conn(0x7fc0b8099a40 msgr2=0x7fc0b8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:55.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.278+0000 7fc0bcb70700 1 -- 172.21.15.179:0/4103545412 shutdown_connections 2023-12-07T00:14:55.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.278+0000 7fc0bcb70700 1 -- 172.21.15.179:0/4103545412 wait complete. 2023-12-07T00:14:55.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.279+0000 7fc0bcb70700 1 Processor -- start 2023-12-07T00:14:55.286 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.279+0000 7fc0bcb70700 1 -- start start 2023-12-07T00:14:55.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0bcb70700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0a0004850 0x7fc0b8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.288 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0bcb70700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0b80b42d0 0x7fc0b815d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0bcb70700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0b80b4750 0x7fc0b815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0bcb70700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b8154990 con 0x7fc0b80b42d0 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0bcb70700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b80b4ce0 con 0x7fc0b80b4750 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0bcb70700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b80b4fc0 con 0x7fc0a0004850 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0b5d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0b80b42d0 0x7fc0b815d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0b5d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0b80b42d0 0x7fc0b815d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40152/0 (socket says 172.21.15.179:40152) 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.280+0000 7fc0b5d9b700 1 -- 172.21.15.179:0/1331777344 learned_addr learned my addr 172.21.15.179:0/1331777344 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0b5d9b700 1 -- 172.21.15.179:0/1331777344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0a0004850 msgr2=0x7fc0b8154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0b659c700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0a0004850 0x7fc0b8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0b5d9b700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0a0004850 0x7fc0b8154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0b6d9d700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0b80b4750 0x7fc0b815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0b5d9b700 1 -- 172.21.15.179:0/1331777344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0b80b4750 msgr2=0x7fc0b815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0b5d9b700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0b80b4750 0x7fc0b815de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.289 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0b5d9b700 1 -- 172.21.15.179:0/1331777344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b80b52a0 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0b5d9b700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0b80b42d0 0x7fc0b815d900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005830 tx=0x7fc0a80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0a6ffd700 1 -- 172.21.15.179:0/1331777344 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a8021070 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0a6ffd700 1 -- 172.21.15.179:0/1331777344 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a80045d0 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0a6ffd700 1 -- 172.21.15.179:0/1331777344 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a800e6c0 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b80b5580 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.281+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b80b1ad0 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.282+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b80685f0 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.282+0000 7fc0a6ffd700 1 -- 172.21.15.179:0/1331777344 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0a8025070 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.283+0000 7fc0a6ffd700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc09806aed0 0x7fc09806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.283+0000 7fc0a6ffd700 1 -- 172.21.15.179:0/1331777344 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc0a808aa00 con 0x7fc0b80b42d0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.283+0000 7fc0b659c700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc09806aed0 0x7fc09806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.283+0000 7fc0b659c700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc09806aed0 0x7fc09806d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac007fa0 tx=0x7fc0ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.287+0000 7fc0a6ffd700 1 -- 172.21.15.179:0/1331777344 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0a80558a0 con 0x7fc0b80b42d0 2023-12-07T00:14:55.477 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.477+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0b80b6a20 con 0x7fc0b80b42d0 2023-12-07T00:14:55.477 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.478+0000 7fc0a6ffd700 1 -- 172.21.15.179:0/1331777344 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0a8058ec0 con 0x7fc0b80b42d0 2023-12-07T00:14:55.477 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:55.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc09806aed0 msgr2=0x7fc09806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc09806aed0 0x7fc09806d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac007fa0 tx=0x7fc0ac009040 comp rx=0 tx=0).stop 2023-12-07T00:14:55.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0b80b42d0 msgr2=0x7fc0b815d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0b80b42d0 0x7fc0b815d900 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0005830 tx=0x7fc0a80047c0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 shutdown_connections 2023-12-07T00:14:55.479 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc09806aed0 0x7fc09806d390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0b80b4750 0x7fc0b815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc0a0004850 0x7fc0b8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 --2- 172.21.15.179:0/1331777344 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0b80b42d0 0x7fc0b815d900 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 >> 172.21.15.179:0/1331777344 conn(0x7fc0b8099a40 msgr2=0x7fc0b80b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:55.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 shutdown_connections 2023-12-07T00:14:55.480 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.480+0000 7fc0bcb70700 1 -- 172.21.15.179:0/1331777344 wait complete. 2023-12-07T00:14:55.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:14:55.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.615+0000 7fd0f06d9700 1 Processor -- start 2023-12-07T00:14:55.615 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.615+0000 7fd0f06d9700 1 -- start start 2023-12-07T00:14:55.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.616+0000 7fd0f06d9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd0e815e1c0 0x7fd0e80af380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.616 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0f06d9700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e80afc40 con 0x7fd0e80c57f0 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0f06d9700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e80ad2f0 con 0x7fd0e806e350 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0f06d9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80ad5d0 con 0x7fd0e815e1c0 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0eec76700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd0e80c57f0 0x7fd0e80ae0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47064/0 (socket says 172.21.15.179:47064) 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0eec76700 1 -- 172.21.15.179:0/1064326398 learned_addr learned my addr 172.21.15.179:0/1064326398 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0ee475700 1 --2- 172.21.15.179:0/1064326398 >> v2:172.21.15.190:3300/0 conn(0x7fd0e815e1c0 0x7fd0e80af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0ee475700 1 -- 172.21.15.179:0/1064326398 >> v1:172.21.15.190:6789/0 conn(0x7fd0e806e350 legacy=0x7fd0e80c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0ee475700 1 -- 172.21.15.179:0/1064326398 >> v1:172.21.15.179:6789/0 conn(0x7fd0e80c57f0 legacy=0x7fd0e80ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0ee475700 1 -- 172.21.15.179:0/1064326398 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e80ad8b0 con 0x7fd0e815e1c0 2023-12-07T00:14:55.617 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.617+0000 7fd0ee475700 1 --2- 172.21.15.179:0/1064326398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 0x7fd0e80af380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009840 tx=0x7fd0e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=271b4aea453a110d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.621+0000 7fd0ed473700 1 -- 172.21.15.179:0/1064326398 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4011830 con 0x7fd0e815e1c0 2023-12-07T00:14:55.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.621+0000 7fd0ed473700 1 -- 172.21.15.179:0/1064326398 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e4011990 con 0x7fd0e815e1c0 2023-12-07T00:14:55.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.621+0000 7fd0ed473700 1 -- 172.21.15.179:0/1064326398 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4011d20 con 0x7fd0e815e1c0 2023-12-07T00:14:55.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.622+0000 7fd0f06d9700 1 -- 172.21.15.179:0/1064326398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 msgr2=0x7fd0e80af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.622+0000 7fd0f06d9700 1 --2- 172.21.15.179:0/1064326398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 0x7fd0e80af380 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009840 tx=0x7fd0e4009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:55.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.622+0000 7fd0f06d9700 1 -- 172.21.15.179:0/1064326398 shutdown_connections 2023-12-07T00:14:55.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.622+0000 7fd0f06d9700 1 --2- 172.21.15.179:0/1064326398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 0x7fd0e80af380 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.622+0000 7fd0f06d9700 1 -- 172.21.15.179:0/1064326398 >> 172.21.15.179:0/1064326398 conn(0x7fd0e80b3270 msgr2=0x7fd0e80b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:55.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.622+0000 7fd0f06d9700 1 -- 172.21.15.179:0/1064326398 shutdown_connections 2023-12-07T00:14:55.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.623+0000 7fd0f06d9700 1 -- 172.21.15.179:0/1064326398 wait complete. 2023-12-07T00:14:55.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.624+0000 7fd0f06d9700 1 Processor -- start 2023-12-07T00:14:55.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.624+0000 7fd0f06d9700 1 -- start start 2023-12-07T00:14:55.624 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0f06d9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e806e350 0x7fd0e80b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0f06d9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80c57f0 0x7fd0e80b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0f06d9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 0x7fd0e8153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0f06d9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e8154360 con 0x7fd0e806e350 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0f06d9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80b14c0 con 0x7fd0e815e1c0 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0f06d9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80b17a0 con 0x7fd0e80c57f0 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e806e350 0x7fd0e80b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e806e350 0x7fd0e80b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40164/0 (socket says 172.21.15.179:40164) 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 -- 172.21.15.179:0/173991862 learned_addr learned my addr 172.21.15.179:0/173991862 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0edc74700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80c57f0 0x7fd0e80b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0eec76700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 0x7fd0e8153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 -- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80c57f0 msgr2=0x7fd0e80b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80c57f0 0x7fd0e80b0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 -- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 msgr2=0x7fd0e8153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.625 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 0x7fd0e8153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 -- 172.21.15.179:0/173991862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e40094a0 con 0x7fd0e806e350 2023-12-07T00:14:55.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0eec76700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 0x7fd0e8153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:55.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.625+0000 7fd0ee475700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e806e350 0x7fd0e80b2560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4000c00 tx=0x7fd0e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.631+0000 7fd0deffd700 1 -- 172.21.15.179:0/173991862 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40038a0 con 0x7fd0e806e350 2023-12-07T00:14:55.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.631+0000 7fd0deffd700 1 -- 172.21.15.179:0/173991862 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e401e070 con 0x7fd0e806e350 2023-12-07T00:14:55.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.631+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e815e720 con 0x7fd0e806e350 2023-12-07T00:14:55.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.631+0000 7fd0deffd700 1 -- 172.21.15.179:0/173991862 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4003c60 con 0x7fd0e806e350 2023-12-07T00:14:55.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.631+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e80b1d60 con 0x7fd0e806e350 2023-12-07T00:14:55.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.632+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e80b23b0 con 0x7fd0e806e350 2023-12-07T00:14:55.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.632+0000 7fd0deffd700 1 -- 172.21.15.179:0/173991862 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0e402d450 con 0x7fd0e806e350 2023-12-07T00:14:55.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.633+0000 7fd0deffd700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.633+0000 7fd0deffd700 1 -- 172.21.15.179:0/173991862 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0e408aa10 con 0x7fd0e806e350 2023-12-07T00:14:55.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.633+0000 7fd0edc74700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.633+0000 7fd0edc74700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80b46e0 tx=0x7fd0d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.638+0000 7fd0deffd700 1 -- 172.21.15.179:0/173991862 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0e4055790 con 0x7fd0e806e350 2023-12-07T00:14:55.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.831+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0e80c5610 con 0x7fd0e806e350 2023-12-07T00:14:55.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.832+0000 7fd0deffd700 1 -- 172.21.15.179:0/173991862 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0e4058db0 con 0x7fd0e806e350 2023-12-07T00:14:55.831 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:14:55.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 msgr2=0x7fd0cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80b46e0 tx=0x7fd0d8009040 comp rx=0 tx=0).stop 2023-12-07T00:14:55.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e806e350 msgr2=0x7fd0e80b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e806e350 0x7fd0e80b2560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4000c00 tx=0x7fd0e4004750 comp rx=0 tx=0).stop 2023-12-07T00:14:55.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 shutdown_connections 2023-12-07T00:14:55.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd0cc06aed0 0x7fd0cc06d390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd0e815e1c0 0x7fd0e8153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0e806e350 0x7fd0e80b2560 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 --2- 172.21.15.179:0/173991862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd0e80c57f0 0x7fd0e80b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 >> 172.21.15.179:0/173991862 conn(0x7fd0e80b3270 msgr2=0x7fd0e806e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:55.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 shutdown_connections 2023-12-07T00:14:55.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.834+0000 7fd0f06d9700 1 -- 172.21.15.179:0/173991862 wait complete. 2023-12-07T00:14:55.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:14:55.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.969+0000 7f4c7751e700 1 Processor -- start 2023-12-07T00:14:55.968 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.969+0000 7f4c7751e700 1 -- start start 2023-12-07T00:14:55.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c7751e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c7006b680 0x7f4c700cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c7751e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c700cb0f0 con 0x7f4c70161c70 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c7751e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c701627a0 con 0x7f4c70161360 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c7751e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c70161740 con 0x7f4c7006b680 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c74ab9700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4c7006b680 0x7f4c700cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c75abb700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4c70161c70 0x7f4c70162090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47078/0 (socket says 172.21.15.179:47078) 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c75abb700 1 -- 172.21.15.179:0/747531095 learned_addr learned my addr 172.21.15.179:0/747531095 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c74ab9700 1 -- 172.21.15.179:0/747531095 >> v1:172.21.15.190:6789/0 conn(0x7f4c70161360 legacy=0x7f4c7006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c74ab9700 1 -- 172.21.15.179:0/747531095 >> v1:172.21.15.179:6789/0 conn(0x7f4c70161c70 legacy=0x7f4c70162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c74ab9700 1 -- 172.21.15.179:0/747531095 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c700cb340 con 0x7f4c7006b680 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c67fff700 1 -- 172.21.15.179:0/747531095 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943172406 0 0) 0x7f4c700cb0f0 con 0x7f4c70161c70 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c74ab9700 1 --2- 172.21.15.179:0/747531095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c7006b680 0x7f4c700cc100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009840 tx=0x7f4c60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e6d75182ec58d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c67fff700 1 -- 172.21.15.179:0/747531095 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60004230 con 0x7f4c7006b680 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.970+0000 7f4c67fff700 1 -- 172.21.15.179:0/747531095 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c60004390 con 0x7f4c7006b680 2023-12-07T00:14:55.970 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.971+0000 7f4c67fff700 1 -- 172.21.15.179:0/747531095 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c600036a0 con 0x7f4c7006b680 2023-12-07T00:14:55.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.971+0000 7f4c7751e700 1 -- 172.21.15.179:0/747531095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c7006b680 msgr2=0x7f4c700cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.971+0000 7f4c7751e700 1 --2- 172.21.15.179:0/747531095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c7006b680 0x7f4c700cc100 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c60009840 tx=0x7f4c60009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:55.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.971+0000 7f4c7751e700 1 -- 172.21.15.179:0/747531095 shutdown_connections 2023-12-07T00:14:55.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.971+0000 7f4c7751e700 1 --2- 172.21.15.179:0/747531095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c7006b680 0x7f4c700cc100 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.971+0000 7f4c7751e700 1 -- 172.21.15.179:0/747531095 >> 172.21.15.179:0/747531095 conn(0x7f4c70099a40 msgr2=0x7f4c70099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:55.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.971+0000 7f4c7751e700 1 -- 172.21.15.179:0/747531095 shutdown_connections 2023-12-07T00:14:55.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.971+0000 7f4c7751e700 1 -- 172.21.15.179:0/747531095 wait complete. 2023-12-07T00:14:55.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.972+0000 7f4c7751e700 1 Processor -- start 2023-12-07T00:14:55.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.972+0000 7f4c7751e700 1 -- start start 2023-12-07T00:14:55.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c7751e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c7006b680 0x7f4c700ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c7751e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c70161360 0x7f4c7015f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c7751e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c70161c70 0x7f4c7015fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c7751e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700afe30 con 0x7f4c70161360 2023-12-07T00:14:55.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c7751e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700af1b0 con 0x7f4c70161c70 2023-12-07T00:14:55.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c7751e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700af490 con 0x7f4c7006b680 2023-12-07T00:14:55.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c74ab9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c70161360 0x7f4c7015f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.974 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c74ab9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c70161360 0x7f4c7015f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40180/0 (socket says 172.21.15.179:40180) 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c74ab9700 1 -- 172.21.15.179:0/2336103779 learned_addr learned my addr 172.21.15.179:0/2336103779 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c74ab9700 1 -- 172.21.15.179:0/2336103779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c7006b680 msgr2=0x7f4c700ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c75abb700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c70161c70 0x7f4c7015fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c752ba700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c7006b680 0x7f4c700ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c74ab9700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c7006b680 0x7f4c700ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c74ab9700 1 -- 172.21.15.179:0/2336103779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c70161c70 msgr2=0x7f4c7015fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c74ab9700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c70161c70 0x7f4c7015fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.973+0000 7f4c74ab9700 1 -- 172.21.15.179:0/2336103779 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600094a0 con 0x7f4c70161360 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.974+0000 7f4c74ab9700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c70161360 0x7f4c7015f9a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c600090b0 tx=0x7f4c60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.974+0000 7f4c65ffb700 1 -- 172.21.15.179:0/2336103779 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60011830 con 0x7f4c70161360 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.974+0000 7f4c65ffb700 1 -- 172.21.15.179:0/2336103779 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6001e070 con 0x7f4c70161360 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.974+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c700af770 con 0x7f4c70161360 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.974+0000 7f4c65ffb700 1 -- 172.21.15.179:0/2336103779 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60011bb0 con 0x7f4c70161360 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.974+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c700ad9d0 con 0x7f4c70161360 2023-12-07T00:14:55.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.975+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c700aff70 con 0x7f4c70161360 2023-12-07T00:14:55.976 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.975+0000 7f4c65ffb700 1 -- 172.21.15.179:0/2336103779 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c60011d10 con 0x7f4c70161360 2023-12-07T00:14:55.977 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.976+0000 7f4c65ffb700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c5406aed0 0x7f4c5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:55.977 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.976+0000 7f4c65ffb700 1 -- 172.21.15.179:0/2336103779 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4c6008aca0 con 0x7f4c70161360 2023-12-07T00:14:55.977 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.976+0000 7f4c752ba700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c5406aed0 0x7f4c5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:55.977 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.976+0000 7f4c752ba700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c5406aed0 0x7f4c5406d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c003e60 tx=0x7f4c6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:55.979 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:55.980+0000 7f4c65ffb700 1 -- 172.21.15.179:0/2336103779 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c700aff70 con 0x7f4c70161360 2023-12-07T00:14:56.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.174+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4c700aff70 con 0x7f4c70161360 2023-12-07T00:14:56.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.174+0000 7f4c65ffb700 1 -- 172.21.15.179:0/2336103779 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4c700aff70 con 0x7f4c70161360 2023-12-07T00:14:56.173 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c5406aed0 msgr2=0x7f4c5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c5406aed0 0x7f4c5406d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c003e60 tx=0x7f4c6c009040 comp rx=0 tx=0).stop 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c70161360 msgr2=0x7f4c7015f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c70161360 0x7f4c7015f9a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c600090b0 tx=0x7f4c60004750 comp rx=0 tx=0).stop 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 shutdown_connections 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c5406aed0 0x7f4c5406d390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c70161c70 0x7f4c7015fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c7006b680 0x7f4c700ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 --2- 172.21.15.179:0/2336103779 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c70161360 0x7f4c7015f9a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 >> 172.21.15.179:0/2336103779 conn(0x7f4c70099a40 msgr2=0x7f4c70099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.176+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 shutdown_connections 2023-12-07T00:14:56.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.177+0000 7f4c7751e700 1 -- 172.21.15.179:0/2336103779 wait complete. 2023-12-07T00:14:56.188 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:56.318 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.310+0000 7f4ab5353700 1 Processor -- start 2023-12-07T00:14:56.318 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.310+0000 7f4ab5353700 1 -- start start 2023-12-07T00:14:56.318 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4ab5353700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4ab015bde0 0x7f4ab00d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.318 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4ab5353700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab009ab50 con 0x7f4ab009a310 2023-12-07T00:14:56.318 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4ab5353700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab00cf630 con 0x7f4ab00cd020 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4ab5353700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab00cf8f0 con 0x7f4ab015bde0 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4aaf7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4ab009a310 0x7f4ab00b1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47090/0 (socket says 172.21.15.179:47090) 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4aaf7fe700 1 -- 172.21.15.179:0/811990073 learned_addr learned my addr 172.21.15.179:0/811990073 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4aaeffd700 1 --2- 172.21.15.179:0/811990073 >> v2:172.21.15.190:3300/0 conn(0x7f4ab015bde0 0x7f4ab00d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753886960 0 0) 0x7f4ab009ab50 con 0x7f4ab009a310 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.311+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a980035b0 con 0x7f4ab009a310 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2955554700 0 0) 0x7f4a980035b0 con 0x7f4ab009a310 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 >> v2:172.21.15.190:3300/0 conn(0x7f4ab015bde0 msgr2=0x7f4ab00d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 --2- 172.21.15.179:0/811990073 >> v2:172.21.15.190:3300/0 conn(0x7f4ab015bde0 0x7f4ab00d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 >> v1:172.21.15.190:6789/0 conn(0x7f4ab00cd020 legacy=0x7f4ab0099c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00cfbd0 con 0x7f4ab009a310 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f4aa80019f0 con 0x7f4ab009a310 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 >> v1:172.21.15.179:6789/0 conn(0x7f4ab009a310 legacy=0x7f4ab00b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4a98003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98004850 0x7f4a98004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98005210 0x7f4a9800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00cf8f0 con 0x7f4a98003a00 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9800c0b0 con 0x7f4a98004850 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9800c270 con 0x7f4a98005210 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaeffd700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4a98003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aae7fc700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98004850 0x7f4a98004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaf7fe700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98005210 0x7f4a9800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaeffd700 1 -- 172.21.15.179:0/811990073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98005210 msgr2=0x7f4a9800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaeffd700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4a98005210 0x7f4a9800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaeffd700 1 -- 172.21.15.179:0/811990073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98004850 msgr2=0x7f4a98004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaeffd700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4a98004850 0x7f4a98004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaf7fe700 1 -- 172.21.15.179:0/811990073 reap_dead start 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaeffd700 1 -- 172.21.15.179:0/811990073 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980035b0 con 0x7f4a98003a00 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aaeffd700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4a98003e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009b60 tx=0x7f4a98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca05e5396a30ef5 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400e6c0 con 0x7f4a98003a00 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400e820 con 0x7f4a98003a00 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.312+0000 7f4aadffb700 1 -- 172.21.15.179:0/811990073 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400ebb0 con 0x7f4a98003a00 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.313+0000 7f4ab5353700 1 -- 172.21.15.179:0/811990073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 msgr2=0x7f4a98003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.313+0000 7f4ab5353700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4a98003e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4009b60 tx=0x7f4a98005880 comp rx=0 tx=0).stop 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.313+0000 7f4ab5353700 1 -- 172.21.15.179:0/811990073 shutdown_connections 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.313+0000 7f4ab5353700 1 --2- 172.21.15.179:0/811990073 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4a98003e20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.313+0000 7f4ab5353700 1 -- 172.21.15.179:0/811990073 >> 172.21.15.179:0/811990073 conn(0x7f4ab00b3550 msgr2=0x7f4ab00b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.313+0000 7f4ab5353700 1 -- 172.21.15.179:0/811990073 shutdown_connections 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.313+0000 7f4ab5353700 1 -- 172.21.15.179:0/811990073 wait complete. 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.314+0000 7f4ab5353700 1 Processor -- start 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.314+0000 7f4ab5353700 1 -- start start 2023-12-07T00:14:56.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4ab5353700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4ab00c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4ab5353700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ab014f860 0x7f4ab0156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4ab5353700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ab0154750 0x7f4ab0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4ab5353700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab014fce0 con 0x7f4a98003a00 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4ab5353700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0155110 con 0x7f4ab0154750 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4ab5353700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0156d90 con 0x7f4ab014f860 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaeffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4ab00c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaeffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4ab00c72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40198/0 (socket says 172.21.15.179:40198) 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaeffd700 1 -- 172.21.15.179:0/321819851 learned_addr learned my addr 172.21.15.179:0/321819851 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaf7fe700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ab0154750 0x7f4ab0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aae7fc700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ab014f860 0x7f4ab0156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaeffd700 1 -- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ab014f860 msgr2=0x7f4ab0156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaeffd700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ab014f860 0x7f4ab0156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaeffd700 1 -- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ab0154750 msgr2=0x7f4ab0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.322 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaeffd700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ab0154750 0x7f4ab0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaeffd700 1 -- 172.21.15.179:0/321819851 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab00c78b0 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aaf7fe700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ab0154750 0x7f4ab0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.315+0000 7f4aae7fc700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ab014f860 0x7f4ab0156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.316+0000 7f4aaeffd700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4ab00c72d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40090b0 tx=0x7f4aa40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.316+0000 7f4a977fe700 1 -- 172.21.15.179:0/321819851 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400e6c0 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.316+0000 7f4a977fe700 1 -- 172.21.15.179:0/321819851 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa4003ad0 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.316+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab00c7b90 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.316+0000 7f4a977fe700 1 -- 172.21.15.179:0/321819851 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40045d0 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.316+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab00af010 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.317+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab00685f0 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.318+0000 7f4a977fe700 1 -- 172.21.15.179:0/321819851 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4aa4013470 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.318+0000 7f4a977fe700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a9c06aed0 0x7f4a9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.318+0000 7f4a977fe700 1 -- 172.21.15.179:0/321819851 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4aa408b450 con 0x7f4a98003a00 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.318+0000 7f4aae7fc700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a9c06aed0 0x7f4a9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.318+0000 7f4aae7fc700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a9c06aed0 0x7f4a9c06d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00aef00 tx=0x7f4aa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:56.324 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.322+0000 7f4a977fe700 1 -- 172.21.15.179:0/321819851 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4aa40562b0 con 0x7f4a98003a00 2023-12-07T00:14:56.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.516+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ab00b4460 con 0x7f4a98003a00 2023-12-07T00:14:56.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.517+0000 7f4a977fe700 1 -- 172.21.15.179:0/321819851 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7f4aa40598d0 con 0x7f4a98003a00 2023-12-07T00:14:56.516 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:56.517 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:56.518 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a9c06aed0 msgr2=0x7f4a9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.518 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a9c06aed0 0x7f4a9c06d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00aef00 tx=0x7f4aa0009040 comp rx=0 tx=0).stop 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 msgr2=0x7f4ab00c72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4ab00c72d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40090b0 tx=0x7f4aa40047c0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 shutdown_connections 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4a9c06aed0 0x7f4a9c06d390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4ab0154750 0x7f4ab0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a98003a00 0x7f4ab00c72d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 --2- 172.21.15.179:0/321819851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4ab014f860 0x7f4ab0156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 >> 172.21.15.179:0/321819851 conn(0x7f4ab00b3550 msgr2=0x7f4ab015b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 shutdown_connections 2023-12-07T00:14:56.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.519+0000 7f4ab5353700 1 -- 172.21.15.179:0/321819851 wait complete. 2023-12-07T00:14:56.532 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:56.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:56.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.659+0000 7f54c06c4700 1 Processor -- start 2023-12-07T00:14:56.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.659+0000 7f54c06c4700 1 -- start start 2023-12-07T00:14:56.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.660+0000 7f54c06c4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54b815ab70 0x7f54b8070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.660+0000 7f54c06c4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54b80d0ed0 0x7f54b80adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.660+0000 7f54c06c4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b806f960 con 0x7f54b80ce770 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.660+0000 7f54c06c4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b815af50 con 0x7f54b815ab70 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.660+0000 7f54c06c4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b806fc40 con 0x7f54b80d0ed0 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54be460700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54b815ab70 0x7f54b8070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54be460700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f54b815ab70 0x7f54b8070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40206/0 (socket says 172.21.15.179:40206) 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54be460700 1 -- 172.21.15.179:0/3400657413 learned_addr learned my addr 172.21.15.179:0/3400657413 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54bec61700 1 --2- 172.21.15.179:0/3400657413 >> v2:172.21.15.190:3300/0 conn(0x7f54b80d0ed0 0x7f54b80adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54be460700 1 -- 172.21.15.179:0/3400657413 >> v2:172.21.15.190:3300/0 conn(0x7f54b80d0ed0 msgr2=0x7f54b80adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54be460700 1 --2- 172.21.15.179:0/3400657413 >> v2:172.21.15.190:3300/0 conn(0x7f54b80d0ed0 0x7f54b80adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54be460700 1 -- 172.21.15.179:0/3400657413 >> v1:172.21.15.190:6789/0 conn(0x7f54b80ce770 legacy=0x7f54b80d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54be460700 1 -- 172.21.15.179:0/3400657413 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b80cf110 con 0x7f54b815ab70 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54be460700 1 --2- 172.21.15.179:0/3400657413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b8070880 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f54b815f650 tx=0x7f54ac00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600f1a32fec714df server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54bd45e700 1 -- 172.21.15.179:0/3400657413 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00dcf0 con 0x7f54b815ab70 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54bd45e700 1 -- 172.21.15.179:0/3400657413 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ac00de50 con 0x7f54b815ab70 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.661+0000 7f54bd45e700 1 -- 172.21.15.179:0/3400657413 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54ac004250 con 0x7f54b815ab70 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.662+0000 7f54c06c4700 1 -- 172.21.15.179:0/3400657413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 msgr2=0x7f54b8070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.662+0000 7f54c06c4700 1 --2- 172.21.15.179:0/3400657413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b8070880 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f54b815f650 tx=0x7f54ac00be70 comp rx=0 tx=0).stop 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.662+0000 7f54c06c4700 1 -- 172.21.15.179:0/3400657413 shutdown_connections 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.662+0000 7f54c06c4700 1 --2- 172.21.15.179:0/3400657413 >> v2:172.21.15.190:3300/0 conn(0x7f54b80d0ed0 0x7f54b80adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.662+0000 7f54c06c4700 1 --2- 172.21.15.179:0/3400657413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b8070880 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.662+0000 7f54c06c4700 1 -- 172.21.15.179:0/3400657413 >> 172.21.15.179:0/3400657413 conn(0x7f54b8099a40 msgr2=0x7f54b8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:56.663 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.662+0000 7f54c06c4700 1 -- 172.21.15.179:0/3400657413 shutdown_connections 2023-12-07T00:14:56.664 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.662+0000 7f54c06c4700 1 -- 172.21.15.179:0/3400657413 wait complete. 2023-12-07T00:14:56.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.663+0000 7f54c06c4700 1 Processor -- start 2023-12-07T00:14:56.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.663+0000 7f54c06c4700 1 -- start start 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54c06c4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54b80ce770 0x7f54b80c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54c06c4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54b80d0ed0 0x7f54b814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54c06c4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b80b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54c06c4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80c5750 con 0x7f54b815ab70 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54c06c4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b814e4e0 con 0x7f54b80d0ed0 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54c06c4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b80c4b40 con 0x7f54b80ce770 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b80b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b80b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40214/0 (socket says 172.21.15.179:40214) 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 -- 172.21.15.179:0/2530069136 learned_addr learned my addr 172.21.15.179:0/2530069136 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 -- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54b80ce770 msgr2=0x7f54b80c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54be460700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54b80ce770 0x7f54b80c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bdc5f700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54b80d0ed0 0x7f54b814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54b80ce770 0x7f54b80c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 -- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54b80d0ed0 msgr2=0x7f54b814dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54b80d0ed0 0x7f54b814dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 -- 172.21.15.179:0/2530069136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac00b7f0 con 0x7f54b815ab70 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bdc5f700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54b80d0ed0 0x7f54b814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54bec61700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b80b5630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f54b000cd60 tx=0x7f54b000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54aaffd700 1 -- 172.21.15.179:0/2530069136 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0003a20 con 0x7f54b815ab70 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54aaffd700 1 -- 172.21.15.179:0/2530069136 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b0003ba0 con 0x7f54b815ab70 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.664+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b80c4e20 con 0x7f54b815ab70 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.665+0000 7f54aaffd700 1 -- 172.21.15.179:0/2530069136 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0004020 con 0x7f54b815ab70 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.665+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b80c53e0 con 0x7f54b815ab70 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.665+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b80685f0 con 0x7f54b815ab70 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.666+0000 7f54aaffd700 1 -- 172.21.15.179:0/2530069136 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54b0004180 con 0x7f54b815ab70 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.666+0000 7f54aaffd700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f549c06aed0 0x7f549c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:56.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.666+0000 7f54aaffd700 1 -- 172.21.15.179:0/2530069136 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f54b0012070 con 0x7f54b815ab70 2023-12-07T00:14:56.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.666+0000 7f54be460700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f549c06aed0 0x7f549c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:56.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.667+0000 7f54be460700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f549c06aed0 0x7f549c06d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f54ac000c00 tx=0x7f54ac012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:56.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.671+0000 7f54aaffd700 1 -- 172.21.15.179:0/2530069136 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54b0054ec0 con 0x7f54b815ab70 2023-12-07T00:14:56.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.862+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54b80c5890 con 0x7f54b815ab70 2023-12-07T00:14:56.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.862+0000 7f54aaffd700 1 -- 172.21.15.179:0/2530069136 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54b00584e0 con 0x7f54b815ab70 2023-12-07T00:14:56.862 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:56.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f549c06aed0 msgr2=0x7f549c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f549c06aed0 0x7f549c06d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f54ac000c00 tx=0x7f54ac012000 comp rx=0 tx=0).stop 2023-12-07T00:14:56.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 msgr2=0x7f54b80b5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:56.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b80b5630 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f54b000cd60 tx=0x7f54b000a570 comp rx=0 tx=0).stop 2023-12-07T00:14:56.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 shutdown_connections 2023-12-07T00:14:56.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f549c06aed0 0x7f549c06d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.864 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f54b815ab70 0x7f54b80b5630 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54b80ce770 0x7f54b80c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 --2- 172.21.15.179:0/2530069136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54b80d0ed0 0x7f54b814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:56.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 >> 172.21.15.179:0/2530069136 conn(0x7f54b8099a40 msgr2=0x7f54b80afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:56.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 shutdown_connections 2023-12-07T00:14:56.865 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:56.864+0000 7f54c06c4700 1 -- 172.21.15.179:0/2530069136 wait complete. 2023-12-07T00:14:56.876 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:14:57.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.000+0000 7f54a269f700 1 Processor -- start 2023-12-07T00:14:57.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.000+0000 7f54a269f700 1 -- start start 2023-12-07T00:14:57.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f54a269f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f549c15de50 0x7f549c0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f54a269f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c0ccc90 0x7f549c06af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f54a269f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c0cc550 con 0x7f549c06b4b0 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f54a269f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549c06b930 con 0x7f549c15de50 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f54a269f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0cd1c0 con 0x7f549c0ccc90 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f549c15de50 0x7f549c0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f54a0c3c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f549c06b4b0 0x7f549c1619b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47120/0 (socket says 172.21.15.179:47120) 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f54a0c3c700 1 -- 172.21.15.179:0/1858899358 learned_addr learned my addr 172.21.15.179:0/1858899358 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549bfff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f549c15de50 0x7f549c0cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40218/0 (socket says 172.21.15.179:40218) 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549b7fe700 1 --2- 172.21.15.179:0/1858899358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c0ccc90 0x7f549c06af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549bfff700 1 -- 172.21.15.179:0/1858899358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c0ccc90 msgr2=0x7f549c06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549bfff700 1 --2- 172.21.15.179:0/1858899358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c0ccc90 0x7f549c06af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549bfff700 1 -- 172.21.15.179:0/1858899358 >> v1:172.21.15.179:6789/0 conn(0x7f549c06b4b0 legacy=0x7f549c1619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549bfff700 1 -- 172.21.15.179:0/1858899358 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c0cd4a0 con 0x7f549c15de50 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549affd700 1 -- 172.21.15.179:0/1858899358 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229481314 0 0) 0x7f549c0cc550 con 0x7f549c06b4b0 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549b7fe700 1 --2- 172.21.15.179:0/1858899358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c0ccc90 0x7f549c06af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549bfff700 1 --2- 172.21.15.179:0/1858899358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c0cc010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5490009840 tx=0x7f5490009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d345dcd1d2560a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.001+0000 7f549affd700 1 -- 172.21.15.179:0/1858899358 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490011830 con 0x7f549c15de50 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f549affd700 1 -- 172.21.15.179:0/1858899358 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490011990 con 0x7f549c15de50 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f549affd700 1 -- 172.21.15.179:0/1858899358 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490011d20 con 0x7f549c15de50 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f54a269f700 1 -- 172.21.15.179:0/1858899358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 msgr2=0x7f549c0cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f54a269f700 1 --2- 172.21.15.179:0/1858899358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c0cc010 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5490009840 tx=0x7f5490009b50 comp rx=0 tx=0).stop 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f54a269f700 1 -- 172.21.15.179:0/1858899358 shutdown_connections 2023-12-07T00:14:57.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f54a269f700 1 --2- 172.21.15.179:0/1858899358 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c0cc010 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f54a269f700 1 --2- 172.21.15.179:0/1858899358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c0ccc90 0x7f549c06af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f54a269f700 1 -- 172.21.15.179:0/1858899358 >> 172.21.15.179:0/1858899358 conn(0x7f549c099a40 msgr2=0x7f549c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f54a269f700 1 -- 172.21.15.179:0/1858899358 shutdown_connections 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.002+0000 7f54a269f700 1 -- 172.21.15.179:0/1858899358 wait complete. 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.003+0000 7f54a269f700 1 Processor -- start 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.003+0000 7f54a269f700 1 -- start start 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a269f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c06b4b0 0x7f549c0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a269f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f549c0ccc90 0x7f549c14e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a269f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c14ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a269f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0c4f20 con 0x7f549c15de50 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a269f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0b66e0 con 0x7f549c0ccc90 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a269f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0c4c40 con 0x7f549c06b4b0 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a0c3c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c14ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a0c3c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c14ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40228/0 (socket says 172.21.15.179:40228) 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f54a0c3c700 1 -- 172.21.15.179:0/1757757839 learned_addr learned my addr 172.21.15.179:0/1757757839 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f549bfff700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c06b4b0 0x7f549c0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.004+0000 7f549b7fe700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f549c0ccc90 0x7f549c14e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f54a0c3c700 1 -- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c06b4b0 msgr2=0x7f549c0b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f54a0c3c700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c06b4b0 0x7f549c0b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f54a0c3c700 1 -- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f549c0ccc90 msgr2=0x7f549c14e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f54a0c3c700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f549c0ccc90 0x7f549c14e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f54a0c3c700 1 -- 172.21.15.179:0/1757757839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900094a0 con 0x7f549c15de50 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f549b7fe700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f549c0ccc90 0x7f549c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f54a0c3c700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c14ae00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f549400cba0 tx=0x7f549400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f5498ff9700 1 -- 172.21.15.179:0/1757757839 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400ab80 con 0x7f549c15de50 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f5498ff9700 1 -- 172.21.15.179:0/1757757839 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549400ad00 con 0x7f549c15de50 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549c0b6090 con 0x7f549c15de50 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f5498ff9700 1 -- 172.21.15.179:0/1757757839 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5494007310 con 0x7f549c15de50 2023-12-07T00:14:57.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.005+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c0b3e30 con 0x7f549c15de50 2023-12-07T00:14:57.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.006+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549c0b6820 con 0x7f549c15de50 2023-12-07T00:14:57.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.006+0000 7f5498ff9700 1 -- 172.21.15.179:0/1757757839 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5494007470 con 0x7f549c15de50 2023-12-07T00:14:57.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.007+0000 7f5498ff9700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f548806aed0 0x7f548806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.007+0000 7f5498ff9700 1 -- 172.21.15.179:0/1757757839 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f54940897f0 con 0x7f549c15de50 2023-12-07T00:14:57.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.007+0000 7f549bfff700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f548806aed0 0x7f548806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.007+0000 7f549bfff700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f548806aed0 0x7f548806d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5490000c00 tx=0x7f5490008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.011+0000 7f5498ff9700 1 -- 172.21.15.179:0/1757757839 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f549c0b6820 con 0x7f549c15de50 2023-12-07T00:14:57.202 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.203+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f549c0b6820 con 0x7f549c15de50 2023-12-07T00:14:57.202 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.203+0000 7f5498ff9700 1 -- 172.21.15.179:0/1757757839 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5494018020 con 0x7f549c15de50 2023-12-07T00:14:57.202 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f548806aed0 msgr2=0x7f548806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f548806aed0 0x7f548806d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5490000c00 tx=0x7f5490008030 comp rx=0 tx=0).stop 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 msgr2=0x7f549c14ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c14ae00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f549400cba0 tx=0x7f549400cf60 comp rx=0 tx=0).stop 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 shutdown_connections 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f548806aed0 0x7f548806d390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f549c15de50 0x7f549c14ae00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f549c06b4b0 0x7f549c0b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 --2- 172.21.15.179:0/1757757839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f549c0ccc90 0x7f549c14e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 >> 172.21.15.179:0/1757757839 conn(0x7f549c099a40 msgr2=0x7f549c099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:57.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 shutdown_connections 2023-12-07T00:14:57.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.205+0000 7f54a269f700 1 -- 172.21.15.179:0/1757757839 wait complete. 2023-12-07T00:14:57.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:14:57.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.340+0000 7f4c2f940700 1 Processor -- start 2023-12-07T00:14:57.339 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.340+0000 7f4c2f940700 1 -- start start 2023-12-07T00:14:57.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c2f940700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c281624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c2f940700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c280d06a0 con 0x7f4c2809a2a0 2023-12-07T00:14:57.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c2f940700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c280d0980 con 0x7f4c280cfcc0 2023-12-07T00:14:57.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c2f940700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c28162a20 con 0x7f4c28162100 2023-12-07T00:14:57.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c2dedd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4c2809a2a0 0x7f4c2815d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47138/0 (socket says 172.21.15.179:47138) 2023-12-07T00:14:57.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c2dedd700 1 -- 172.21.15.179:0/3102301088 learned_addr learned my addr 172.21.15.179:0/3102301088 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:57.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c2d6dc700 1 --2- 172.21.15.179:0/3102301088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c281624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c1ffff700 1 -- 172.21.15.179:0/3102301088 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363743461 0 0) 0x7f4c280d06a0 con 0x7f4c2809a2a0 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c1ffff700 1 -- 172.21.15.179:0/3102301088 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c140035b0 con 0x7f4c2809a2a0 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c1ffff700 1 -- 172.21.15.179:0/3102301088 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106621814 0 0) 0x7f4c280d0980 con 0x7f4c280cfcc0 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.341+0000 7f4c1ffff700 1 -- 172.21.15.179:0/3102301088 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c280d06a0 con 0x7f4c280cfcc0 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2d6dc700 1 -- 172.21.15.179:0/3102301088 >> v1:172.21.15.190:6789/0 conn(0x7f4c280cfcc0 legacy=0x7f4c28099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c1ffff700 1 -- 172.21.15.179:0/3102301088 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3926277183 0 0) 0x7f4c140035b0 con 0x7f4c2809a2a0 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2d6dc700 1 -- 172.21.15.179:0/3102301088 >> v1:172.21.15.179:6789/0 conn(0x7f4c2809a2a0 legacy=0x7f4c2815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2d6dc700 1 -- 172.21.15.179:0/3102301088 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c280d0c60 con 0x7f4c28162100 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2d6dc700 1 --2- 172.21.15.179:0/3102301088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c281624e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009870 tx=0x7f4c18009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6652c9dff1687f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c1ffff700 1 -- 172.21.15.179:0/3102301088 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c200019f0 con 0x7f4c28162100 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c1ffff700 1 -- 172.21.15.179:0/3102301088 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c18004030 con 0x7f4c28162100 2023-12-07T00:14:57.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c1ffff700 1 -- 172.21.15.179:0/3102301088 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c180043a0 con 0x7f4c28162100 2023-12-07T00:14:57.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2f940700 1 -- 172.21.15.179:0/3102301088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 msgr2=0x7f4c281624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2f940700 1 --2- 172.21.15.179:0/3102301088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c281624e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009870 tx=0x7f4c18009b80 comp rx=0 tx=0).stop 2023-12-07T00:14:57.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2f940700 1 -- 172.21.15.179:0/3102301088 shutdown_connections 2023-12-07T00:14:57.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2f940700 1 --2- 172.21.15.179:0/3102301088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c281624e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.342+0000 7f4c2f940700 1 -- 172.21.15.179:0/3102301088 >> 172.21.15.179:0/3102301088 conn(0x7f4c280b34e0 msgr2=0x7f4c280b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:57.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.343+0000 7f4c2f940700 1 -- 172.21.15.179:0/3102301088 shutdown_connections 2023-12-07T00:14:57.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.343+0000 7f4c2f940700 1 -- 172.21.15.179:0/3102301088 wait complete. 2023-12-07T00:14:57.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.344+0000 7f4c2f940700 1 Processor -- start 2023-12-07T00:14:57.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.344+0000 7f4c2f940700 1 -- start start 2023-12-07T00:14:57.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.344+0000 7f4c2f940700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2809a2a0 0x7f4c2815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.344+0000 7f4c2f940700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c280cfcc0 0x7f4c2815ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.344+0000 7f4c2f940700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c280b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.344+0000 7f4c2f940700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280c9b40 con 0x7f4c280cfcc0 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.344+0000 7f4c2f940700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280c8f30 con 0x7f4c2809a2a0 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.344+0000 7f4c2f940700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c280c9210 con 0x7f4c28162100 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c280cfcc0 0x7f4c2815ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c280cfcc0 0x7f4c2815ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40240/0 (socket says 172.21.15.179:40240) 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 -- 172.21.15.179:0/117160210 learned_addr learned my addr 172.21.15.179:0/117160210 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2d6dc700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2809a2a0 0x7f4c2815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2dedd700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c280b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 -- 172.21.15.179:0/117160210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 msgr2=0x7f4c280b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c280b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 -- 172.21.15.179:0/117160210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2809a2a0 msgr2=0x7f4c2815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2809a2a0 0x7f4c2815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 -- 172.21.15.179:0/117160210 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c180094a0 con 0x7f4c280cfcc0 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2cedb700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c280cfcc0 0x7f4c2815ed90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c520 tx=0x7f4c2400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c1dffb700 1 -- 172.21.15.179:0/117160210 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240052d0 con 0x7f4c280cfcc0 2023-12-07T00:14:57.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c1dffb700 1 -- 172.21.15.179:0/117160210 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c24005430 con 0x7f4c280cfcc0 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c1dffb700 1 -- 172.21.15.179:0/117160210 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240038c0 con 0x7f4c280cfcc0 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c280c94f0 con 0x7f4c280cfcc0 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.345+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c280c8ac0 con 0x7f4c280cfcc0 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.346+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c280c8ce0 con 0x7f4c280cfcc0 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.347+0000 7f4c1dffb700 1 -- 172.21.15.179:0/117160210 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c24003a20 con 0x7f4c280cfcc0 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.347+0000 7f4c1dffb700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c0c06aed0 0x7f4c0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.347+0000 7f4c1dffb700 1 -- 172.21.15.179:0/117160210 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4c24088e20 con 0x7f4c280cfcc0 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.347+0000 7f4c2d6dc700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c0c06aed0 0x7f4c0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.349 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.347+0000 7f4c2d6dc700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c0c06aed0 0x7f4c0c06d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c18000c00 tx=0x7f4c18008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.351+0000 7f4c1dffb700 1 -- 172.21.15.179:0/117160210 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c24053b10 con 0x7f4c280cfcc0 2023-12-07T00:14:57.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.540+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c280c9c80 con 0x7f4c280cfcc0 2023-12-07T00:14:57.540 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.540+0000 7f4c1dffb700 1 -- 172.21.15.179:0/117160210 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c280c9c80 con 0x7f4c280cfcc0 2023-12-07T00:14:57.540 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.542+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c0c06aed0 msgr2=0x7f4c0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.542+0000 7f4c2f940700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c0c06aed0 0x7f4c0c06d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c18000c00 tx=0x7f4c18008030 comp rx=0 tx=0).stop 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.542+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c280cfcc0 msgr2=0x7f4c2815ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.542+0000 7f4c2f940700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c280cfcc0 0x7f4c2815ed90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400c520 tx=0x7f4c2400c830 comp rx=0 tx=0).stop 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.543+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 shutdown_connections 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.543+0000 7f4c2f940700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c0c06aed0 0x7f4c0c06d390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.543+0000 7f4c2f940700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c28162100 0x7f4c280b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.543+0000 7f4c2f940700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c2809a2a0 0x7f4c2815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.543+0000 7f4c2f940700 1 --2- 172.21.15.179:0/117160210 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c280cfcc0 0x7f4c2815ed90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.542 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.543+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 >> 172.21.15.179:0/117160210 conn(0x7f4c280b34e0 msgr2=0x7f4c2806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:57.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.543+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 shutdown_connections 2023-12-07T00:14:57.543 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.543+0000 7f4c2f940700 1 -- 172.21.15.179:0/117160210 wait complete. 2023-12-07T00:14:57.554 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:14:57.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.678+0000 7f6ba6d43700 1 Processor -- start 2023-12-07T00:14:57.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.678+0000 7f6ba6d43700 1 -- start start 2023-12-07T00:14:57.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.679+0000 7f6ba6d43700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ba00d0ed0 0x7f6ba0070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.679+0000 7f6ba6d43700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba006f960 con 0x7f6ba015ab70 2023-12-07T00:14:57.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.679+0000 7f6ba6d43700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba00cf110 con 0x7f6ba00ce770 2023-12-07T00:14:57.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.679+0000 7f6ba6d43700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba015af50 con 0x7f6ba00d0ed0 2023-12-07T00:14:57.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.679+0000 7f6ba4adf700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6ba015ab70 0x7f6ba00d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47148/0 (socket says 172.21.15.179:47148) 2023-12-07T00:14:57.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.679+0000 7f6ba4adf700 1 -- 172.21.15.179:0/2824930582 learned_addr learned my addr 172.21.15.179:0/2824930582 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:57.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6ba52e0700 1 --2- 172.21.15.179:0/2824930582 >> v2:172.21.15.190:3300/0 conn(0x7f6ba00d0ed0 0x7f6ba0070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930113356 0 0) 0x7f6ba006f960 con 0x7f6ba015ab70 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b900035b0 con 0x7f6ba015ab70 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1190321905 0 0) 0x7f6b900035b0 con 0x7f6ba015ab70 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 >> v2:172.21.15.190:3300/0 conn(0x7f6ba00d0ed0 msgr2=0x7f6ba0070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 --2- 172.21.15.179:0/2824930582 >> v2:172.21.15.190:3300/0 conn(0x7f6ba00d0ed0 0x7f6ba0070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 >> v1:172.21.15.190:6789/0 conn(0x7f6ba00ce770 legacy=0x7f6ba00adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00cf3f0 con 0x7f6ba015ab70 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f6b94001670 con 0x7f6ba015ab70 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 >> v1:172.21.15.179:6789/0 conn(0x7f6ba015ab70 legacy=0x7f6ba00d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90003a00 0x7f6b90003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b90004850 0x7f6b90004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b90005330 0x7f6b9000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba015af50 con 0x7f6b90004850 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000c200 con 0x7f6b90003a00 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000c3c0 con 0x7f6b90005330 2023-12-07T00:14:57.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9ffff700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b90004850 0x7f6b90004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6ba4adf700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90003a00 0x7f6b90003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6ba52e0700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b90005330 0x7f6b9000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9ffff700 1 -- 172.21.15.179:0/2824930582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b90005330 msgr2=0x7f6b9000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9ffff700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6b90005330 0x7f6b9000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9ffff700 1 -- 172.21.15.179:0/2824930582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90003a00 msgr2=0x7f6b90003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9ffff700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90003a00 0x7f6b90003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6b9ffff700 1 -- 172.21.15.179:0/2824930582 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b900035b0 con 0x7f6b90004850 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.680+0000 7f6ba52e0700 1 -- 172.21.15.179:0/2824930582 reap_dead start 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6b9ffff700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b90004850 0x7f6b90004cd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c007fd0 tx=0x7f6b90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4d6d0acb2fe098 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0052d0 con 0x7f6b90004850 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c005430 con 0x7f6b90004850 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6b9f7fe700 1 -- 172.21.15.179:0/2824930582 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0038c0 con 0x7f6b90004850 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6ba6d43700 1 -- 172.21.15.179:0/2824930582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b90004850 msgr2=0x7f6b90004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6ba6d43700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b90004850 0x7f6b90004cd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c007fd0 tx=0x7f6b90005880 comp rx=0 tx=0).stop 2023-12-07T00:14:57.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6ba6d43700 1 -- 172.21.15.179:0/2824930582 shutdown_connections 2023-12-07T00:14:57.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6ba6d43700 1 --2- 172.21.15.179:0/2824930582 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6b90004850 0x7f6b90004cd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6ba6d43700 1 -- 172.21.15.179:0/2824930582 >> 172.21.15.179:0/2824930582 conn(0x7f6ba0099a40 msgr2=0x7f6ba0099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:57.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6ba6d43700 1 -- 172.21.15.179:0/2824930582 shutdown_connections 2023-12-07T00:14:57.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.681+0000 7f6ba6d43700 1 -- 172.21.15.179:0/2824930582 wait complete. 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.682+0000 7f6ba6d43700 1 Processor -- start 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.682+0000 7f6ba6d43700 1 -- start start 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6ba6d43700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90004850 0x7f6ba0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6ba6d43700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ba00b6420 0x7f6ba01f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6ba6d43700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba00b0680 0x7f6ba00b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6ba6d43700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba006fc40 con 0x7f6ba00b6420 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6ba6d43700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba01565d0 con 0x7f6b90004850 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6ba6d43700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba00b1050 con 0x7f6ba00b0680 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6b9ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ba00b6420 0x7f6ba01f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6b9ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ba00b6420 0x7f6ba01f1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40258/0 (socket says 172.21.15.179:40258) 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.683+0000 7f6b9ffff700 1 -- 172.21.15.179:0/74430745 learned_addr learned my addr 172.21.15.179:0/74430745 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6ba4adf700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90004850 0x7f6ba0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6ba52e0700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba00b0680 0x7f6ba00b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9ffff700 1 -- 172.21.15.179:0/74430745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba00b0680 msgr2=0x7f6ba00b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9ffff700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba00b0680 0x7f6ba00b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9ffff700 1 -- 172.21.15.179:0/74430745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90004850 msgr2=0x7f6ba0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9ffff700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90004850 0x7f6ba0156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9ffff700 1 -- 172.21.15.179:0/74430745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00c9cd0 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9ffff700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ba00b6420 0x7f6ba01f1fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c1d0 tx=0x7f6b8c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9d7fa700 1 -- 172.21.15.179:0/74430745 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c001290 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9d7fa700 1 -- 172.21.15.179:0/74430745 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c003e80 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba00c8e20 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6b9d7fa700 1 -- 172.21.15.179:0/74430745 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c006aa0 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.684+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba00c93a0 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.685+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba006f560 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.686+0000 7f6b9d7fa700 1 -- 172.21.15.179:0/74430745 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b8c019040 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.686+0000 7f6b9d7fa700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6b8406aed0 0x7f6b8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.686+0000 7f6b9d7fa700 1 -- 172.21.15.179:0/74430745 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6b8c089fb0 con 0x7f6ba00b6420 2023-12-07T00:14:57.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.686+0000 7f6ba4adf700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6b8406aed0 0x7f6b8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:57.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.686+0000 7f6ba4adf700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6b8406aed0 0x7f6b8406d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b94007db0 tx=0x7f6b94000fe0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:57.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.690+0000 7f6b9d7fa700 1 -- 172.21.15.179:0/74430745 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b8c0bce90 con 0x7f6ba00b6420 2023-12-07T00:14:57.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.879+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6ba00c9e60 con 0x7f6ba00b6420 2023-12-07T00:14:57.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.880+0000 7f6b9d7fa700 1 -- 172.21.15.179:0/74430745 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6b8c02c020 con 0x7f6ba00b6420 2023-12-07T00:14:57.879 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:57.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.881+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6b8406aed0 msgr2=0x7f6b8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.881+0000 7f6ba6d43700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6b8406aed0 0x7f6b8406d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b94007db0 tx=0x7f6b94000fe0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.881+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ba00b6420 msgr2=0x7f6ba01f1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:57.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.881+0000 7f6ba6d43700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ba00b6420 0x7f6ba01f1fb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c1d0 tx=0x7f6b8c001120 comp rx=0 tx=0).stop 2023-12-07T00:14:57.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.882+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 shutdown_connections 2023-12-07T00:14:57.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.882+0000 7f6ba6d43700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f6b8406aed0 0x7f6b8406d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.882+0000 7f6ba6d43700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ba00b0680 0x7f6ba00b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.882+0000 7f6ba6d43700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6b90004850 0x7f6ba0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.882+0000 7f6ba6d43700 1 --2- 172.21.15.179:0/74430745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6ba00b6420 0x7f6ba01f1fb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:57.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.882+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 >> 172.21.15.179:0/74430745 conn(0x7f6ba0099a40 msgr2=0x7f6ba00ada90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:57.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.882+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 shutdown_connections 2023-12-07T00:14:57.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:57.882+0000 7f6ba6d43700 1 -- 172.21.15.179:0/74430745 wait complete. 2023-12-07T00:14:57.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:58.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.013+0000 7ff6331da700 1 Processor -- start 2023-12-07T00:14:58.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.014+0000 7ff6331da700 1 -- start start 2023-12-07T00:14:58.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.014+0000 7ff6331da700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c15e220 0x7ff62c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.014+0000 7ff6331da700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c15f330 con 0x7ff62c15de40 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.014+0000 7ff6331da700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62c15e720 con 0x7ff62c0b2aa0 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.014+0000 7ff6331da700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c0d1820 con 0x7ff62c15e220 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.014+0000 7ff630f76700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff62c15de40 0x7ff62c0b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47166/0 (socket says 172.21.15.179:47166) 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.014+0000 7ff630f76700 1 -- 172.21.15.179:0/2059865343 learned_addr learned my addr 172.21.15.179:0/2059865343 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62bfff700 1 --2- 172.21.15.179:0/2059865343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c15e220 0x7ff62c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62b7fe700 1 -- 172.21.15.179:0/2059865343 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 758027754 0 0) 0x7ff62c15f330 con 0x7ff62c15de40 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62b7fe700 1 -- 172.21.15.179:0/2059865343 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff61c0035b0 con 0x7ff62c15de40 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62b7fe700 1 -- 172.21.15.179:0/2059865343 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711859190 0 0) 0x7ff62c15e720 con 0x7ff62c0b2aa0 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62b7fe700 1 -- 172.21.15.179:0/2059865343 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff62c15f330 con 0x7ff62c0b2aa0 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62b7fe700 1 -- 172.21.15.179:0/2059865343 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1738852755 0 0) 0x7ff61c0035b0 con 0x7ff62c15de40 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62bfff700 1 -- 172.21.15.179:0/2059865343 >> v1:172.21.15.190:6789/0 conn(0x7ff62c0b2aa0 legacy=0x7ff62c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62bfff700 1 -- 172.21.15.179:0/2059865343 >> v1:172.21.15.179:6789/0 conn(0x7ff62c15de40 legacy=0x7ff62c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62bfff700 1 -- 172.21.15.179:0/2059865343 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c15ea00 con 0x7ff62c15e220 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62bfff700 1 --2- 172.21.15.179:0/2059865343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c15e220 0x7ff62c0b2560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff618009850 tx=0x7ff618009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d18c511f603897a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62b7fe700 1 -- 172.21.15.179:0/2059865343 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff620001670 con 0x7ff62c15e220 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62b7fe700 1 -- 172.21.15.179:0/2059865343 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff618005c30 con 0x7ff62c15e220 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.015+0000 7ff62b7fe700 1 -- 172.21.15.179:0/2059865343 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618004030 con 0x7ff62c15e220 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.016+0000 7ff6331da700 1 -- 172.21.15.179:0/2059865343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c15e220 msgr2=0x7ff62c0b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.016+0000 7ff6331da700 1 --2- 172.21.15.179:0/2059865343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c15e220 0x7ff62c0b2560 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff618009850 tx=0x7ff618009b60 comp rx=0 tx=0).stop 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.016+0000 7ff6331da700 1 -- 172.21.15.179:0/2059865343 shutdown_connections 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.016+0000 7ff6331da700 1 --2- 172.21.15.179:0/2059865343 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c15e220 0x7ff62c0b2560 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.016+0000 7ff6331da700 1 -- 172.21.15.179:0/2059865343 >> 172.21.15.179:0/2059865343 conn(0x7ff62c072970 msgr2=0x7ff62c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.016+0000 7ff6331da700 1 -- 172.21.15.179:0/2059865343 shutdown_connections 2023-12-07T00:14:58.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.016+0000 7ff6331da700 1 -- 172.21.15.179:0/2059865343 wait complete. 2023-12-07T00:14:58.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.017+0000 7ff6331da700 1 Processor -- start 2023-12-07T00:14:58.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.017+0000 7ff6331da700 1 -- start start 2023-12-07T00:14:58.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff6331da700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c0b2aa0 0x7ff62c153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff6331da700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff62c15de40 0x7ff62c15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff6331da700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c15e220 0x7ff62c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.020 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff6331da700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c15aea0 con 0x7ff62c15e220 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff6331da700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c156130 con 0x7ff62c15de40 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff6331da700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62c153790 con 0x7ff62c0b2aa0 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff631777700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c15e220 0x7ff62c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff631777700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c15e220 0x7ff62c156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40274/0 (socket says 172.21.15.179:40274) 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff631777700 1 -- 172.21.15.179:0/4003422969 learned_addr learned my addr 172.21.15.179:0/4003422969 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff630f76700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c0b2aa0 0x7ff62c153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.018+0000 7ff62bfff700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff62c15de40 0x7ff62c15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff631777700 1 -- 172.21.15.179:0/4003422969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c0b2aa0 msgr2=0x7ff62c153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff631777700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c0b2aa0 0x7ff62c153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff631777700 1 -- 172.21.15.179:0/4003422969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff62c15de40 msgr2=0x7ff62c15a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff631777700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff62c15de40 0x7ff62c15a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff631777700 1 -- 172.21.15.179:0/4003422969 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618009430 con 0x7ff62c15e220 2023-12-07T00:14:58.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff631777700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c15e220 0x7ff62c156630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff62400cbc0 tx=0x7ff62400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff6297fa700 1 -- 172.21.15.179:0/4003422969 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624003c00 con 0x7ff62c15e220 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff6297fa700 1 -- 172.21.15.179:0/4003422969 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff624003d60 con 0x7ff62c15e220 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62c1594e0 con 0x7ff62c15e220 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff6297fa700 1 -- 172.21.15.179:0/4003422969 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62400aaa0 con 0x7ff62c15e220 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.019+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62c15b080 con 0x7ff62c15e220 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.020+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62c04f290 con 0x7ff62c15e220 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.020+0000 7ff6297fa700 1 -- 172.21.15.179:0/4003422969 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff62400ac00 con 0x7ff62c15e220 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.021+0000 7ff6297fa700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff61006aed0 0x7ff61006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.021+0000 7ff6297fa700 1 -- 172.21.15.179:0/4003422969 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff6240898b0 con 0x7ff62c15e220 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.021+0000 7ff630f76700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff61006aed0 0x7ff61006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.021+0000 7ff630f76700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff61006aed0 0x7ff61006d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff62c1f7090 tx=0x7ff620001770 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.025+0000 7ff6297fa700 1 -- 172.21.15.179:0/4003422969 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff624054630 con 0x7ff62c15e220 2023-12-07T00:14:58.214 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.215+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff62c0cd3d0 con 0x7ff62c15e220 2023-12-07T00:14:58.215 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.216+0000 7ff6297fa700 1 -- 172.21.15.179:0/4003422969 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7ff624057c50 con 0x7ff62c15e220 2023-12-07T00:14:58.216 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:58.216 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.218+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff61006aed0 msgr2=0x7ff61006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.218+0000 7ff6331da700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff61006aed0 0x7ff61006d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff62c1f7090 tx=0x7ff620001770 comp rx=0 tx=0).stop 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.218+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c15e220 msgr2=0x7ff62c156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.218+0000 7ff6331da700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c15e220 0x7ff62c156630 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff62400cbc0 tx=0x7ff62400ced0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.219+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 shutdown_connections 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.219+0000 7ff6331da700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff61006aed0 0x7ff61006d390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.219+0000 7ff6331da700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff62c15e220 0x7ff62c156630 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.219+0000 7ff6331da700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff62c0b2aa0 0x7ff62c153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.219+0000 7ff6331da700 1 --2- 172.21.15.179:0/4003422969 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff62c15de40 0x7ff62c15a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.219+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 >> 172.21.15.179:0/4003422969 conn(0x7ff62c072970 msgr2=0x7ff62c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:58.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.219+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 shutdown_connections 2023-12-07T00:14:58.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.219+0000 7ff6331da700 1 -- 172.21.15.179:0/4003422969 wait complete. 2023-12-07T00:14:58.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:58.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:14:58.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.354+0000 7f363b491700 1 Processor -- start 2023-12-07T00:14:58.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.355+0000 7f363b491700 1 -- start start 2023-12-07T00:14:58.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.355+0000 7f363b491700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3634161360 0x7f36340cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.355+0000 7f363b491700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36340cb0f0 con 0x7f363406af70 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.355+0000 7f363b491700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3634161740 con 0x7f3634162380 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.355+0000 7f363b491700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3634162810 con 0x7f3634161360 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f3638a2c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f363406af70 0x7f3634161c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47182/0 (socket says 172.21.15.179:47182) 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f3638a2c700 1 -- 172.21.15.179:0/1278495086 learned_addr learned my addr 172.21.15.179:0/1278495086 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f363922d700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3634161360 0x7f36340cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793093586 0 0) 0x7f36340cb0f0 con 0x7f363406af70 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36200035b0 con 0x7f363406af70 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3913771939 0 0) 0x7f36200035b0 con 0x7f363406af70 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3634161360 msgr2=0x7f36340cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3634161360 0x7f36340cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 >> v1:172.21.15.190:6789/0 conn(0x7f3634162380 legacy=0x7f36340ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340cb340 con 0x7f363406af70 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f3630001670 con 0x7f363406af70 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 >> v1:172.21.15.179:6789/0 conn(0x7f363406af70 legacy=0x7f3634161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3620003a30 0x7f3620003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f3620004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3634161360 0x7f3620005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3634162810 con 0x7f3620004850 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362000bb40 con 0x7f3620003a30 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362000bd00 con 0x7f3634161360 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f3638a2c700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f3620004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f363922d700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3620003a30 0x7f3620003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.356+0000 7f3639a2e700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3634161360 0x7f3620005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f3638a2c700 1 -- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3634161360 msgr2=0x7f3620005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f3638a2c700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3634161360 0x7f3620005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f3638a2c700 1 -- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3620003a30 msgr2=0x7f3620003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f3638a2c700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3620003a30 0x7f3620003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f3638a2c700 1 -- 172.21.15.179:0/1278495086 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36200035b0 con 0x7f3620004850 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f3638a2c700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f3620004cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f363000c2f0 tx=0x7f3620005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ad3cfd824a1008 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363000ce30 con 0x7f3620004850 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630005960 con 0x7f3620004850 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f362bfff700 1 -- 172.21.15.179:0/1278495086 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630005d10 con 0x7f3620004850 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f363b491700 1 -- 172.21.15.179:0/1278495086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 msgr2=0x7f3620004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f363b491700 1 --2- 172.21.15.179:0/1278495086 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f3620004cd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f363000c2f0 tx=0x7f3620005880 comp rx=0 tx=0).stop 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f3639a2e700 1 -- 172.21.15.179:0/1278495086 reap_dead start 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f363b491700 1 -- 172.21.15.179:0/1278495086 shutdown_connections 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f363b491700 1 -- 172.21.15.179:0/1278495086 >> 172.21.15.179:0/1278495086 conn(0x7f3634099a40 msgr2=0x7f3634099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:58.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.357+0000 7f363b491700 1 -- 172.21.15.179:0/1278495086 shutdown_connections 2023-12-07T00:14:58.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.358+0000 7f363b491700 1 -- 172.21.15.179:0/1278495086 wait complete. 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.359+0000 7f363b491700 1 Processor -- start 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.359+0000 7f363b491700 1 -- start start 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.359+0000 7f363b491700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f363414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.359+0000 7f363b491700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36340aea30 0x7f36340aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.359+0000 7f363b491700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36341f7100 0x7f36341f75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.359+0000 7f363b491700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36340af3f0 con 0x7f3620004850 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.359+0000 7f363b491700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36341f7e70 con 0x7f36340aea30 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.359+0000 7f363b491700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3634159cd0 con 0x7f36341f7100 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f363414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f363414f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40290/0 (socket says 172.21.15.179:40290) 2023-12-07T00:14:58.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 -- 172.21.15.179:0/3444070082 learned_addr learned my addr 172.21.15.179:0/3444070082 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f3639a2e700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36341f7100 0x7f36341f75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f3638a2c700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36340aea30 0x7f36340aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 -- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36341f7100 msgr2=0x7f36341f75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36341f7100 0x7f36341f75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 -- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36340aea30 msgr2=0x7f36340aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36340aea30 0x7f36340aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 -- 172.21.15.179:0/3444070082 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36341593a0 con 0x7f3620004850 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f3638a2c700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36340aea30 0x7f36340aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363922d700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f363414f0b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3624011b00 tx=0x7f3624011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f3629ffb700 1 -- 172.21.15.179:0/3444070082 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400f940 con 0x7f3620004850 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f3629ffb700 1 -- 172.21.15.179:0/3444070082 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362400faa0 con 0x7f3620004850 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3634159680 con 0x7f3620004850 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f3629ffb700 1 -- 172.21.15.179:0/3444070082 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362400fe50 con 0x7f3620004850 2023-12-07T00:14:58.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.360+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363414f5f0 con 0x7f3620004850 2023-12-07T00:14:58.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.361+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36340685f0 con 0x7f3620004850 2023-12-07T00:14:58.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.362+0000 7f3629ffb700 1 -- 172.21.15.179:0/3444070082 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3624014440 con 0x7f3620004850 2023-12-07T00:14:58.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.362+0000 7f3629ffb700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f361806aed0 0x7f361806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.362+0000 7f3629ffb700 1 -- 172.21.15.179:0/3444070082 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f362408a120 con 0x7f3620004850 2023-12-07T00:14:58.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.362+0000 7f3638a2c700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f361806aed0 0x7f361806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.363+0000 7f3638a2c700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f361806aed0 0x7f361806d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3630001930 tx=0x7f3630007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.366+0000 7f3629ffb700 1 -- 172.21.15.179:0/3444070082 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3624054ea0 con 0x7f3620004850 2023-12-07T00:14:58.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.556+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36340b6a20 con 0x7f3620004850 2023-12-07T00:14:58.556 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.557+0000 7f3629ffb700 1 -- 172.21.15.179:0/3444070082 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36240584c0 con 0x7f3620004850 2023-12-07T00:14:58.556 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:14:58.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f361806aed0 msgr2=0x7f361806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f361806aed0 0x7f361806d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3630001930 tx=0x7f3630007000 comp rx=0 tx=0).stop 2023-12-07T00:14:58.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 msgr2=0x7f363414f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f363414f0b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3624011b00 tx=0x7f3624011e10 comp rx=0 tx=0).stop 2023-12-07T00:14:58.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 shutdown_connections 2023-12-07T00:14:58.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f361806aed0 0x7f361806d390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.558 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36341f7100 0x7f36341f75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3620004850 0x7f363414f0b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 --2- 172.21.15.179:0/3444070082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36340aea30 0x7f36340aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 >> 172.21.15.179:0/3444070082 conn(0x7f3634099a40 msgr2=0x7f363406fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:58.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 shutdown_connections 2023-12-07T00:14:58.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.559+0000 7f363b491700 1 -- 172.21.15.179:0/3444070082 wait complete. 2023-12-07T00:14:58.570 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:14:58.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.698+0000 7f67f340d700 1 Processor -- start 2023-12-07T00:14:58.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.698+0000 7f67f340d700 1 -- start start 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f340d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67ec161360 0x7f67ec0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f340d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 0x7f67ec06b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f340d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f67ec161c70 0x7f67ec162100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f340d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec06b930 con 0x7f67ec161360 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f340d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec0cb0f0 con 0x7f67ec161c70 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f340d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec161740 con 0x7f67ec06af70 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f11a9700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67ec161360 0x7f67ec0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f11a9700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f67ec161360 0x7f67ec0cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40298/0 (socket says 172.21.15.179:40298) 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f11a9700 1 -- 172.21.15.179:0/4002478851 learned_addr learned my addr 172.21.15.179:0/4002478851 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f09a8700 1 --2- 172.21.15.179:0/4002478851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 0x7f67ec06b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.699+0000 7f67f19aa700 1 --2- 172.21.15.179:0/4002478851 >> v2:172.21.15.190:3300/0 conn(0x7f67ec161c70 0x7f67ec162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f11a9700 1 -- 172.21.15.179:0/4002478851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 msgr2=0x7f67ec06b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f11a9700 1 --2- 172.21.15.179:0/4002478851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 0x7f67ec06b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f11a9700 1 -- 172.21.15.179:0/4002478851 >> v2:172.21.15.190:3300/0 conn(0x7f67ec161c70 msgr2=0x7f67ec162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f11a9700 1 --2- 172.21.15.179:0/4002478851 >> v2:172.21.15.190:3300/0 conn(0x7f67ec161c70 0x7f67ec162100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f11a9700 1 -- 172.21.15.179:0/4002478851 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec0cb340 con 0x7f67ec161360 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f11a9700 1 --2- 172.21.15.179:0/4002478851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0cc100 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0c7af0 tx=0x7f67dc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206011aa84cfff4b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67e3fff700 1 -- 172.21.15.179:0/4002478851 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00b870 con 0x7f67ec161360 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67e3fff700 1 -- 172.21.15.179:0/4002478851 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc00b9d0 con 0x7f67ec161360 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67e3fff700 1 -- 172.21.15.179:0/4002478851 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00bd60 con 0x7f67ec161360 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f340d700 1 -- 172.21.15.179:0/4002478851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 msgr2=0x7f67ec0cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f340d700 1 --2- 172.21.15.179:0/4002478851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0cc100 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0c7af0 tx=0x7f67dc009bd0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f340d700 1 -- 172.21.15.179:0/4002478851 shutdown_connections 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f340d700 1 --2- 172.21.15.179:0/4002478851 >> v2:172.21.15.190:3300/0 conn(0x7f67ec161c70 0x7f67ec162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f340d700 1 --2- 172.21.15.179:0/4002478851 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0cc100 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f340d700 1 --2- 172.21.15.179:0/4002478851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 0x7f67ec06b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.700+0000 7f67f340d700 1 -- 172.21.15.179:0/4002478851 >> 172.21.15.179:0/4002478851 conn(0x7f67ec099a40 msgr2=0x7f67ec099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:58.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.701+0000 7f67f340d700 1 -- 172.21.15.179:0/4002478851 shutdown_connections 2023-12-07T00:14:58.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.701+0000 7f67f340d700 1 -- 172.21.15.179:0/4002478851 wait complete. 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.702+0000 7f67f340d700 1 Processor -- start 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.702+0000 7f67f340d700 1 -- start start 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f340d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 0x7f67ec1f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f340d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f340d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67ec161c70 0x7f67ec1f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f340d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec1f47e0 con 0x7f67ec161360 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f340d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec0b5c30 con 0x7f67ec161c70 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f340d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec0b5ef0 con 0x7f67ec06af70 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f09a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f09a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40304/0 (socket says 172.21.15.179:40304) 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f09a8700 1 -- 172.21.15.179:0/1597338741 learned_addr learned my addr 172.21.15.179:0/1597338741 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f19aa700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67ec161c70 0x7f67ec1f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f11a9700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 0x7f67ec1f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f09a8700 1 -- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 msgr2=0x7f67ec1f42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f09a8700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 0x7f67ec1f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f09a8700 1 -- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67ec161c70 msgr2=0x7f67ec1f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f09a8700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67ec161c70 0x7f67ec1f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f09a8700 1 -- 172.21.15.179:0/1597338741 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc009550 con 0x7f67ec161360 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.703+0000 7f67f19aa700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67ec161c70 0x7f67ec1f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.704+0000 7f67f09a8700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0b56f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f67e800d800 tx=0x7f67e800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.704+0000 7f67e1ffb700 1 -- 172.21.15.179:0/1597338741 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e80125f0 con 0x7f67ec161360 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.704+0000 7f67e1ffb700 1 -- 172.21.15.179:0/1597338741 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8012750 con 0x7f67ec161360 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.704+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec0b61d0 con 0x7f67ec161360 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.704+0000 7f67e1ffb700 1 -- 172.21.15.179:0/1597338741 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8012ae0 con 0x7f67ec161360 2023-12-07T00:14:58.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.704+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec0b6790 con 0x7f67ec161360 2023-12-07T00:14:58.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.705+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ec0cd210 con 0x7f67ec161360 2023-12-07T00:14:58.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.705+0000 7f67e1ffb700 1 -- 172.21.15.179:0/1597338741 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f67e8012c40 con 0x7f67ec161360 2023-12-07T00:14:58.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.705+0000 7f67e1ffb700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f67d006aed0 0x7f67d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:58.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.706+0000 7f67e1ffb700 1 -- 172.21.15.179:0/1597338741 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f67e8089c20 con 0x7f67ec161360 2023-12-07T00:14:58.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.706+0000 7f67f11a9700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f67d006aed0 0x7f67d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:58.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.706+0000 7f67f11a9700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f67d006aed0 0x7f67d006d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009c10 tx=0x7f67dc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:58.709 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.710+0000 7f67e1ffb700 1 -- 172.21.15.179:0/1597338741 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67e80549a0 con 0x7f67ec161360 2023-12-07T00:14:58.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.904+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f67ec0685f0 con 0x7f67ec161360 2023-12-07T00:14:58.904 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.905+0000 7f67e1ffb700 1 -- 172.21.15.179:0/1597338741 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f67e8057fc0 con 0x7f67ec161360 2023-12-07T00:14:58.904 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:58.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f67d006aed0 msgr2=0x7f67d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f67d006aed0 0x7f67d006d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009c10 tx=0x7f67dc008030 comp rx=0 tx=0).stop 2023-12-07T00:14:58.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 msgr2=0x7f67ec0b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0b56f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f67e800d800 tx=0x7f67e800dbc0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 shutdown_connections 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f67d006aed0 0x7f67d006d390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f67ec161c70 0x7f67ec1f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f67ec06af70 0x7f67ec1f42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 --2- 172.21.15.179:0/1597338741 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f67ec161360 0x7f67ec0b56f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 >> 172.21.15.179:0/1597338741 conn(0x7f67ec099a40 msgr2=0x7f67ec0ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 shutdown_connections 2023-12-07T00:14:58.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:58.907+0000 7f67f340d700 1 -- 172.21.15.179:0/1597338741 wait complete. 2023-12-07T00:14:58.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:14:59.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.042+0000 7f1b414fe700 1 Processor -- start 2023-12-07T00:14:59.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.042+0000 7f1b414fe700 1 -- start start 2023-12-07T00:14:59.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b414fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3c15de60 0x7f1b3c0b9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b414fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b3c0d1c00 0x7f1b3c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b414fe700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0b74d0 con 0x7f1b3c15da80 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b414fe700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b77b0 con 0x7f1b3c0d1c00 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b414fe700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b7a90 con 0x7f1b3c15de60 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b3affd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1b3c15da80 0x7f1b3c0b6c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47212/0 (socket says 172.21.15.179:47212) 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b3affd700 1 -- 172.21.15.179:0/324420891 learned_addr learned my addr 172.21.15.179:0/324420891 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b3a7fc700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3c15de60 0x7f1b3c0b9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b3b7fe700 1 --2- 172.21.15.179:0/324420891 >> v2:172.21.15.190:3300/0 conn(0x7f1b3c0d1c00 0x7f1b3c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437127917 0 0) 0x7f1b3c0b74d0 con 0x7f1b3c15da80 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.043+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b240035b0 con 0x7f1b3c15da80 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2081721421 0 0) 0x7f1b240035b0 con 0x7f1b3c15da80 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3c15de60 msgr2=0x7f1b3c0b9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3c15de60 0x7f1b3c0b9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 >> v2:172.21.15.190:3300/0 conn(0x7f1b3c0d1c00 msgr2=0x7f1b3c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 --2- 172.21.15.179:0/324420891 >> v2:172.21.15.190:3300/0 conn(0x7f1b3c0d1c00 0x7f1b3c0ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0b7d70 con 0x7f1b3c15da80 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f1b30001670 con 0x7f1b3c15da80 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 >> v1:172.21.15.179:6789/0 conn(0x7f1b3c15da80 legacy=0x7f1b3c0b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3c15de60 0x7f1b24003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b24003f80 0x7f1b24004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b24004d90 0x7f1b24005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b77b0 con 0x7f1b24003f80 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b7a90 con 0x7f1b24004d90 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2400ba40 con 0x7f1b3c15de60 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3a7fc700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b24003f80 0x7f1b24004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3affd700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3c15de60 0x7f1b24003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3b7fe700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b24004d90 0x7f1b24005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3a7fc700 1 -- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3c15de60 msgr2=0x7f1b24003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:59.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3a7fc700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3c15de60 0x7f1b24003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3a7fc700 1 -- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b24004d90 msgr2=0x7f1b24005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3a7fc700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b24004d90 0x7f1b24005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3a7fc700 1 -- 172.21.15.179:0/324420891 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240035b0 con 0x7f1b24003f80 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b3a7fc700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b24003f80 0x7f1b24004850 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009b60 tx=0x7f1b24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dc045e6fd5ea95 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00e6c0 con 0x7f1b24003f80 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00e820 con 0x7f1b24003f80 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.044+0000 7f1b39ffb700 1 -- 172.21.15.179:0/324420891 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00eb90 con 0x7f1b24003f80 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.045+0000 7f1b414fe700 1 -- 172.21.15.179:0/324420891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b24003f80 msgr2=0x7f1b24004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.045+0000 7f1b414fe700 1 --2- 172.21.15.179:0/324420891 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b24003f80 0x7f1b24004850 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009b60 tx=0x7f1b24005880 comp rx=0 tx=0).stop 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.045+0000 7f1b3b7fe700 1 -- 172.21.15.179:0/324420891 reap_dead start 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.045+0000 7f1b414fe700 1 -- 172.21.15.179:0/324420891 shutdown_connections 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.045+0000 7f1b414fe700 1 -- 172.21.15.179:0/324420891 >> 172.21.15.179:0/324420891 conn(0x7f1b3c072ac0 msgr2=0x7f1b3c072ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.045+0000 7f1b414fe700 1 -- 172.21.15.179:0/324420891 shutdown_connections 2023-12-07T00:14:59.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.045+0000 7f1b414fe700 1 -- 172.21.15.179:0/324420891 wait complete. 2023-12-07T00:14:59.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.046+0000 7f1b414fe700 1 Processor -- start 2023-12-07T00:14:59.049 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.046+0000 7f1b414fe700 1 -- start start 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b414fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b24003f80 0x7f1b3c154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b414fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3c15e300 0x7f1b3c15e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b414fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3c0cd230 0x7f1b3c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b414fe700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0cc220 con 0x7f1b3c15e300 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b414fe700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0ccda0 con 0x7f1b3c0cd230 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b414fe700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0cc470 con 0x7f1b24003f80 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b3a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3c15e300 0x7f1b3c15e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b3a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3c15e300 0x7f1b3c15e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40324/0 (socket says 172.21.15.179:40324) 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b3a7fc700 1 -- 172.21.15.179:0/2298681224 learned_addr learned my addr 172.21.15.179:0/2298681224 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b3a7fc700 1 -- 172.21.15.179:0/2298681224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b24003f80 msgr2=0x7f1b3c154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b3a7fc700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b24003f80 0x7f1b3c154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b3a7fc700 1 -- 172.21.15.179:0/2298681224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3c0cd230 msgr2=0x7f1b3c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b3a7fc700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3c0cd230 0x7f1b3c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.047+0000 7f1b3a7fc700 1 -- 172.21.15.179:0/2298681224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0cc750 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.048+0000 7f1b3a7fc700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3c15e300 0x7f1b3c15e780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00e4b0 tx=0x7f1b2c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.048+0000 7f1b237fe700 1 -- 172.21.15.179:0/2298681224 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c00e6c0 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.048+0000 7f1b237fe700 1 -- 172.21.15.179:0/2298681224 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c003ab0 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.048+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c0cc220 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.048+0000 7f1b237fe700 1 -- 172.21.15.179:0/2298681224 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c003e60 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.048+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c154cc0 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.049+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c154ee0 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.049+0000 7f1b237fe700 1 -- 172.21.15.179:0/2298681224 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b2c013470 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.050+0000 7f1b237fe700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b2806aed0 0x7f1b2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.050+0000 7f1b237fe700 1 -- 172.21.15.179:0/2298681224 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1b2c08b1e0 con 0x7f1b3c15e300 2023-12-07T00:14:59.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.050+0000 7f1b3affd700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b2806aed0 0x7f1b2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.053 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.050+0000 7f1b3affd700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b2806aed0 0x7f1b2806d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1b300014f0 tx=0x7f1b30000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.053 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.054+0000 7f1b237fe700 1 -- 172.21.15.179:0/2298681224 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b2c056130 con 0x7f1b3c15e300 2023-12-07T00:14:59.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.246+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b3c067ee0 con 0x7f1b3c15e300 2023-12-07T00:14:59.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.246+0000 7f1b237fe700 1 -- 172.21.15.179:0/2298681224 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b2c059750 con 0x7f1b3c15e300 2023-12-07T00:14:59.247 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:14:59.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b2806aed0 msgr2=0x7f1b2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b2806aed0 0x7f1b2806d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1b300014f0 tx=0x7f1b30000bc0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3c15e300 msgr2=0x7f1b3c15e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3c15e300 0x7f1b3c15e780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00e4b0 tx=0x7f1b2c0047c0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 shutdown_connections 2023-12-07T00:14:59.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b2806aed0 0x7f1b2806d390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3c0cd230 0x7f1b3c0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b24003f80 0x7f1b3c154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 --2- 172.21.15.179:0/2298681224 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b3c15e300 0x7f1b3c15e780 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 >> 172.21.15.179:0/2298681224 conn(0x7f1b3c072ac0 msgr2=0x7f1b3c0b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:59.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 shutdown_connections 2023-12-07T00:14:59.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.248+0000 7f1b414fe700 1 -- 172.21.15.179:0/2298681224 wait complete. 2023-12-07T00:14:59.259 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:14:59.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.384+0000 7f5211722700 1 Processor -- start 2023-12-07T00:14:59.383 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.384+0000 7f5211722700 1 -- start start 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5211722700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f520c161450 0x7f520c161830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5211722700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0b6dd0 con 0x7f520c0cf0a0 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5211722700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c162280 con 0x7f520c161d70 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5211722700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0d2370 con 0x7f520c161450 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f520b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f520c0cf0a0 0x7f520c0d2790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47232/0 (socket says 172.21.15.179:47232) 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f520b7fe700 1 -- 172.21.15.179:0/2247599872 learned_addr learned my addr 172.21.15.179:0/2247599872 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f520affd700 1 --2- 172.21.15.179:0/2247599872 >> v2:172.21.15.190:3300/0 conn(0x7f520c161450 0x7f520c161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784243885 0 0) 0x7f520c0b6dd0 con 0x7f520c0cf0a0 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f40035b0 con 0x7f520c0cf0a0 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333026546 0 0) 0x7f51f40035b0 con 0x7f520c0cf0a0 2023-12-07T00:14:59.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 >> v2:172.21.15.190:3300/0 conn(0x7f520c161450 msgr2=0x7f520c161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5209ffb700 1 --2- 172.21.15.179:0/2247599872 >> v2:172.21.15.190:3300/0 conn(0x7f520c161450 0x7f520c161830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.385+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 >> v1:172.21.15.190:6789/0 conn(0x7f520c161d70 legacy=0x7f520c0ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c162560 con 0x7f520c0cf0a0 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f52040019f0 con 0x7f520c0cf0a0 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 >> v1:172.21.15.179:6789/0 conn(0x7f520c0cf0a0 legacy=0x7f520c0d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51f4003a00 0x7f51f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f51f4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51f4005210 0x7f51f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0d2370 con 0x7f51f4004850 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400c1b0 con 0x7f51f4003a00 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400c370 con 0x7f51f4005210 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520a7fc700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f51f4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520affd700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51f4003a00 0x7f51f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520b7fe700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51f4005210 0x7f51f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520a7fc700 1 -- 172.21.15.179:0/2247599872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51f4005210 msgr2=0x7f51f400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:59.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520a7fc700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f51f4005210 0x7f51f400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520a7fc700 1 -- 172.21.15.179:0/2247599872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51f4003a00 msgr2=0x7f51f4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:59.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520a7fc700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f51f4003a00 0x7f51f4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520b7fe700 1 -- 172.21.15.179:0/2247599872 reap_dead start 2023-12-07T00:14:59.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520a7fc700 1 -- 172.21.15.179:0/2247599872 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f40035b0 con 0x7f51f4004850 2023-12-07T00:14:59.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f520a7fc700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f51f4004cd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0017c0 tx=0x7f51f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65dd3c8ea7f21d6c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0052d0 con 0x7f51f4004850 2023-12-07T00:14:59.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc005430 con 0x7f51f4004850 2023-12-07T00:14:59.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.386+0000 7f5209ffb700 1 -- 172.21.15.179:0/2247599872 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0038c0 con 0x7f51f4004850 2023-12-07T00:14:59.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.387+0000 7f5211722700 1 -- 172.21.15.179:0/2247599872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 msgr2=0x7f51f4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.387+0000 7f5211722700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f51f4004cd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0017c0 tx=0x7f51f4005880 comp rx=0 tx=0).stop 2023-12-07T00:14:59.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.387+0000 7f5211722700 1 -- 172.21.15.179:0/2247599872 shutdown_connections 2023-12-07T00:14:59.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.387+0000 7f5211722700 1 --2- 172.21.15.179:0/2247599872 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f51f4004cd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.387+0000 7f5211722700 1 -- 172.21.15.179:0/2247599872 >> 172.21.15.179:0/2247599872 conn(0x7f520c06cb70 msgr2=0x7f520c06cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:59.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.387+0000 7f5211722700 1 -- 172.21.15.179:0/2247599872 shutdown_connections 2023-12-07T00:14:59.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.387+0000 7f5211722700 1 -- 172.21.15.179:0/2247599872 wait complete. 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.389+0000 7f5211722700 1 Processor -- start 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.389+0000 7f5211722700 1 -- start start 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f5211722700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f520c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f5211722700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f520c0c8100 0x7f520c15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f5211722700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f520c0c9a90 0x7f520c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f5211722700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c158890 con 0x7f51f4004850 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f5211722700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0b3e10 con 0x7f520c0c8100 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f5211722700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0c8590 con 0x7f520c0c9a90 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f520c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f520c158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40342/0 (socket says 172.21.15.179:40342) 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 -- 172.21.15.179:0/2761047174 learned_addr learned my addr 172.21.15.179:0/2761047174 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:59.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520a7fc700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f520c0c8100 0x7f520c15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520b7fe700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f520c0c9a90 0x7f520c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 -- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f520c0c9a90 msgr2=0x7f520c15dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f520c0c9a90 0x7f520c15dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 -- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f520c0c8100 msgr2=0x7f520c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f520c0c8100 0x7f520c15d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 -- 172.21.15.179:0/2761047174 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0b37c0 con 0x7f51f4004850 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520b7fe700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f520c0c9a90 0x7f520c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f520affd700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f520c158350 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f52000119d0 tx=0x7f5200011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f51f37fe700 1 -- 172.21.15.179:0/2761047174 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200009630 con 0x7f51f4004850 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f51f37fe700 1 -- 172.21.15.179:0/2761047174 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200004240 con 0x7f51f4004850 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c0b3aa0 con 0x7f51f4004850 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f51f37fe700 1 -- 172.21.15.179:0/2761047174 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000f730 con 0x7f51f4004850 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.390+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c0ca0c0 con 0x7f51f4004850 2023-12-07T00:14:59.394 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.391+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c0b3620 con 0x7f51f4004850 2023-12-07T00:14:59.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.392+0000 7f51f37fe700 1 -- 172.21.15.179:0/2761047174 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f520000f890 con 0x7f51f4004850 2023-12-07T00:14:59.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.392+0000 7f51f37fe700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f51f806aed0 0x7f51f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.392+0000 7f520a7fc700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f51f806aed0 0x7f51f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.392+0000 7f51f37fe700 1 -- 172.21.15.179:0/2761047174 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5200089fc0 con 0x7f51f4004850 2023-12-07T00:14:59.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.393+0000 7f520a7fc700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f51f806aed0 0x7f51f806d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51fc005040 tx=0x7f51fc009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.395 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.397+0000 7f51f37fe700 1 -- 172.21.15.179:0/2761047174 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52000bce90 con 0x7f51f4004850 2023-12-07T00:14:59.583 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.584+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f520c0d1f10 con 0x7f51f4004850 2023-12-07T00:14:59.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.585+0000 7f51f37fe700 1 -- 172.21.15.179:0/2761047174 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f52000230a0 con 0x7f51f4004850 2023-12-07T00:14:59.584 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:14:59.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f51f806aed0 msgr2=0x7f51f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f51f806aed0 0x7f51f806d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f51fc005040 tx=0x7f51fc009030 comp rx=0 tx=0).stop 2023-12-07T00:14:59.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 msgr2=0x7f520c158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.586 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f520c158350 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f52000119d0 tx=0x7f5200011d90 comp rx=0 tx=0).stop 2023-12-07T00:14:59.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 shutdown_connections 2023-12-07T00:14:59.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f51f806aed0 0x7f51f806d390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f520c0c9a90 0x7f520c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51f4004850 0x7f520c158350 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 --2- 172.21.15.179:0/2761047174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f520c0c8100 0x7f520c15d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 >> 172.21.15.179:0/2761047174 conn(0x7f520c06cb70 msgr2=0x7f520c0cad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:59.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 shutdown_connections 2023-12-07T00:14:59.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.587+0000 7f5211722700 1 -- 172.21.15.179:0/2761047174 wait complete. 2023-12-07T00:14:59.627 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-07T00:14:59.628 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:14:59.749 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.750+0000 7f2f798f1700 1 Processor -- start 2023-12-07T00:14:59.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.750+0000 7f2f798f1700 1 -- start start 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.751+0000 7f2f798f1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2f7415de40 0x7f2f740b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.751+0000 7f2f798f1700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f7415f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.751+0000 7f2f798f1700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7415f330 con 0x7f2f7415e220 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.751+0000 7f2f798f1700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f740d1820 con 0x7f2f7415de40 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.751+0000 7f2f798f1700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7415e720 con 0x7f2f740b2c70 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f737fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f7415f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f72ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2f7415de40 0x7f2f740b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f737fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f7415f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:40768/0 (socket says 172.21.15.179:40768) 2023-12-07T00:14:59.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f72ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2f7415de40 0x7f2f740b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:42602/0 (socket says 172.21.15.179:42602) 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f727fc700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f2f7415e220 0x7f2f740b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:53932/0 (socket says 172.21.15.179:53932) 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f737fe700 1 -- 172.21.15.179:0/1176116398 learned_addr learned my addr 172.21.15.179:0/1176116398 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f737fe700 1 -- 172.21.15.179:0/1176116398 >> v2:172.21.15.190:3300/0 conn(0x7f2f7415de40 msgr2=0x7f2f740b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f737fe700 1 --2- 172.21.15.179:0/1176116398 >> v2:172.21.15.190:3300/0 conn(0x7f2f7415de40 0x7f2f740b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f737fe700 1 -- 172.21.15.179:0/1176116398 >> v1:172.21.15.190:6789/0 conn(0x7f2f7415e220 legacy=0x7f2f740b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f737fe700 1 -- 172.21.15.179:0/1176116398 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7415ea00 con 0x7f2f740b2c70 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f72ffd700 1 --2- 172.21.15.179:0/1176116398 >> v2:172.21.15.190:3300/0 conn(0x7f2f7415de40 0x7f2f740b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f737fe700 1 --2- 172.21.15.179:0/1176116398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f7415f870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009e50 tx=0x7f2f6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa700595b7413262 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f71ffb700 1 -- 172.21.15.179:0/1176116398 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00e070 con 0x7f2f740b2c70 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f71ffb700 1 -- 172.21.15.179:0/1176116398 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c00b910 con 0x7f2f740b2c70 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.752+0000 7f2f71ffb700 1 -- 172.21.15.179:0/1176116398 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c00bcc0 con 0x7f2f740b2c70 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.753+0000 7f2f798f1700 1 -- 172.21.15.179:0/1176116398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 msgr2=0x7f2f7415f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.753+0000 7f2f798f1700 1 --2- 172.21.15.179:0/1176116398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f7415f870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009e50 tx=0x7f2f6c00b330 comp rx=0 tx=0).stop 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.753+0000 7f2f798f1700 1 -- 172.21.15.179:0/1176116398 shutdown_connections 2023-12-07T00:14:59.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.753+0000 7f2f798f1700 1 --2- 172.21.15.179:0/1176116398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f7415f870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.753+0000 7f2f798f1700 1 --2- 172.21.15.179:0/1176116398 >> v2:172.21.15.190:3300/0 conn(0x7f2f7415de40 0x7f2f740b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.753+0000 7f2f798f1700 1 -- 172.21.15.179:0/1176116398 >> 172.21.15.179:0/1176116398 conn(0x7f2f74072970 msgr2=0x7f2f74072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:59.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.753+0000 7f2f798f1700 1 -- 172.21.15.179:0/1176116398 shutdown_connections 2023-12-07T00:14:59.754 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.753+0000 7f2f798f1700 1 -- 172.21.15.179:0/1176116398 wait complete. 2023-12-07T00:14:59.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.754+0000 7f2f798f1700 1 Processor -- start 2023-12-07T00:14:59.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.754+0000 7f2f798f1700 1 -- start start 2023-12-07T00:14:59.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f798f1700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f740cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f798f1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7415de40 0x7f2f741e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f798f1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7415e220 0x7f2f740cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f798f1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f741e7c10 con 0x7f2f7415de40 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f798f1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740cbda0 con 0x7f2f7415e220 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f798f1700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740cc080 con 0x7f2f740b2c70 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f727fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7415de40 0x7f2f741e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f727fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7415de40 0x7f2f741e76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40360/0 (socket says 172.21.15.179:40360) 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f727fc700 1 -- 172.21.15.179:0/678647782 learned_addr learned my addr 172.21.15.179:0/678647782 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f72ffd700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f740cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f737fe700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7415e220 0x7f2f740cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f727fc700 1 -- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 msgr2=0x7f2f740cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f727fc700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f740cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f727fc700 1 -- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7415e220 msgr2=0x7f2f740cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.755+0000 7f2f727fc700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7415e220 0x7f2f740cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.756+0000 7f2f727fc700 1 -- 172.21.15.179:0/678647782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680094a0 con 0x7f2f7415de40 2023-12-07T00:14:59.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.756+0000 7f2f737fe700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7415e220 0x7f2f740cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:14:59.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.756+0000 7f2f727fc700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7415de40 0x7f2f741e76d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c400 tx=0x7f2f6400c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.756+0000 7f2f5bfff700 1 -- 172.21.15.179:0/678647782 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f64005d00 con 0x7f2f7415de40 2023-12-07T00:14:59.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.756+0000 7f2f5bfff700 1 -- 172.21.15.179:0/678647782 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f64005e60 con 0x7f2f7415de40 2023-12-07T00:14:59.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.756+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c009b30 con 0x7f2f7415de40 2023-12-07T00:14:59.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.756+0000 7f2f5bfff700 1 -- 172.21.15.179:0/678647782 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f640072d0 con 0x7f2f7415de40 2023-12-07T00:14:59.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.756+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f740cc640 con 0x7f2f7415de40 2023-12-07T00:14:59.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.757+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7404f290 con 0x7f2f7415de40 2023-12-07T00:14:59.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.757+0000 7f2f5bfff700 1 -- 172.21.15.179:0/678647782 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f64007430 con 0x7f2f7415de40 2023-12-07T00:14:59.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.758+0000 7f2f5bfff700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2f6006aed0 0x7f2f6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:14:59.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.758+0000 7f2f5bfff700 1 -- 172.21.15.179:0/678647782 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f64088ba0 con 0x7f2f7415de40 2023-12-07T00:14:59.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.758+0000 7f2f72ffd700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2f6006aed0 0x7f2f6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:14:59.759 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.758+0000 7f2f72ffd700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2f6006aed0 0x7f2f6006d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009d70 tx=0x7f2f68009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:14:59.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.762+0000 7f2f5bfff700 1 -- 172.21.15.179:0/678647782 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f64053930 con 0x7f2f7415de40 2023-12-07T00:14:59.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.950+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f740685f0 con 0x7f2f7415de40 2023-12-07T00:14:59.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.952+0000 7f2f5bfff700 1 -- 172.21.15.179:0/678647782 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7f2f64017020 con 0x7f2f7415de40 2023-12-07T00:14:59.952 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:14:59.952 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:14:59.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2f6006aed0 msgr2=0x7f2f6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2f6006aed0 0x7f2f6006d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009d70 tx=0x7f2f68009210 comp rx=0 tx=0).stop 2023-12-07T00:14:59.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7415de40 msgr2=0x7f2f741e76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:14:59.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7415de40 0x7f2f741e76d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c400 tx=0x7f2f6400c710 comp rx=0 tx=0).stop 2023-12-07T00:14:59.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 shutdown_connections 2023-12-07T00:14:59.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2f6006aed0 0x7f2f6006d390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7415e220 0x7f2f740cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f740b2c70 0x7f2f740cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 --2- 172.21.15.179:0/678647782 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2f7415de40 0x7f2f741e76d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:14:59.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 >> 172.21.15.179:0/678647782 conn(0x7f2f74072970 msgr2=0x7f2f740b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:14:59.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 shutdown_connections 2023-12-07T00:14:59.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:14:59.954+0000 7f2f798f1700 1 -- 172.21.15.179:0/678647782 wait complete. 2023-12-07T00:14:59.965 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:14:59.966 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:15:00.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.090+0000 7f5167fd4700 1 Processor -- start 2023-12-07T00:15:00.089 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.090+0000 7f5167fd4700 1 -- start start 2023-12-07T00:15:00.091 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5167fd4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f516015de50 0x7f51600cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5167fd4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51600ccc90 0x7f516006af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5167fd4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51600cc550 con 0x7f516006b4b0 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5167fd4700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516006b960 con 0x7f51600ccc90 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5167fd4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51600cd1c0 con 0x7f516015de50 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f516556f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51600ccc90 0x7f516006af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f516556f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f51600ccc90 0x7f516006af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40364/0 (socket says 172.21.15.179:40364) 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5166571700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f516006b4b0 0x7f51601619b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47270/0 (socket says 172.21.15.179:47270) 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f516556f700 1 -- 172.21.15.179:0/3984318324 learned_addr learned my addr 172.21.15.179:0/3984318324 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5165d70700 1 --2- 172.21.15.179:0/3984318324 >> v2:172.21.15.190:3300/0 conn(0x7f516015de50 0x7f51600cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f516556f700 1 -- 172.21.15.179:0/3984318324 >> v2:172.21.15.190:3300/0 conn(0x7f516015de50 msgr2=0x7f51600cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f516556f700 1 --2- 172.21.15.179:0/3984318324 >> v2:172.21.15.190:3300/0 conn(0x7f516015de50 0x7f51600cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f516556f700 1 -- 172.21.15.179:0/3984318324 >> v1:172.21.15.179:6789/0 conn(0x7f516006b4b0 legacy=0x7f51601619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5164d6e700 1 -- 172.21.15.179:0/3984318324 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1506597585 0 0) 0x7f51600cc550 con 0x7f516006b4b0 2023-12-07T00:15:00.092 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f516556f700 1 -- 172.21.15.179:0/3984318324 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600cd4a0 con 0x7f51600ccc90 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f5165d70700 1 --2- 172.21.15.179:0/3984318324 >> v2:172.21.15.190:3300/0 conn(0x7f516015de50 0x7f51600cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.091+0000 7f516556f700 1 --2- 172.21.15.179:0/3984318324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f516006af70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f51600b0170 tx=0x7f5150009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27379ce4cb8f77e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5164d6e700 1 -- 172.21.15.179:0/3984318324 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515000b870 con 0x7f51600ccc90 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5164d6e700 1 -- 172.21.15.179:0/3984318324 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515000b9d0 con 0x7f51600ccc90 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5164d6e700 1 -- 172.21.15.179:0/3984318324 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515000bd60 con 0x7f51600ccc90 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5167fd4700 1 -- 172.21.15.179:0/3984318324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 msgr2=0x7f516006af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3984318324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f516006af70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f51600b0170 tx=0x7f5150009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5167fd4700 1 -- 172.21.15.179:0/3984318324 shutdown_connections 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3984318324 >> v2:172.21.15.190:3300/0 conn(0x7f516015de50 0x7f51600cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3984318324 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f516006af70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5167fd4700 1 -- 172.21.15.179:0/3984318324 >> 172.21.15.179:0/3984318324 conn(0x7f5160099a40 msgr2=0x7f5160099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5167fd4700 1 -- 172.21.15.179:0/3984318324 shutdown_connections 2023-12-07T00:15:00.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.092+0000 7f5167fd4700 1 -- 172.21.15.179:0/3984318324 wait complete. 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.094+0000 7f5167fd4700 1 Processor -- start 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.094+0000 7f5167fd4700 1 -- start start 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5167fd4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516006b4b0 0x7f5160144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5167fd4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f51600c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5167fd4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516015de50 0x7f5160146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5167fd4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51601f33e0 con 0x7f51600ccc90 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5167fd4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51600c6e80 con 0x7f516006b4b0 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5167fd4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51600b66c0 con 0x7f516015de50 2023-12-07T00:15:00.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f51600c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f51600c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40372/0 (socket says 172.21.15.179:40372) 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 -- 172.21.15.179:0/3434932215 learned_addr learned my addr 172.21.15.179:0/3434932215 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5165d70700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516006b4b0 0x7f5160144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5166571700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516015de50 0x7f5160146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 -- 172.21.15.179:0/3434932215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516015de50 msgr2=0x7f5160146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516015de50 0x7f5160146ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 -- 172.21.15.179:0/3434932215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516006b4b0 msgr2=0x7f5160144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516006b4b0 0x7f5160144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 -- 172.21.15.179:0/3434932215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5150009550 con 0x7f51600ccc90 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f516556f700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f51600c45b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5150009c10 tx=0x7f5150004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f51567fc700 1 -- 172.21.15.179:0/3434932215 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5150004460 con 0x7f51600ccc90 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f51567fc700 1 -- 172.21.15.179:0/3434932215 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51500045c0 con 0x7f51600ccc90 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.095+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51600c7100 con 0x7f51600ccc90 2023-12-07T00:15:00.097 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.096+0000 7f51567fc700 1 -- 172.21.15.179:0/3434932215 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51500038a0 con 0x7f51600ccc90 2023-12-07T00:15:00.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.096+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516015b230 con 0x7f51600ccc90 2023-12-07T00:15:00.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.096+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516015b3c0 con 0x7f51600ccc90 2023-12-07T00:15:00.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.097+0000 7f51567fc700 1 -- 172.21.15.179:0/3434932215 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5150021070 con 0x7f51600ccc90 2023-12-07T00:15:00.098 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.097+0000 7f51567fc700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f514406aed0 0x7f514406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.098+0000 7f5165d70700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f514406aed0 0x7f514406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.098+0000 7f51567fc700 1 -- 172.21.15.179:0/3434932215 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f515008b040 con 0x7f51600ccc90 2023-12-07T00:15:00.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.098+0000 7f5165d70700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f514406aed0 0x7f514406d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f51600d1800 tx=0x7f515c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.102+0000 7f51567fc700 1 -- 172.21.15.179:0/3434932215 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5150055ca0 con 0x7f51600ccc90 2023-12-07T00:15:00.290 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.291+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f51600685f0 con 0x7f51600ccc90 2023-12-07T00:15:00.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.292+0000 7f51567fc700 1 -- 172.21.15.179:0/3434932215 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51500592c0 con 0x7f51600ccc90 2023-12-07T00:15:00.291 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f514406aed0 msgr2=0x7f514406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f514406aed0 0x7f514406d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f51600d1800 tx=0x7f515c008040 comp rx=0 tx=0).stop 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 msgr2=0x7f51600c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f51600c45b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5150009c10 tx=0x7f5150004750 comp rx=0 tx=0).stop 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 shutdown_connections 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f514406aed0 0x7f514406d390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f516015de50 0x7f5160146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f516006b4b0 0x7f5160144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 --2- 172.21.15.179:0/3434932215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f51600ccc90 0x7f51600c45b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.293 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 >> 172.21.15.179:0/3434932215 conn(0x7f5160099a40 msgr2=0x7f516006ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:00.294 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 shutdown_connections 2023-12-07T00:15:00.294 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.294+0000 7f5167fd4700 1 -- 172.21.15.179:0/3434932215 wait complete. 2023-12-07T00:15:00.306 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:15:00.429 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.430+0000 7febf45b0700 1 Processor -- start 2023-12-07T00:15:00.429 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.430+0000 7febf45b0700 1 -- start start 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf45b0700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7febec15de50 0x7febec0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf45b0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7febec06b680 0x7febec0cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf45b0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec0cc550 con 0x7febec0ccc90 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf45b0700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec0cd1c0 con 0x7febec15de50 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf45b0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec0cd4a0 con 0x7febec06b680 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf234c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7febec15de50 0x7febec0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf234c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7febec15de50 0x7febec0cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40378/0 (socket says 172.21.15.179:40378) 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf234c700 1 -- 172.21.15.179:0/954367922 learned_addr learned my addr 172.21.15.179:0/954367922 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf2b4d700 1 --2- 172.21.15.179:0/954367922 >> v2:172.21.15.190:3300/0 conn(0x7febec06b680 0x7febec0cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf234c700 1 -- 172.21.15.179:0/954367922 >> v2:172.21.15.190:3300/0 conn(0x7febec06b680 msgr2=0x7febec0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf234c700 1 --2- 172.21.15.179:0/954367922 >> v2:172.21.15.190:3300/0 conn(0x7febec06b680 0x7febec0cfab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf234c700 1 -- 172.21.15.179:0/954367922 >> v1:172.21.15.190:6789/0 conn(0x7febec0ccc90 legacy=0x7febec06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:00.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf234c700 1 -- 172.21.15.179:0/954367922 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0cd780 con 0x7febec15de50 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf234c700 1 --2- 172.21.15.179:0/954367922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec15de50 0x7febec0cc010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febec0ce790 tx=0x7febe8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4172f366c03360 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf134a700 1 -- 172.21.15.179:0/954367922 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8004230 con 0x7febec15de50 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf134a700 1 -- 172.21.15.179:0/954367922 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe8004390 con 0x7febec15de50 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.431+0000 7febf134a700 1 -- 172.21.15.179:0/954367922 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe80036a0 con 0x7febec15de50 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.432+0000 7febf45b0700 1 -- 172.21.15.179:0/954367922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec15de50 msgr2=0x7febec0cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.432+0000 7febf45b0700 1 --2- 172.21.15.179:0/954367922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec15de50 0x7febec0cc010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7febec0ce790 tx=0x7febe8009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.432+0000 7febf45b0700 1 -- 172.21.15.179:0/954367922 shutdown_connections 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.432+0000 7febf45b0700 1 --2- 172.21.15.179:0/954367922 >> v2:172.21.15.190:3300/0 conn(0x7febec06b680 0x7febec0cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.432+0000 7febf45b0700 1 --2- 172.21.15.179:0/954367922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec15de50 0x7febec0cc010 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.432+0000 7febf45b0700 1 -- 172.21.15.179:0/954367922 >> 172.21.15.179:0/954367922 conn(0x7febec099a40 msgr2=0x7febec099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.432+0000 7febf45b0700 1 -- 172.21.15.179:0/954367922 shutdown_connections 2023-12-07T00:15:00.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.432+0000 7febf45b0700 1 -- 172.21.15.179:0/954367922 wait complete. 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.433+0000 7febf45b0700 1 Processor -- start 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.433+0000 7febf45b0700 1 -- start start 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf45b0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec06b680 0x7febec14f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf45b0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febec0ccc90 0x7febec158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf45b0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7febec15de50 0x7febec0b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf45b0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec14fb40 con 0x7febec06b680 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf45b0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec1572c0 con 0x7febec0ccc90 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf45b0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec157560 con 0x7febec15de50 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf234c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec06b680 0x7febec14f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf234c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec06b680 0x7febec14f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40384/0 (socket says 172.21.15.179:40384) 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf234c700 1 -- 172.21.15.179:0/3616799897 learned_addr learned my addr 172.21.15.179:0/3616799897 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf234c700 1 -- 172.21.15.179:0/3616799897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7febec15de50 msgr2=0x7febec0b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf234c700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7febec15de50 0x7febec0b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf234c700 1 -- 172.21.15.179:0/3616799897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febec0ccc90 msgr2=0x7febec158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf1b4b700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febec0ccc90 0x7febec158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf234c700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febec0ccc90 0x7febec158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.434+0000 7febf234c700 1 -- 172.21.15.179:0/3616799897 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe8009550 con 0x7febec06b680 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.435+0000 7febf234c700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec06b680 0x7febec14f600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7febe8009130 tx=0x7febe8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.435+0000 7febe2ffd700 1 -- 172.21.15.179:0/3616799897 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8011630 con 0x7febec06b680 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.435+0000 7febe2ffd700 1 -- 172.21.15.179:0/3616799897 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe8011790 con 0x7febec06b680 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.435+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec157840 con 0x7febec06b680 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.435+0000 7febe2ffd700 1 -- 172.21.15.179:0/3616799897 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe8011b00 con 0x7febec06b680 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.435+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec157e00 con 0x7febec06b680 2023-12-07T00:15:00.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.436+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec0685f0 con 0x7febec06b680 2023-12-07T00:15:00.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.436+0000 7febe2ffd700 1 -- 172.21.15.179:0/3616799897 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7febe8011c60 con 0x7febec06b680 2023-12-07T00:15:00.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.436+0000 7febe2ffd700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febd006aed0 0x7febd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.436+0000 7febe2ffd700 1 -- 172.21.15.179:0/3616799897 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7febe808afc0 con 0x7febec06b680 2023-12-07T00:15:00.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.437+0000 7febf1b4b700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febd006aed0 0x7febd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.437+0000 7febf1b4b700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febd006aed0 0x7febd006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7febec072e10 tx=0x7febdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.441+0000 7febe2ffd700 1 -- 172.21.15.179:0/3616799897 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7febe80bde90 con 0x7febec06b680 2023-12-07T00:15:00.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.631+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febec0b69d0 con 0x7febec06b680 2023-12-07T00:15:00.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.632+0000 7febe2ffd700 1 -- 172.21.15.179:0/3616799897 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7febe8028020 con 0x7febec06b680 2023-12-07T00:15:00.631 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:00.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febd006aed0 msgr2=0x7febd006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.633 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febd006aed0 0x7febd006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7febec072e10 tx=0x7febdc009040 comp rx=0 tx=0).stop 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec06b680 msgr2=0x7febec14f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec06b680 0x7febec14f600 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7febe8009130 tx=0x7febe8004750 comp rx=0 tx=0).stop 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 shutdown_connections 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febd006aed0 0x7febd006d390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7febec15de50 0x7febec0b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7febec06b680 0x7febec14f600 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 --2- 172.21.15.179:0/3616799897 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7febec0ccc90 0x7febec158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 >> 172.21.15.179:0/3616799897 conn(0x7febec099a40 msgr2=0x7febec06af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 shutdown_connections 2023-12-07T00:15:00.634 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.634+0000 7febf45b0700 1 -- 172.21.15.179:0/3616799897 wait complete. 2023-12-07T00:15:00.645 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:15:00.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.769+0000 7ffbbcf87700 1 Processor -- start 2023-12-07T00:15:00.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.769+0000 7ffbbcf87700 1 -- start start 2023-12-07T00:15:00.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbbcf87700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbb806b680 0x7ffbb80cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbbcf87700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffbb8161c70 0x7ffbb8162090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbbcf87700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb80cb0f0 con 0x7ffbb8161360 2023-12-07T00:15:00.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbbcf87700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb8161740 con 0x7ffbb806b680 2023-12-07T00:15:00.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbbcf87700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb80cb340 con 0x7ffbb8161c70 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb5d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbb806b680 0x7ffbb80cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb5d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbb806b680 0x7ffbb80cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40394/0 (socket says 172.21.15.179:40394) 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb5d9b700 1 -- 172.21.15.179:0/4227822906 learned_addr learned my addr 172.21.15.179:0/4227822906 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb5d9b700 1 -- 172.21.15.179:0/4227822906 >> v2:172.21.15.190:3300/0 conn(0x7ffbb8161c70 msgr2=0x7ffbb8162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb5d9b700 1 --2- 172.21.15.179:0/4227822906 >> v2:172.21.15.190:3300/0 conn(0x7ffbb8161c70 0x7ffbb8162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb5d9b700 1 -- 172.21.15.179:0/4227822906 >> v1:172.21.15.190:6789/0 conn(0x7ffbb8161360 legacy=0x7ffbb806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb5d9b700 1 -- 172.21.15.179:0/4227822906 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb80cb620 con 0x7ffbb806b680 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb5d9b700 1 --2- 172.21.15.179:0/4227822906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb806b680 0x7ffbb80cc100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80c7af0 tx=0x7ffbac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923b51f7201977f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb559a700 1 -- 172.21.15.179:0/4227822906 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac004230 con 0x7ffbb806b680 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb559a700 1 -- 172.21.15.179:0/4227822906 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac004390 con 0x7ffbb806b680 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.770+0000 7ffbb559a700 1 -- 172.21.15.179:0/4227822906 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0036a0 con 0x7ffbb806b680 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.771+0000 7ffbbcf87700 1 -- 172.21.15.179:0/4227822906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb806b680 msgr2=0x7ffbb80cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.771+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/4227822906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb806b680 0x7ffbb80cc100 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffbb80c7af0 tx=0x7ffbac009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.771+0000 7ffbbcf87700 1 -- 172.21.15.179:0/4227822906 shutdown_connections 2023-12-07T00:15:00.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.771+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/4227822906 >> v2:172.21.15.190:3300/0 conn(0x7ffbb8161c70 0x7ffbb8162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.771+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/4227822906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb806b680 0x7ffbb80cc100 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.771+0000 7ffbbcf87700 1 -- 172.21.15.179:0/4227822906 >> 172.21.15.179:0/4227822906 conn(0x7ffbb8099a40 msgr2=0x7ffbb8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:00.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.771+0000 7ffbbcf87700 1 -- 172.21.15.179:0/4227822906 shutdown_connections 2023-12-07T00:15:00.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.771+0000 7ffbbcf87700 1 -- 172.21.15.179:0/4227822906 wait complete. 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.772+0000 7ffbbcf87700 1 Processor -- start 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.772+0000 7ffbbcf87700 1 -- start start 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbbcf87700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbb806b680 0x7ffbb80b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbbcf87700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb8161360 0x7ffbb80ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbbcf87700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffbb8161c70 0x7ffbb8155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbbcf87700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80b4c20 con 0x7ffbb8161360 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbbcf87700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb815a2a0 con 0x7ffbb806b680 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbbcf87700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb815ef10 con 0x7ffbb8161c70 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbb5d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb8161360 0x7ffbb80ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbb5d9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb8161360 0x7ffbb80ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40400/0 (socket says 172.21.15.179:40400) 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbb5d9b700 1 -- 172.21.15.179:0/1632115778 learned_addr learned my addr 172.21.15.179:0/1632115778 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbb659c700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbb806b680 0x7ffbb80b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.773+0000 7ffbb6d9d700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffbb8161c70 0x7ffbb8155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbb5d9b700 1 -- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffbb8161c70 msgr2=0x7ffbb8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbb5d9b700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffbb8161c70 0x7ffbb8155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbb5d9b700 1 -- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbb806b680 msgr2=0x7ffbb80b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbb5d9b700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbb806b680 0x7ffbb80b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbb5d9b700 1 -- 172.21.15.179:0/1632115778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac009550 con 0x7ffbb8161360 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbb659c700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbb806b680 0x7ffbb80b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbb5d9b700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb8161360 0x7ffbb80ae450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009130 tx=0x7ffbac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffba6ffd700 1 -- 172.21.15.179:0/1632115778 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011630 con 0x7ffbb8161360 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffba6ffd700 1 -- 172.21.15.179:0/1632115778 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac011790 con 0x7ffbb8161360 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffba6ffd700 1 -- 172.21.15.179:0/1632115778 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac011b00 con 0x7ffbb8161360 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb815f1f0 con 0x7ffbb8161360 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.774+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb80ae990 con 0x7ffbb8161360 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.775+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb80685f0 con 0x7ffbb8161360 2023-12-07T00:15:00.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.775+0000 7ffba6ffd700 1 -- 172.21.15.179:0/1632115778 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffbac011c60 con 0x7ffbb8161360 2023-12-07T00:15:00.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.776+0000 7ffba6ffd700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffb9806aed0 0x7ffb9806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:00.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.776+0000 7ffba6ffd700 1 -- 172.21.15.179:0/1632115778 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffbac08b020 con 0x7ffbb8161360 2023-12-07T00:15:00.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.776+0000 7ffbb659c700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffb9806aed0 0x7ffb9806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:00.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.776+0000 7ffbb659c700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffb9806aed0 0x7ffb9806d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009910 tx=0x7ffba8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:00.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.780+0000 7ffba6ffd700 1 -- 172.21.15.179:0/1632115778 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffbac055d20 con 0x7ffbb8161360 2023-12-07T00:15:00.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.969+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffbb815f710 con 0x7ffbb8161360 2023-12-07T00:15:00.969 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.969+0000 7ffba6ffd700 1 -- 172.21.15.179:0/1632115778 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffbb815f710 con 0x7ffbb8161360 2023-12-07T00:15:00.969 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffb9806aed0 msgr2=0x7ffb9806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffb9806aed0 0x7ffb9806d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009910 tx=0x7ffba8008040 comp rx=0 tx=0).stop 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb8161360 msgr2=0x7ffbb80ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb8161360 0x7ffbb80ae450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffbac009130 tx=0x7ffbac004750 comp rx=0 tx=0).stop 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 shutdown_connections 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffb9806aed0 0x7ffb9806d390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffbb8161c70 0x7ffbb8155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffbb806b680 0x7ffbb80b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.971+0000 7ffbbcf87700 1 --2- 172.21.15.179:0/1632115778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb8161360 0x7ffbb80ae450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:00.971 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.972+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 >> 172.21.15.179:0/1632115778 conn(0x7ffbb8099a40 msgr2=0x7ffbb80cfa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:00.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.972+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 shutdown_connections 2023-12-07T00:15:00.972 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:00.972+0000 7ffbbcf87700 1 -- 172.21.15.179:0/1632115778 wait complete. 2023-12-07T00:15:00.983 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:15:01.105 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.106+0000 7fc33e751700 1 Processor -- start 2023-12-07T00:15:01.105 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.106+0000 7fc33e751700 1 -- start start 2023-12-07T00:15:01.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.106+0000 7fc33e751700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815ab70 0x7fc338070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.106+0000 7fc33e751700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc3380d0ed0 0x7fc3380adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.106+0000 7fc33e751700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33806f960 con 0x7fc3380ce770 2023-12-07T00:15:01.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc33e751700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33815af50 con 0x7fc3380d0ed0 2023-12-07T00:15:01.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc33e751700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33806fc40 con 0x7fc33815ab70 2023-12-07T00:15:01.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc3377fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc3380ce770 0x7fc3380d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47310/0 (socket says 172.21.15.179:47310) 2023-12-07T00:15:01.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc3377fe700 1 -- 172.21.15.179:0/3056448622 learned_addr learned my addr 172.21.15.179:0/3056448622 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc33ccee700 1 --2- 172.21.15.179:0/3056448622 >> v2:172.21.15.190:3300/0 conn(0x7fc3380d0ed0 0x7fc3380adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc337fff700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815ab70 0x7fc338070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906941786 0 0) 0x7fc33806f960 con 0x7fc3380ce770 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3200035b0 con 0x7fc3380ce770 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1280999329 0 0) 0x7fc3200035b0 con 0x7fc3380ce770 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815ab70 msgr2=0x7fc338070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815ab70 0x7fc338070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 >> v2:172.21.15.190:3300/0 conn(0x7fc3380d0ed0 msgr2=0x7fc3380adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 --2- 172.21.15.179:0/3056448622 >> v2:172.21.15.190:3300/0 conn(0x7fc3380d0ed0 0x7fc3380adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3380cf110 con 0x7fc3380ce770 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fc328001670 con 0x7fc3380ce770 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 >> v1:172.21.15.179:6789/0 conn(0x7fc3380ce770 legacy=0x7fc3380d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc320003a00 0x7fc320003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815ab70 0x7fc320004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc320004d90 0x7fc320005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33815af50 con 0x7fc320004d90 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33806fc40 con 0x7fc320003a00 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32000ba90 con 0x7fc33815ab70 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc337fff700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc320003a00 0x7fc320003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc33ccee700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc320004d90 0x7fc320005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.107+0000 7fc3377fe700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815ab70 0x7fc320004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc33ccee700 1 -- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815ab70 msgr2=0x7fc320004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc33ccee700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815ab70 0x7fc320004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc33ccee700 1 -- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc320003a00 msgr2=0x7fc320003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc33ccee700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc320003a00 0x7fc320003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc33ccee700 1 -- 172.21.15.179:0/3056448622 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3200035b0 con 0x7fc320004d90 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc337fff700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc320003a00 0x7fc320003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc33ccee700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc320004d90 0x7fc320005210 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc330009f90 tx=0x7fc320005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4bc74068def10e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:01.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33000ec30 con 0x7fc320004d90 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33000f040 con 0x7fc320004d90 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc336ffd700 1 -- 172.21.15.179:0/3056448622 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330014480 con 0x7fc320004d90 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc33e751700 1 -- 172.21.15.179:0/3056448622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc320004d90 msgr2=0x7fc320005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.108+0000 7fc33e751700 1 --2- 172.21.15.179:0/3056448622 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc320004d90 0x7fc320005210 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc330009f90 tx=0x7fc320005880 comp rx=0 tx=0).stop 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.109+0000 7fc33ccee700 1 -- 172.21.15.179:0/3056448622 reap_dead start 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.109+0000 7fc33e751700 1 -- 172.21.15.179:0/3056448622 shutdown_connections 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.109+0000 7fc33e751700 1 -- 172.21.15.179:0/3056448622 >> 172.21.15.179:0/3056448622 conn(0x7fc338099a40 msgr2=0x7fc338099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.109+0000 7fc33e751700 1 -- 172.21.15.179:0/3056448622 shutdown_connections 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.109+0000 7fc33e751700 1 -- 172.21.15.179:0/3056448622 wait complete. 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.110+0000 7fc33e751700 1 Processor -- start 2023-12-07T00:15:01.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.110+0000 7fc33e751700 1 -- start start 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33e751700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33814f070 0x7fc33815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33e751700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815b5d0 0x7fc3380c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33e751700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33814f450 0x7fc3380c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33e751700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380b6720 con 0x7fc33814f450 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33e751700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380cdac0 con 0x7fc33814f070 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33e751700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3380b5fd0 con 0x7fc33815b5d0 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33814f450 0x7fc3380c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33814f450 0x7fc3380c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40422/0 (socket says 172.21.15.179:40422) 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 -- 172.21.15.179:0/2807181493 learned_addr learned my addr 172.21.15.179:0/2807181493 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc337fff700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33814f070 0x7fc33815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc3377fe700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815b5d0 0x7fc3380c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 -- 172.21.15.179:0/2807181493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815b5d0 msgr2=0x7fc3380c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815b5d0 0x7fc3380c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 -- 172.21.15.179:0/2807181493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33814f070 msgr2=0x7fc33815b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33814f070 0x7fc33815b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 -- 172.21.15.179:0/2807181493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3380ce2b0 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc33ccee700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33814f450 0x7fc3380c6ba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc33000e700 tx=0x7fc330009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.111+0000 7fc334ff9700 1 -- 172.21.15.179:0/2807181493 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330007000 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.112+0000 7fc334ff9700 1 -- 172.21.15.179:0/2807181493 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc330020e60 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.112+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3380cdcf0 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.112+0000 7fc334ff9700 1 -- 172.21.15.179:0/2807181493 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc330003c60 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.112+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3380c6160 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.113+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3380c62f0 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.113+0000 7fc334ff9700 1 -- 172.21.15.179:0/2807181493 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc330004030 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.113+0000 7fc334ff9700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc32406aed0 0x7fc32406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.113+0000 7fc334ff9700 1 -- 172.21.15.179:0/2807181493 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc33008ce50 con 0x7fc33814f450 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.113+0000 7fc337fff700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc32406aed0 0x7fc32406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.114+0000 7fc337fff700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc32406aed0 0x7fc32406d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc33815e3e0 tx=0x7fc32c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:01.117 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.118+0000 7fc334ff9700 1 -- 172.21.15.179:0/2807181493 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc330057c90 con 0x7fc33814f450 2023-12-07T00:15:01.307 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.307+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc33806f560 con 0x7fc33814f450 2023-12-07T00:15:01.307 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.308+0000 7fc334ff9700 1 -- 172.21.15.179:0/2807181493 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc33005b2b0 con 0x7fc33814f450 2023-12-07T00:15:01.307 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:01.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc32406aed0 msgr2=0x7fc32406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.309 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc32406aed0 0x7fc32406d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc33815e3e0 tx=0x7fc32c009210 comp rx=0 tx=0).stop 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33814f450 msgr2=0x7fc3380c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33814f450 0x7fc3380c6ba0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc33000e700 tx=0x7fc330009750 comp rx=0 tx=0).stop 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 shutdown_connections 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc32406aed0 0x7fc32406d390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc33814f450 0x7fc3380c6ba0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc33814f070 0x7fc33815b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 --2- 172.21.15.179:0/2807181493 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc33815b5d0 0x7fc3380c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 >> 172.21.15.179:0/2807181493 conn(0x7fc338099a40 msgr2=0x7fc3381555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 shutdown_connections 2023-12-07T00:15:01.310 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.310+0000 7fc33e751700 1 -- 172.21.15.179:0/2807181493 wait complete. 2023-12-07T00:15:01.322 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-12-07T00:15:01.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.443+0000 7f5376d1f700 1 Processor -- start 2023-12-07T00:15:01.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.443+0000 7f5376d1f700 1 -- start start 2023-12-07T00:15:01.446 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f5376d1f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 0x7f53700b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.446 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f5376d1f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537015f330 con 0x7f537015de40 2023-12-07T00:15:01.446 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f5376d1f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f537015e720 con 0x7f53700b2aa0 2023-12-07T00:15:01.446 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f5376d1f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700d1820 con 0x7f537015e220 2023-12-07T00:15:01.446 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f5374abb700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f537015de40 0x7f53700b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47328/0 (socket says 172.21.15.179:47328) 2023-12-07T00:15:01.446 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f5374abb700 1 -- 172.21.15.179:0/275898204 learned_addr learned my addr 172.21.15.179:0/275898204 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:01.446 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240695275 0 0) 0x7f537015f330 con 0x7f537015de40 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f536ffff700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 0x7f53700b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.444+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53600035b0 con 0x7f537015de40 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208439153 0 0) 0x7f537015e720 con 0x7f53700b2aa0 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f537015f330 con 0x7f53700b2aa0 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 308460987 0 0) 0x7f53600035b0 con 0x7f537015de40 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 msgr2=0x7f53700b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 0x7f53700b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 >> v1:172.21.15.190:6789/0 conn(0x7f53700b2aa0 legacy=0x7f537015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537015ea00 con 0x7f537015de40 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f5364001670 con 0x7f537015de40 2023-12-07T00:15:01.447 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 >> v1:172.21.15.179:6789/0 conn(0x7f537015de40 legacy=0x7f53700b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 0x7f5360003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5360004120 0x7f5360004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5360004d90 0x7f5360005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536000bac0 con 0x7f5360004d90 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536000bc30 con 0x7f5360004120 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536000bdf0 con 0x7f537015e220 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f53752bc700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5360004d90 0x7f5360005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536ffff700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5360004120 0x7f5360004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f5374abb700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 0x7f5360003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f53752bc700 1 -- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 msgr2=0x7f5360003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f53752bc700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 0x7f5360003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f53752bc700 1 -- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5360004120 msgr2=0x7f5360004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f53752bc700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5360004120 0x7f5360004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f53752bc700 1 -- 172.21.15.179:0/275898204 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600035b0 con 0x7f5360004d90 2023-12-07T00:15:01.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f5374abb700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f537015e220 0x7f5360003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f53752bc700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5360004d90 0x7f5360005210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f536800c2f0 tx=0x7f5360005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0783c0c8994d2c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368001f30 con 0x7f5360004d90 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536800ce90 con 0x7f5360004d90 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.445+0000 7f536f7fe700 1 -- 172.21.15.179:0/275898204 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5368003c40 con 0x7f5360004d90 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.446+0000 7f5376d1f700 1 -- 172.21.15.179:0/275898204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5360004d90 msgr2=0x7f5360005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.446+0000 7f5376d1f700 1 --2- 172.21.15.179:0/275898204 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5360004d90 0x7f5360005210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f536800c2f0 tx=0x7f5360005880 comp rx=0 tx=0).stop 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.446+0000 7f53752bc700 1 -- 172.21.15.179:0/275898204 reap_dead start 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.446+0000 7f5376d1f700 1 -- 172.21.15.179:0/275898204 shutdown_connections 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.446+0000 7f5376d1f700 1 -- 172.21.15.179:0/275898204 >> 172.21.15.179:0/275898204 conn(0x7f5370072970 msgr2=0x7f5370072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.446+0000 7f5376d1f700 1 -- 172.21.15.179:0/275898204 shutdown_connections 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.446+0000 7f5376d1f700 1 -- 172.21.15.179:0/275898204 wait complete. 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.447+0000 7f5376d1f700 1 Processor -- start 2023-12-07T00:15:01.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.447+0000 7f5376d1f700 1 -- start start 2023-12-07T00:15:01.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f5376d1f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5370155190 0x7f5370159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f5376d1f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f537015a220 0x7f537015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f5376d1f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f537015bb40 0x7f53701f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f5376d1f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537015bff0 con 0x7f537015a220 2023-12-07T00:15:01.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f5376d1f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537015acd0 con 0x7f537015bb40 2023-12-07T00:15:01.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f5376d1f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537015a710 con 0x7f5370155190 2023-12-07T00:15:01.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f536ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f537015a220 0x7f537015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f536ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f537015a220 0x7f537015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40440/0 (socket says 172.21.15.179:40440) 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f536ffff700 1 -- 172.21.15.179:0/1225881778 learned_addr learned my addr 172.21.15.179:0/1225881778 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f5374abb700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5370155190 0x7f5370159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.448+0000 7f53752bc700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f537015bb40 0x7f53701f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536ffff700 1 -- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5370155190 msgr2=0x7f5370159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536ffff700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5370155190 0x7f5370159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536ffff700 1 -- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f537015bb40 msgr2=0x7f53701f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536ffff700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f537015bb40 0x7f53701f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536ffff700 1 -- 172.21.15.179:0/1225881778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537015a9f0 con 0x7f537015a220 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f53752bc700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f537015bb40 0x7f53701f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536ffff700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f537015a220 0x7f537015b600 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f535c0119f0 tx=0x7f535c011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536d7fa700 1 -- 172.21.15.179:0/1225881778 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c005c30 con 0x7f537015a220 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536d7fa700 1 -- 172.21.15.179:0/1225881778 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c005d90 con 0x7f537015a220 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f536d7fa700 1 -- 172.21.15.179:0/1225881778 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00f950 con 0x7f537015a220 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53700c9cf0 con 0x7f537015a220 2023-12-07T00:15:01.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.449+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5370155570 con 0x7f537015a220 2023-12-07T00:15:01.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.450+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537004f290 con 0x7f537015a220 2023-12-07T00:15:01.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.450+0000 7f536d7fa700 1 -- 172.21.15.179:0/1225881778 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f535c00fab0 con 0x7f537015a220 2023-12-07T00:15:01.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.451+0000 7f536d7fa700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f535406af00 0x7f535406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:01.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.451+0000 7f536d7fa700 1 -- 172.21.15.179:0/1225881778 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f535c08a000 con 0x7f537015a220 2023-12-07T00:15:01.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.451+0000 7f5374abb700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f535406af00 0x7f535406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:01.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.451+0000 7f5374abb700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f535406af00 0x7f535406d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53640048d0 tx=0x7f5364007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:01.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.455+0000 7f536d7fa700 1 -- 172.21.15.179:0/1225881778 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f535c054da0 con 0x7f537015a220 2023-12-07T00:15:01.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:01.729+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f53700ca210 con 0x7f537015a220 2023-12-07T00:15:02.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.657+0000 7f536d7fa700 1 -- 172.21.15.179:0/1225881778 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v67) v1 ==== 147+0+0 (secure 0 0 0) 0x7f53700ca210 con 0x7f537015a220 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.660+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f535406af00 msgr2=0x7f535406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.660+0000 7f5376d1f700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f535406af00 0x7f535406d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f53640048d0 tx=0x7f5364007040 comp rx=0 tx=0).stop 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.660+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f537015a220 msgr2=0x7f537015b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.660+0000 7f5376d1f700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f537015a220 0x7f537015b600 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f535c0119f0 tx=0x7f535c011d00 comp rx=0 tx=0).stop 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.661+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 shutdown_connections 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.661+0000 7f5376d1f700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f535406af00 0x7f535406d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.661+0000 7f5376d1f700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f537015bb40 0x7f53701f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.661+0000 7f5376d1f700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5370155190 0x7f5370159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.661+0000 7f5376d1f700 1 --2- 172.21.15.179:0/1225881778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f537015a220 0x7f537015b600 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.661+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 >> 172.21.15.179:0/1225881778 conn(0x7f5370072970 msgr2=0x7f53700d00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:02.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.661+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 shutdown_connections 2023-12-07T00:15:02.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.661+0000 7f5376d1f700 1 -- 172.21.15.179:0/1225881778 wait complete. 2023-12-07T00:15:02.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-07T00:15:02.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.806+0000 7fa3210df700 1 Processor -- start 2023-12-07T00:15:02.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.806+0000 7fa3210df700 1 -- start start 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa3210df700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c0cfde0 0x7fa31c0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa3210df700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa31c06b3f0 0x7fa31c0cda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa3210df700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31c162590 con 0x7fa31c06af70 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa3210df700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa31c06bae0 con 0x7fa31c06b3f0 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa3210df700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c06b880 con 0x7fa31c0cfde0 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa31a59c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa31c06af70 0x7fa31c0cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47348/0 (socket says 172.21.15.179:47348) 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa31a59c700 1 -- 172.21.15.179:0/3747950021 learned_addr learned my addr 172.21.15.179:0/3747950021 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa31b59e700 1 --2- 172.21.15.179:0/3747950021 >> v2:172.21.15.190:3300/0 conn(0x7fa31c06b3f0 0x7fa31c0cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa31ad9d700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c0cfde0 0x7fa31c0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.809 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135780059 0 0) 0x7fa31c162590 con 0x7fa31c06af70 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3040035b0 con 0x7fa31c06af70 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 91346218 0 0) 0x7fa3040035b0 con 0x7fa31c06af70 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c0cfde0 msgr2=0x7fa31c0d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c0cfde0 0x7fa31c0d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 >> v2:172.21.15.190:3300/0 conn(0x7fa31c06b3f0 msgr2=0x7fa31c0cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 --2- 172.21.15.179:0/3747950021 >> v2:172.21.15.190:3300/0 conn(0x7fa31c06b3f0 0x7fa31c0cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c162a20 con 0x7fa31c06af70 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fa310001670 con 0x7fa31c06af70 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.807+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 >> v1:172.21.15.179:6789/0 conn(0x7fa31c06af70 legacy=0x7fa31c0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa304003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa304004850 0x7fa304004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c0cfde0 0x7fa304005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c06bae0 con 0x7fa304003a00 2023-12-07T00:15:02.810 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c06b880 con 0x7fa304004850 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30400ba10 con 0x7fa31c0cfde0 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31ad9d700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa304003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31b59e700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c0cfde0 0x7fa304005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31a59c700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa304004850 0x7fa304004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31ad9d700 1 -- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c0cfde0 msgr2=0x7fa304005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31ad9d700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c0cfde0 0x7fa304005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31ad9d700 1 -- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa304004850 msgr2=0x7fa304004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31ad9d700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa304004850 0x7fa304004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31ad9d700 1 -- 172.21.15.179:0/3747950021 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3040035b0 con 0x7fa304003a00 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31a59c700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa304004850 0x7fa304004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa31ad9d700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa304003e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009b60 tx=0x7fa304005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbed233aab9bd25 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00e6c0 con 0x7fa304003a00 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c00e820 con 0x7fa304003a00 2023-12-07T00:15:02.811 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.808+0000 7fa319d9b700 1 -- 172.21.15.179:0/3747950021 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00eb90 con 0x7fa304003a00 2023-12-07T00:15:02.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.809+0000 7fa3210df700 1 -- 172.21.15.179:0/3747950021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 msgr2=0x7fa304003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:02.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.809+0000 7fa3210df700 1 --2- 172.21.15.179:0/3747950021 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa304003e20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009b60 tx=0x7fa304005880 comp rx=0 tx=0).stop 2023-12-07T00:15:02.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.809+0000 7fa31b59e700 1 -- 172.21.15.179:0/3747950021 reap_dead start 2023-12-07T00:15:02.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.809+0000 7fa3210df700 1 -- 172.21.15.179:0/3747950021 shutdown_connections 2023-12-07T00:15:02.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.809+0000 7fa3210df700 1 -- 172.21.15.179:0/3747950021 >> 172.21.15.179:0/3747950021 conn(0x7fa31c099a40 msgr2=0x7fa31c0d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:02.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.809+0000 7fa3210df700 1 -- 172.21.15.179:0/3747950021 shutdown_connections 2023-12-07T00:15:02.812 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.809+0000 7fa3210df700 1 -- 172.21.15.179:0/3747950021 wait complete. 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.810+0000 7fa3210df700 1 Processor -- start 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.810+0000 7fa3210df700 1 -- start start 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa3210df700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa31c0b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa3210df700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa31c09cbc0 0x7fa31c1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa3210df700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c09d040 0x7fa31c1f3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa3210df700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c1f36d0 con 0x7fa304003a00 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa3210df700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0b50f0 con 0x7fa31c09cbc0 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa3210df700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c0b4570 con 0x7fa31c09d040 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31ad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa31c0b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31ad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa31c0b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40458/0 (socket says 172.21.15.179:40458) 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31ad9d700 1 -- 172.21.15.179:0/1979487257 learned_addr learned my addr 172.21.15.179:0/1979487257 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:02.815 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31a59c700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa31c09cbc0 0x7fa31c1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31b59e700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c09d040 0x7fa31c1f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31ad9d700 1 -- 172.21.15.179:0/1979487257 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c09d040 msgr2=0x7fa31c1f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31ad9d700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c09d040 0x7fa31c1f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31ad9d700 1 -- 172.21.15.179:0/1979487257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa31c09cbc0 msgr2=0x7fa31c1f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31ad9d700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa31c09cbc0 0x7fa31c1f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.811+0000 7fa31ad9d700 1 -- 172.21.15.179:0/1979487257 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c0b4850 con 0x7fa304003a00 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.812+0000 7fa31ad9d700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa31c0b6030 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa30c000c00 tx=0x7fa30c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.812+0000 7fa3037fe700 1 -- 172.21.15.179:0/1979487257 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c00e6c0 con 0x7fa304003a00 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.812+0000 7fa3037fe700 1 -- 172.21.15.179:0/1979487257 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c0038c0 con 0x7fa304003a00 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.812+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31c0b4b30 con 0x7fa304003a00 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.812+0000 7fa3037fe700 1 -- 172.21.15.179:0/1979487257 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c003c70 con 0x7fa304003a00 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.812+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31c0b6570 con 0x7fa304003a00 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.813+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31c0685f0 con 0x7fa304003a00 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.813+0000 7fa3037fe700 1 -- 172.21.15.179:0/1979487257 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa30c013470 con 0x7fa304003a00 2023-12-07T00:15:02.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.813+0000 7fa3037fe700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa30806af00 0x7fa30806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:02.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.814+0000 7fa3037fe700 1 -- 172.21.15.179:0/1979487257 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa30c08b210 con 0x7fa304003a00 2023-12-07T00:15:02.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.814+0000 7fa31a59c700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa30806af00 0x7fa30806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:02.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.814+0000 7fa31a59c700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa30806af00 0x7fa30806d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0b5fc0 tx=0x7fa310007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:02.817 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:02.818+0000 7fa3037fe700 1 -- 172.21.15.179:0/1979487257 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa30c0560b0 con 0x7fa304003a00 2023-12-07T00:15:03.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.010+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa31c0b68b0 con 0x7fa304003a00 2023-12-07T00:15:03.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.013+0000 7fa3037fe700 1 -- 172.21.15.179:0/1979487257 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa30c026350 con 0x7fa304003a00 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa30806af00 msgr2=0x7fa30806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa30806af00 0x7fa30806d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0b5fc0 tx=0x7fa310007040 comp rx=0 tx=0).stop 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 msgr2=0x7fa31c0b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa31c0b6030 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa30c000c00 tx=0x7fa30c0047c0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 shutdown_connections 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa30806af00 0x7fa30806d3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa31c09d040 0x7fa31c1f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa304003a00 0x7fa31c0b6030 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 --2- 172.21.15.179:0/1979487257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa31c09cbc0 0x7fa31c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 >> 172.21.15.179:0/1979487257 conn(0x7fa31c099a40 msgr2=0x7fa31c06e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:03.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 shutdown_connections 2023-12-07T00:15:03.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.015+0000 7fa3210df700 1 -- 172.21.15.179:0/1979487257 wait complete. 2023-12-07T00:15:03.027 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-07T00:15:03.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T00:15:03.066 DEBUG:teuthology.orchestra.run.smithi190:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-07T00:15:03.114 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-07T00:15:03.115 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:15:03.115 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:03.132 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:15:03.132 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:03.189 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:15:03.189 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:03.246 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:03.406 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.407+0000 7f8eba35d700 1 Processor -- start 2023-12-07T00:15:03.406 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.407+0000 7f8eba35d700 1 -- start start 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eba35d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8eb4099b20 0x7f8eb4066ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eba35d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40af250 0x7f8eb40af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eba35d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb40b1720 con 0x7f8eb415bf40 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eba35d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb40afc40 con 0x7f8eb4099b20 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eba35d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb406c670 con 0x7f8eb40af250 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb37fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8eb4099b20 0x7f8eb4066ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb37fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8eb4099b20 0x7f8eb4066ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:42720/0 (socket says 172.21.15.179:42720) 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb3fff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f8eb415bf40 0x7f8eb40cc8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:54046/0 (socket says 172.21.15.179:54046) 2023-12-07T00:15:03.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb37fe700 1 -- 172.21.15.179:0/930483138 learned_addr learned my addr 172.21.15.179:0/930483138 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb88fa700 1 --2- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40af250 0x7f8eb40af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb37fe700 1 -- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40af250 msgr2=0x7f8eb40af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb37fe700 1 --2- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40af250 0x7f8eb40af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb37fe700 1 -- 172.21.15.179:0/930483138 >> v1:172.21.15.190:6789/0 conn(0x7f8eb415bf40 legacy=0x7f8eb40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb37fe700 1 -- 172.21.15.179:0/930483138 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb406c0b0 con 0x7f8eb4099b20 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.408+0000 7f8eb88fa700 1 --2- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40af250 0x7f8eb40af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eb37fe700 1 --2- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb4099b20 0x7f8eb4066ce0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80098f0 tx=0x7f8ea8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5adb91a21effa445 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eb2ffd700 1 -- 172.21.15.179:0/930483138 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8011830 con 0x7f8eb4099b20 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eb2ffd700 1 -- 172.21.15.179:0/930483138 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea8011990 con 0x7f8eb4099b20 2023-12-07T00:15:03.409 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eb2ffd700 1 -- 172.21.15.179:0/930483138 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8011d20 con 0x7f8eb4099b20 2023-12-07T00:15:03.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eba35d700 1 -- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb4099b20 msgr2=0x7f8eb4066ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eba35d700 1 --2- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb4099b20 0x7f8eb4066ce0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80098f0 tx=0x7f8ea8009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:03.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eba35d700 1 -- 172.21.15.179:0/930483138 shutdown_connections 2023-12-07T00:15:03.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eba35d700 1 --2- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb40af250 0x7f8eb40af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eba35d700 1 --2- 172.21.15.179:0/930483138 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb4099b20 0x7f8eb4066ce0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eba35d700 1 -- 172.21.15.179:0/930483138 >> 172.21.15.179:0/930483138 conn(0x7f8eb4072660 msgr2=0x7f8eb40b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:03.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eba35d700 1 -- 172.21.15.179:0/930483138 shutdown_connections 2023-12-07T00:15:03.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.409+0000 7f8eba35d700 1 -- 172.21.15.179:0/930483138 wait complete. 2023-12-07T00:15:03.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.411+0000 7f8eba35d700 1 Processor -- start 2023-12-07T00:15:03.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.411+0000 7f8eba35d700 1 -- start start 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.411+0000 7f8eba35d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4099b20 0x7f8eb40ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eba35d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb40af250 0x7f8eb40adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eba35d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb415bf40 0x7f8eb41f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eba35d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb414ef70 con 0x7f8eb4099b20 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eba35d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40ae200 con 0x7f8eb40af250 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eba35d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40af030 con 0x7f8eb415bf40 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4099b20 0x7f8eb40ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4099b20 0x7f8eb40ad780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40472/0 (socket says 172.21.15.179:40472) 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 -- 172.21.15.179:0/3237350842 learned_addr learned my addr 172.21.15.179:0/3237350842 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb88fa700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb415bf40 0x7f8eb41f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb37fe700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb40af250 0x7f8eb40adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 -- 172.21.15.179:0/3237350842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb415bf40 msgr2=0x7f8eb41f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.413 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb415bf40 0x7f8eb41f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 -- 172.21.15.179:0/3237350842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb40af250 msgr2=0x7f8eb40adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb40af250 0x7f8eb40adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 -- 172.21.15.179:0/3237350842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac009a70 con 0x7f8eb4099b20 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb3fff700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4099b20 0x7f8eb40ad780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c500 tx=0x7f8ea400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb0ff9700 1 -- 172.21.15.179:0/3237350842 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400cea0 con 0x7f8eb4099b20 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb0ff9700 1 -- 172.21.15.179:0/3237350842 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4005cb0 con 0x7f8eb4099b20 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eb0ff9700 1 -- 172.21.15.179:0/3237350842 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40072d0 con 0x7f8eb4099b20 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea8009550 con 0x7f8eb4099b20 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.412+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb40ae790 con 0x7f8eb4099b20 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.413+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb40685f0 con 0x7f8eb4099b20 2023-12-07T00:15:03.414 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.414+0000 7f8eb0ff9700 1 -- 172.21.15.179:0/3237350842 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8ea4007430 con 0x7f8eb4099b20 2023-12-07T00:15:03.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.414+0000 7f8eb0ff9700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8ea006aed0 0x7f8ea006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.414+0000 7f8eb0ff9700 1 -- 172.21.15.179:0/3237350842 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8ea4088bc0 con 0x7f8eb4099b20 2023-12-07T00:15:03.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.414+0000 7f8eb37fe700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8ea006aed0 0x7f8ea006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.415+0000 7f8eb37fe700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8ea006aed0 0x7f8ea006d390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009c40 tx=0x7f8ea8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:03.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.419+0000 7f8eb0ff9700 1 -- 172.21.15.179:0/3237350842 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8ea40538d0 con 0x7f8eb4099b20 2023-12-07T00:15:03.609 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.610+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eb415f560 con 0x7f8eb4099b20 2023-12-07T00:15:03.610 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.612+0000 7f8eb0ff9700 1 -- 172.21.15.179:0/3237350842 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7f8ea4017070 con 0x7f8eb4099b20 2023-12-07T00:15:03.611 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:03.611 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:03.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8ea006aed0 msgr2=0x7f8ea006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8ea006aed0 0x7f8ea006d390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009c40 tx=0x7f8ea8008030 comp rx=0 tx=0).stop 2023-12-07T00:15:03.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4099b20 msgr2=0x7f8eb40ad780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.613 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4099b20 0x7f8eb40ad780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400c500 tx=0x7f8ea400c810 comp rx=0 tx=0).stop 2023-12-07T00:15:03.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 shutdown_connections 2023-12-07T00:15:03.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8ea006aed0 0x7f8ea006d390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8eb415bf40 0x7f8eb41f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8eb4099b20 0x7f8eb40ad780 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 --2- 172.21.15.179:0/3237350842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8eb40af250 0x7f8eb40adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 >> 172.21.15.179:0/3237350842 conn(0x7f8eb4072660 msgr2=0x7f8eb4159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:03.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 shutdown_connections 2023-12-07T00:15:03.614 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.614+0000 7f8eba35d700 1 -- 172.21.15.179:0/3237350842 wait complete. 2023-12-07T00:15:03.626 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:15:03.626 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:15:03.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.750+0000 7feab1915700 1 Processor -- start 2023-12-07T00:15:03.750 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feab1915700 1 -- start start 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feab1915700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feaac15bba0 0x7feaac15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feab1915700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0ccee0 0x7feaac15fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feab1915700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac15f640 con 0x7feaac1602f0 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feab1915700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac0b03e0 con 0x7feaac15bba0 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feab1915700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac15c8c0 con 0x7feaac0ccee0 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feaaaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feaac15bba0 0x7feaac15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feaaaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feaac15bba0 0x7feaac15bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40480/0 (socket says 172.21.15.179:40480) 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.751+0000 7feaaaffd700 1 -- 172.21.15.179:0/1431979842 learned_addr learned my addr 172.21.15.179:0/1431979842 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feaaaffd700 1 -- 172.21.15.179:0/1431979842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0ccee0 msgr2=0x7feaac15fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feaaaffd700 1 --2- 172.21.15.179:0/1431979842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0ccee0 0x7feaac15fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.752 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feaaaffd700 1 -- 172.21.15.179:0/1431979842 >> v1:172.21.15.190:6789/0 conn(0x7feaac1602f0 legacy=0x7feaac0cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feaaaffd700 1 -- 172.21.15.179:0/1431979842 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac15cba0 con 0x7feaac15bba0 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feaaaffd700 1 --2- 172.21.15.179:0/1431979842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac15bf80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feaa00098f0 tx=0x7feaa0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d6e3ca66b0edb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feaa9ffb700 1 -- 172.21.15.179:0/1431979842 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0004230 con 0x7feaac15bba0 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feaa9ffb700 1 -- 172.21.15.179:0/1431979842 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa0004390 con 0x7feaac15bba0 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feaa9ffb700 1 -- 172.21.15.179:0/1431979842 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa00036a0 con 0x7feaac15bba0 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feab1915700 1 -- 172.21.15.179:0/1431979842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 msgr2=0x7feaac15bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.752+0000 7feab1915700 1 --2- 172.21.15.179:0/1431979842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac15bf80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7feaa00098f0 tx=0x7feaa0009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.753+0000 7feab1915700 1 -- 172.21.15.179:0/1431979842 shutdown_connections 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.753+0000 7feab1915700 1 --2- 172.21.15.179:0/1431979842 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac15bf80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.753+0000 7feab1915700 1 --2- 172.21.15.179:0/1431979842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0ccee0 0x7feaac15fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.753+0000 7feab1915700 1 -- 172.21.15.179:0/1431979842 >> 172.21.15.179:0/1431979842 conn(0x7feaac099a40 msgr2=0x7feaac099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.753+0000 7feab1915700 1 -- 172.21.15.179:0/1431979842 shutdown_connections 2023-12-07T00:15:03.753 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.753+0000 7feab1915700 1 -- 172.21.15.179:0/1431979842 wait complete. 2023-12-07T00:15:03.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.754+0000 7feab1915700 1 Processor -- start 2023-12-07T00:15:03.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.754+0000 7feab1915700 1 -- start start 2023-12-07T00:15:03.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feab1915700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaac0ccee0 0x7feaac157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feab1915700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feab1915700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0d02c0 0x7feaac0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.756 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feab1915700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0d0cb0 con 0x7feaac15bba0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feab1915700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac14e720 con 0x7feaac0ccee0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feab1915700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1586b0 con 0x7feaac0d02c0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac14b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40488/0 (socket says 172.21.15.179:40488) 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 -- 172.21.15.179:0/671578845 learned_addr learned my addr 172.21.15.179:0/671578845 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaaffd700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaac0ccee0 0x7feaac157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaab7fe700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0d02c0 0x7feaac0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 -- 172.21.15.179:0/671578845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0d02c0 msgr2=0x7feaac0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0d02c0 0x7feaac0d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 -- 172.21.15.179:0/671578845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaac0ccee0 msgr2=0x7feaac157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaac0ccee0 0x7feaac157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 -- 172.21.15.179:0/671578845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0009550 con 0x7feaac15bba0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feaaa7fc700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac14b600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00b530 tx=0x7fea9c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7fea93fff700 1 -- 172.21.15.179:0/671578845 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c011830 con 0x7feaac15bba0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7fea93fff700 1 -- 172.21.15.179:0/671578845 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c0119b0 con 0x7feaac15bba0 2023-12-07T00:15:03.757 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac158990 con 0x7feaac15bba0 2023-12-07T00:15:03.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7fea93fff700 1 -- 172.21.15.179:0/671578845 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c011d60 con 0x7feaac15bba0 2023-12-07T00:15:03.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.755+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac156960 con 0x7feaac15bba0 2023-12-07T00:15:03.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.756+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac0685f0 con 0x7feaac15bba0 2023-12-07T00:15:03.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.757+0000 7fea93fff700 1 -- 172.21.15.179:0/671578845 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fea9c01a400 con 0x7feaac15bba0 2023-12-07T00:15:03.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.757+0000 7fea93fff700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea9806aed0 0x7fea9806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:03.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.757+0000 7fea93fff700 1 -- 172.21.15.179:0/671578845 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fea9c089ab0 con 0x7feaac15bba0 2023-12-07T00:15:03.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.757+0000 7feaaaffd700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea9806aed0 0x7fea9806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:03.758 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.758+0000 7feaaaffd700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea9806aed0 0x7fea9806d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009c40 tx=0x7feaa0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:03.760 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.762+0000 7fea93fff700 1 -- 172.21.15.179:0/671578845 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fea9c0547a0 con 0x7feaac15bba0 2023-12-07T00:15:03.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.954+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feaac0b6a20 con 0x7feaac15bba0 2023-12-07T00:15:03.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.954+0000 7fea93fff700 1 -- 172.21.15.179:0/671578845 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fea9c015020 con 0x7feaac15bba0 2023-12-07T00:15:03.953 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea9806aed0 msgr2=0x7fea9806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea9806aed0 0x7fea9806d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009c40 tx=0x7feaa0008030 comp rx=0 tx=0).stop 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 msgr2=0x7feaac14b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac14b600 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fea9c00b530 tx=0x7fea9c00b8f0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 shutdown_connections 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fea9806aed0 0x7fea9806d390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feaac0d02c0 0x7feaac0d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feaac0ccee0 0x7feaac157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 --2- 172.21.15.179:0/671578845 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feaac15bba0 0x7feaac14b600 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:03.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.956+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 >> 172.21.15.179:0/671578845 conn(0x7feaac099a40 msgr2=0x7feaac15d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:03.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.957+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 shutdown_connections 2023-12-07T00:15:03.962 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:03.957+0000 7feab1915700 1 -- 172.21.15.179:0/671578845 wait complete. 2023-12-07T00:15:03.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:15:04.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.093+0000 7f2b0fe37700 1 Processor -- start 2023-12-07T00:15:04.093 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.094+0000 7f2b0fe37700 1 -- start start 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.094+0000 7f2b0fe37700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b0815bd70 0x7f2b080cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.094+0000 7f2b0fe37700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b080ccac0 con 0x7f2b08099b90 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.094+0000 7f2b0fe37700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b080ccda0 con 0x7f2b080cc590 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.094+0000 7f2b0fe37700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b080cd740 con 0x7f2b0815bd70 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.094+0000 7f2b0dbd3700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b0815bd70 0x7f2b080cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.094+0000 7f2b0e3d4700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2b08099b90 0x7f2b080c5540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47400/0 (socket says 172.21.15.179:47400) 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.094+0000 7f2b0e3d4700 1 -- 172.21.15.179:0/173029189 learned_addr learned my addr 172.21.15.179:0/173029189 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.095+0000 7f2b0dbd3700 1 -- 172.21.15.179:0/173029189 >> v1:172.21.15.190:6789/0 conn(0x7f2b080cc590 legacy=0x7f2b080d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.095+0000 7f2b0dbd3700 1 -- 172.21.15.179:0/173029189 >> v1:172.21.15.179:6789/0 conn(0x7f2b08099b90 legacy=0x7f2b080c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.095+0000 7f2b0dbd3700 1 -- 172.21.15.179:0/173029189 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080cd080 con 0x7f2b0815bd70 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.095+0000 7f2b0dbd3700 1 --2- 172.21.15.179:0/173029189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080cdb60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009840 tx=0x7f2af8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d3b6debbca1233 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.095+0000 7f2b0cbd1700 1 -- 172.21.15.179:0/173029189 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8004230 con 0x7f2b0815bd70 2023-12-07T00:15:04.095 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.095+0000 7f2b0cbd1700 1 -- 172.21.15.179:0/173029189 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af8004390 con 0x7f2b0815bd70 2023-12-07T00:15:04.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.095+0000 7f2b0cbd1700 1 -- 172.21.15.179:0/173029189 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80036a0 con 0x7f2b0815bd70 2023-12-07T00:15:04.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.096+0000 7f2b0fe37700 1 -- 172.21.15.179:0/173029189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 msgr2=0x7f2b080cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.096+0000 7f2b0fe37700 1 --2- 172.21.15.179:0/173029189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080cdb60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009840 tx=0x7f2af8009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:04.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.096+0000 7f2b0fe37700 1 -- 172.21.15.179:0/173029189 shutdown_connections 2023-12-07T00:15:04.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.096+0000 7f2b0fe37700 1 --2- 172.21.15.179:0/173029189 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080cdb60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.096+0000 7f2b0fe37700 1 -- 172.21.15.179:0/173029189 >> 172.21.15.179:0/173029189 conn(0x7f2b080b34e0 msgr2=0x7f2b080b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:04.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.096+0000 7f2b0fe37700 1 -- 172.21.15.179:0/173029189 shutdown_connections 2023-12-07T00:15:04.096 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.096+0000 7f2b0fe37700 1 -- 172.21.15.179:0/173029189 wait complete. 2023-12-07T00:15:04.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.097+0000 7f2b0fe37700 1 Processor -- start 2023-12-07T00:15:04.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.097+0000 7f2b0fe37700 1 -- start start 2023-12-07T00:15:04.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0fe37700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08099b90 0x7f2b080cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0fe37700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b080cc590 0x7f2b08145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0fe37700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0fe37700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080b7970 con 0x7f2b0815bd70 2023-12-07T00:15:04.099 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0fe37700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080b5000 con 0x7f2b08099b90 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0fe37700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080b52e0 con 0x7f2b080cc590 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40504/0 (socket says 172.21.15.179:40504) 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 -- 172.21.15.179:0/2039387113 learned_addr learned my addr 172.21.15.179:0/2039387113 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0dbd3700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08099b90 0x7f2b080cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0d3d2700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b080cc590 0x7f2b08145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 -- 172.21.15.179:0/2039387113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b080cc590 msgr2=0x7f2b08145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b080cc590 0x7f2b08145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 -- 172.21.15.179:0/2039387113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08099b90 msgr2=0x7f2b080cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08099b90 0x7f2b080cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 -- 172.21.15.179:0/2039387113 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af80094a0 con 0x7f2b0815bd70 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0e3d4700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080b60a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000cca0 tx=0x7f2b0000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2afe7fc700 1 -- 172.21.15.179:0/2039387113 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0000ab30 con 0x7f2b0815bd70 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2afe7fc700 1 -- 172.21.15.179:0/2039387113 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0000ac90 con 0x7f2b0815bd70 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b080b55c0 con 0x7f2b0815bd70 2023-12-07T00:15:04.100 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.098+0000 7f2afe7fc700 1 -- 172.21.15.179:0/2039387113 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b000070d0 con 0x7f2b0815bd70 2023-12-07T00:15:04.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.099+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b080b5b80 con 0x7f2b0815bd70 2023-12-07T00:15:04.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.099+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b080685f0 con 0x7f2b0815bd70 2023-12-07T00:15:04.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.100+0000 7f2afe7fc700 1 -- 172.21.15.179:0/2039387113 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b00007250 con 0x7f2b0815bd70 2023-12-07T00:15:04.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.100+0000 7f2afe7fc700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2aec06aed0 0x7f2aec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.100+0000 7f2afe7fc700 1 -- 172.21.15.179:0/2039387113 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b00089740 con 0x7f2b0815bd70 2023-12-07T00:15:04.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.100+0000 7f2b0dbd3700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2aec06aed0 0x7f2aec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.101 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.101+0000 7f2b0dbd3700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2aec06aed0 0x7f2aec06d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2af80090b0 tx=0x7f2af8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.104 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.105+0000 7f2afe7fc700 1 -- 172.21.15.179:0/2039387113 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b00054430 con 0x7f2b0815bd70 2023-12-07T00:15:04.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.293+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b080b43d0 con 0x7f2b0815bd70 2023-12-07T00:15:04.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.293+0000 7f2afe7fc700 1 -- 172.21.15.179:0/2039387113 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b00057a50 con 0x7f2b0815bd70 2023-12-07T00:15:04.292 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2aec06aed0 msgr2=0x7f2aec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2aec06aed0 0x7f2aec06d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2af80090b0 tx=0x7f2af8008030 comp rx=0 tx=0).stop 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 msgr2=0x7f2b080b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080b60a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2b0000cca0 tx=0x7f2b0000a060 comp rx=0 tx=0).stop 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 shutdown_connections 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2aec06aed0 0x7f2aec06d390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b0815bd70 0x7f2b080b60a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b08099b90 0x7f2b080cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 --2- 172.21.15.179:0/2039387113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b080cc590 0x7f2b08145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 >> 172.21.15.179:0/2039387113 conn(0x7f2b080b34e0 msgr2=0x7f2b08159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 shutdown_connections 2023-12-07T00:15:04.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.295+0000 7f2b0fe37700 1 -- 172.21.15.179:0/2039387113 wait complete. 2023-12-07T00:15:04.306 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:15:04.429 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.430+0000 7fab84390700 1 Processor -- start 2023-12-07T00:15:04.429 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.430+0000 7fab84390700 1 -- start start 2023-12-07T00:15:04.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab84390700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c15be00 0x7fab7c0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab84390700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fab7c09a230 0x7fab7c0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab84390700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab7c0ccbe0 con 0x7fab7c0cdc80 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab84390700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7c0ccec0 con 0x7fab7c09a230 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab84390700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c0cd1a0 con 0x7fab7c15be00 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8292d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fab7c09a230 0x7fab7c0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8192b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fab7c0cdc80 0x7fab7c099b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47412/0 (socket says 172.21.15.179:47412) 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8292d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fab7c09a230 0x7fab7c0cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40512/0 (socket says 172.21.15.179:40512) 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8192b700 1 -- 172.21.15.179:0/4241641900 learned_addr learned my addr 172.21.15.179:0/4241641900 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8212c700 1 --2- 172.21.15.179:0/4241641900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c15be00 0x7fab7c0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8292d700 1 -- 172.21.15.179:0/4241641900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c15be00 msgr2=0x7fab7c0cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8292d700 1 --2- 172.21.15.179:0/4241641900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c15be00 0x7fab7c0cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8292d700 1 -- 172.21.15.179:0/4241641900 >> v1:172.21.15.179:6789/0 conn(0x7fab7c0cdc80 legacy=0x7fab7c099b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8292d700 1 -- 172.21.15.179:0/4241641900 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c0cd480 con 0x7fab7c09a230 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8112a700 1 -- 172.21.15.179:0/4241641900 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942768959 0 0) 0x7fab7c0ccbe0 con 0x7fab7c0cdc80 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.431+0000 7fab8292d700 1 --2- 172.21.15.179:0/4241641900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c09a230 0x7fab7c0cf7f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fab74009d90 tx=0x7fab7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e89e20f62c62d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab8112a700 1 -- 172.21.15.179:0/4241641900 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7400e070 con 0x7fab7c09a230 2023-12-07T00:15:04.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab8112a700 1 -- 172.21.15.179:0/4241641900 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7400bbd0 con 0x7fab7c09a230 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab8112a700 1 -- 172.21.15.179:0/4241641900 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74012430 con 0x7fab7c09a230 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab84390700 1 -- 172.21.15.179:0/4241641900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c09a230 msgr2=0x7fab7c0cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab84390700 1 --2- 172.21.15.179:0/4241641900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c09a230 0x7fab7c0cf7f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fab74009d90 tx=0x7fab7400b330 comp rx=0 tx=0).stop 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab84390700 1 -- 172.21.15.179:0/4241641900 shutdown_connections 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab84390700 1 --2- 172.21.15.179:0/4241641900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c09a230 0x7fab7c0cf7f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab84390700 1 --2- 172.21.15.179:0/4241641900 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c15be00 0x7fab7c0cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab84390700 1 -- 172.21.15.179:0/4241641900 >> 172.21.15.179:0/4241641900 conn(0x7fab7c0b3550 msgr2=0x7fab7c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab84390700 1 -- 172.21.15.179:0/4241641900 shutdown_connections 2023-12-07T00:15:04.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.432+0000 7fab84390700 1 -- 172.21.15.179:0/4241641900 wait complete. 2023-12-07T00:15:04.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.433+0000 7fab84390700 1 Processor -- start 2023-12-07T00:15:04.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.433+0000 7fab84390700 1 -- start start 2023-12-07T00:15:04.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab84390700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab7c09a230 0x7fab7c0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab84390700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c0cdc80 0x7fab7c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab84390700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c15be00 0x7fab7c06c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab84390700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c06e0e0 con 0x7fab7c15be00 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab84390700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c06db20 con 0x7fab7c09a230 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab84390700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c06de00 con 0x7fab7c0cdc80 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab8292d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c15be00 0x7fab7c06c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab8292d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c15be00 0x7fab7c06c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40518/0 (socket says 172.21.15.179:40518) 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab8292d700 1 -- 172.21.15.179:0/2997388441 learned_addr learned my addr 172.21.15.179:0/2997388441 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab8192b700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c0cdc80 0x7fab7c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.434+0000 7fab8212c700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab7c09a230 0x7fab7c0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab8292d700 1 -- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c0cdc80 msgr2=0x7fab7c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab8292d700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c0cdc80 0x7fab7c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab8292d700 1 -- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab7c09a230 msgr2=0x7fab7c0cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab8292d700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab7c09a230 0x7fab7c0cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab8292d700 1 -- 172.21.15.179:0/2997388441 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74009a70 con 0x7fab7c15be00 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab8192b700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c0cdc80 0x7fab7c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:04.437 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab8292d700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c15be00 0x7fab7c06c9b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab7c073600 tx=0x7fab74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab72ffd700 1 -- 172.21.15.179:0/2997388441 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74012430 con 0x7fab7c15be00 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab72ffd700 1 -- 172.21.15.179:0/2997388441 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74020070 con 0x7fab7c15be00 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c06c1b0 con 0x7fab7c15be00 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab72ffd700 1 -- 172.21.15.179:0/2997388441 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74004280 con 0x7fab7c15be00 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.435+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c0cb1f0 con 0x7fab7c15be00 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.436+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c0685f0 con 0x7fab7c15be00 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.436+0000 7fab72ffd700 1 -- 172.21.15.179:0/2997388441 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab740043e0 con 0x7fab7c15be00 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.437+0000 7fab72ffd700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fab6006aed0 0x7fab6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.437+0000 7fab72ffd700 1 -- 172.21.15.179:0/2997388441 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fab74022070 con 0x7fab7c15be00 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.437+0000 7fab8212c700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fab6006aed0 0x7fab6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.438 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.437+0000 7fab8212c700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fab6006aed0 0x7fab6006d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fab78006b20 tx=0x7fab78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.441+0000 7fab72ffd700 1 -- 172.21.15.179:0/2997388441 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab74056780 con 0x7fab7c15be00 2023-12-07T00:15:04.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.633+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab7c09a670 con 0x7fab7c15be00 2023-12-07T00:15:04.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.633+0000 7fab72ffd700 1 -- 172.21.15.179:0/2997388441 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab7402c020 con 0x7fab7c15be00 2023-12-07T00:15:04.632 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fab6006aed0 msgr2=0x7fab6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fab6006aed0 0x7fab6006d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fab78006b20 tx=0x7fab78008040 comp rx=0 tx=0).stop 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c15be00 msgr2=0x7fab7c06c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c15be00 0x7fab7c06c9b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab7c073600 tx=0x7fab74004ad0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 shutdown_connections 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fab6006aed0 0x7fab6006d390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fab7c15be00 0x7fab7c06c9b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab7c09a230 0x7fab7c0cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 --2- 172.21.15.179:0/2997388441 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab7c0cdc80 0x7fab7c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 >> 172.21.15.179:0/2997388441 conn(0x7fab7c0b3550 msgr2=0x7fab7c0aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 shutdown_connections 2023-12-07T00:15:04.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.635+0000 7fab84390700 1 -- 172.21.15.179:0/2997388441 wait complete. 2023-12-07T00:15:04.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:15:04.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.771+0000 7f1aafce9700 1 Processor -- start 2023-12-07T00:15:04.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.771+0000 7f1aafce9700 1 -- start start 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aafce9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 0x7f1aa806c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aafce9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1aa80c6bb0 0x7f1aa806b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aafce9700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa815dce0 con 0x7f1aa80c6730 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aafce9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa80c70f0 con 0x7f1aa80c6bb0 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aafce9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa806c940 con 0x7f1aa806c020 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aad284700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1aa80c6730 0x7f1aa806af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47424/0 (socket says 172.21.15.179:47424) 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aad284700 1 -- 172.21.15.179:0/3022430678 learned_addr learned my addr 172.21.15.179:0/3022430678 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aada85700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 0x7f1aa806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aae286700 1 --2- 172.21.15.179:0/3022430678 >> v2:172.21.15.190:3300/0 conn(0x7f1aa80c6bb0 0x7f1aa806b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273058823 0 0) 0x7f1aa815dce0 con 0x7f1aa80c6730 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.772+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a940035b0 con 0x7f1aa80c6730 2023-12-07T00:15:04.774 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3769957749 0 0) 0x7f1a940035b0 con 0x7f1aa80c6730 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 msgr2=0x7f1aa806c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 0x7f1aa806c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 >> v2:172.21.15.190:3300/0 conn(0x7f1aa80c6bb0 msgr2=0x7f1aa806b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 --2- 172.21.15.179:0/3022430678 >> v2:172.21.15.190:3300/0 conn(0x7f1aa80c6bb0 0x7f1aa806b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa806ee90 con 0x7f1aa80c6730 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f1a98001670 con 0x7f1aa80c6730 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 >> v1:172.21.15.179:6789/0 conn(0x7f1aa80c6730 legacy=0x7f1aa806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 0x7f1a94003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a94003f80 0x7f1a94004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a94004d90 0x7f1a94005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80c70f0 con 0x7f1a94004d90 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa806c940 con 0x7f1a94003f80 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9400ba60 con 0x7f1aa806c020 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aae286700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a94004d90 0x7f1a94005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aad284700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a94003f80 0x7f1a94004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aada85700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 0x7f1a94003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aae286700 1 -- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 msgr2=0x7f1a94003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aae286700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 0x7f1a94003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aae286700 1 -- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a94003f80 msgr2=0x7f1a94004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aae286700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a94003f80 0x7f1a94004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aae286700 1 -- 172.21.15.179:0/3022430678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940035b0 con 0x7f1a94004d90 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aad284700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a94003f80 0x7f1a94004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aada85700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1aa806c020 0x7f1a94003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aae286700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a94004d90 0x7f1a94005210 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000f270 tx=0x7f1a94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9cbadab6ee3183 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000a2d0 con 0x7f1a94004d90 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0010040 con 0x7f1a94004d90 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.773+0000 7f1aaca83700 1 -- 172.21.15.179:0/3022430678 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000fd50 con 0x7f1a94004d90 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.774+0000 7f1aafce9700 1 -- 172.21.15.179:0/3022430678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a94004d90 msgr2=0x7f1a94005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.774+0000 7f1aafce9700 1 --2- 172.21.15.179:0/3022430678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a94004d90 0x7f1a94005210 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000f270 tx=0x7f1a94005880 comp rx=0 tx=0).stop 2023-12-07T00:15:04.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.774+0000 7f1aae286700 1 -- 172.21.15.179:0/3022430678 reap_dead start 2023-12-07T00:15:04.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.774+0000 7f1aafce9700 1 -- 172.21.15.179:0/3022430678 shutdown_connections 2023-12-07T00:15:04.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.774+0000 7f1aafce9700 1 -- 172.21.15.179:0/3022430678 >> 172.21.15.179:0/3022430678 conn(0x7f1aa80b3270 msgr2=0x7f1aa80b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:04.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.774+0000 7f1aafce9700 1 -- 172.21.15.179:0/3022430678 shutdown_connections 2023-12-07T00:15:04.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.774+0000 7f1aafce9700 1 -- 172.21.15.179:0/3022430678 wait complete. 2023-12-07T00:15:04.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.775+0000 7f1aafce9700 1 Processor -- start 2023-12-07T00:15:04.779 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.775+0000 7f1aafce9700 1 -- start start 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aafce9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a94004d90 0x7f1aa81e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aafce9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa80c8d50 0x7f1aa80b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aafce9700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aa80c91d0 0x7f1aa8155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aafce9700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80c9ef0 con 0x7f1aa80c91d0 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aafce9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80cb080 con 0x7f1aa80c8d50 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aafce9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa80c9650 con 0x7f1a94004d90 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aa80c91d0 0x7f1aa8155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aa80c91d0 0x7f1aa8155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40538/0 (socket says 172.21.15.179:40538) 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 -- 172.21.15.179:0/2137877448 learned_addr learned my addr 172.21.15.179:0/2137877448 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aad284700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa80c8d50 0x7f1aa80b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aada85700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a94004d90 0x7f1aa81e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 -- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a94004d90 msgr2=0x7f1aa81e4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a94004d90 0x7f1aa81e4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 -- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa80c8d50 msgr2=0x7f1aa80b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa80c8d50 0x7f1aa80b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 -- 172.21.15.179:0/2137877448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa80c9930 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aad284700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa80c8d50 0x7f1aa80b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.776+0000 7f1aae286700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aa80c91d0 0x7f1aa8155380 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0002230 tx=0x7f1aa000a860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.777+0000 7f1a9e7fc700 1 -- 172.21.15.179:0/2137877448 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0015890 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.777+0000 7f1a9e7fc700 1 -- 172.21.15.179:0/2137877448 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0015a10 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.777+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa80c9c10 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.777+0000 7f1a9e7fc700 1 -- 172.21.15.179:0/2137877448 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0015dc0 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.777+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa80b27a0 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.778+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa80b2930 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.778+0000 7f1a9e7fc700 1 -- 172.21.15.179:0/2137877448 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1aa0008440 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.779+0000 7f1a9e7fc700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a8c06aed0 0x7f1a8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.779+0000 7f1aada85700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a8c06aed0 0x7f1a8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.779+0000 7f1a9e7fc700 1 -- 172.21.15.179:0/2137877448 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1aa008b5d0 con 0x7f1aa80c91d0 2023-12-07T00:15:04.781 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.779+0000 7f1aada85700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a8c06aed0 0x7f1a8c06d390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1aa81f49a0 tx=0x7f1aa4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:04.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.783+0000 7f1a9e7fc700 1 -- 172.21.15.179:0/2137877448 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1aa0059fb0 con 0x7f1aa80c91d0 2023-12-07T00:15:04.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.975+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1aa80cb540 con 0x7f1aa80c91d0 2023-12-07T00:15:04.975 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.976+0000 7f1a9e7fc700 1 -- 172.21.15.179:0/2137877448 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1aa80cb540 con 0x7f1aa80c91d0 2023-12-07T00:15:04.975 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a8c06aed0 msgr2=0x7f1a8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a8c06aed0 0x7f1a8c06d390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1aa81f49a0 tx=0x7f1aa4008040 comp rx=0 tx=0).stop 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aa80c91d0 msgr2=0x7f1aa8155380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aa80c91d0 0x7f1aa8155380 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0002230 tx=0x7f1aa000a860 comp rx=0 tx=0).stop 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 shutdown_connections 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a8c06aed0 0x7f1a8c06d390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1aa80c91d0 0x7f1aa8155380 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a94004d90 0x7f1aa81e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 --2- 172.21.15.179:0/2137877448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1aa80c8d50 0x7f1aa80b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 >> 172.21.15.179:0/2137877448 conn(0x7f1aa80b3270 msgr2=0x7f1aa815bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 shutdown_connections 2023-12-07T00:15:04.978 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:04.978+0000 7f1aafce9700 1 -- 172.21.15.179:0/2137877448 wait complete. 2023-12-07T00:15:04.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T00:15:05.111 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.112+0000 7f81b823a700 1 Processor -- start 2023-12-07T00:15:05.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.112+0000 7f81b823a700 1 -- start start 2023-12-07T00:15:05.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.113+0000 7f81b823a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f81b00d06b0 0x7f81b0099c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.113+0000 7f81b823a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b009a550 con 0x7f81b015bde0 2023-12-07T00:15:05.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.113+0000 7f81b823a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b009ab50 con 0x7f81b009a140 2023-12-07T00:15:05.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.113+0000 7f81b823a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b00cf630 con 0x7f81b00d06b0 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.113+0000 7f81b5fd6700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f81b015bde0 0x7f81b00cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47444/0 (socket says 172.21.15.179:47444) 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.113+0000 7f81b5fd6700 1 -- 172.21.15.179:0/811655214 learned_addr learned my addr 172.21.15.179:0/811655214 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b57d5700 1 --2- 172.21.15.179:0/811655214 >> v2:172.21.15.190:3300/0 conn(0x7f81b00d06b0 0x7f81b0099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b4fd4700 1 -- 172.21.15.179:0/811655214 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007802317 0 0) 0x7f81b009a550 con 0x7f81b015bde0 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b4fd4700 1 -- 172.21.15.179:0/811655214 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f819c0035b0 con 0x7f81b015bde0 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b57d5700 1 -- 172.21.15.179:0/811655214 >> v1:172.21.15.190:6789/0 conn(0x7f81b009a140 legacy=0x7f81b00b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b57d5700 1 -- 172.21.15.179:0/811655214 >> v1:172.21.15.179:6789/0 conn(0x7f81b015bde0 legacy=0x7f81b00cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b57d5700 1 -- 172.21.15.179:0/811655214 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b00cf8f0 con 0x7f81b00d06b0 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b57d5700 1 --2- 172.21.15.179:0/811655214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b00d06b0 0x7f81b0099c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009840 tx=0x7f81ac009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d435e14ae9fb9ce server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b4fd4700 1 -- 172.21.15.179:0/811655214 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac011830 con 0x7f81b00d06b0 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b4fd4700 1 -- 172.21.15.179:0/811655214 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac011990 con 0x7f81b00d06b0 2023-12-07T00:15:05.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.114+0000 7f81b4fd4700 1 -- 172.21.15.179:0/811655214 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac011d20 con 0x7f81b00d06b0 2023-12-07T00:15:05.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.115+0000 7f81b823a700 1 -- 172.21.15.179:0/811655214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b00d06b0 msgr2=0x7f81b0099c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.115+0000 7f81b823a700 1 --2- 172.21.15.179:0/811655214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b00d06b0 0x7f81b0099c00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009840 tx=0x7f81ac009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:05.115 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.115+0000 7f81b823a700 1 -- 172.21.15.179:0/811655214 shutdown_connections 2023-12-07T00:15:05.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.115+0000 7f81b823a700 1 --2- 172.21.15.179:0/811655214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b00d06b0 0x7f81b0099c00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.115+0000 7f81b823a700 1 -- 172.21.15.179:0/811655214 >> 172.21.15.179:0/811655214 conn(0x7f81b00b3550 msgr2=0x7f81b00b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:05.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.115+0000 7f81b823a700 1 -- 172.21.15.179:0/811655214 shutdown_connections 2023-12-07T00:15:05.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.115+0000 7f81b823a700 1 -- 172.21.15.179:0/811655214 wait complete. 2023-12-07T00:15:05.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.116+0000 7f81b823a700 1 Processor -- start 2023-12-07T00:15:05.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.116+0000 7f81b823a700 1 -- start start 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b823a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81b009a140 0x7f81b006cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b823a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b00d06b0 0x7f81b015c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b823a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b015bde0 0x7f81b015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b823a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b015c700 con 0x7f81b009a140 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b823a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b015d520 con 0x7f81b015bde0 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b823a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b015c910 con 0x7f81b00d06b0 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81b009a140 0x7f81b006cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81b009a140 0x7f81b006cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40550/0 (socket says 172.21.15.179:40550) 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 -- 172.21.15.179:0/360753478 learned_addr learned my addr 172.21.15.179:0/360753478 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:05.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b57d5700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b00d06b0 0x7f81b015c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b67d7700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b015bde0 0x7f81b015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 -- 172.21.15.179:0/360753478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b00d06b0 msgr2=0x7f81b015c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b00d06b0 0x7f81b015c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 -- 172.21.15.179:0/360753478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b015bde0 msgr2=0x7f81b015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b015bde0 0x7f81b015d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 -- 172.21.15.179:0/360753478 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac0094a0 con 0x7f81b009a140 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.117+0000 7f81b5fd6700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81b009a140 0x7f81b006cec0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c700 tx=0x7f81a000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.118+0000 7f81a67fc700 1 -- 172.21.15.179:0/360753478 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0005d70 con 0x7f81b009a140 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.118+0000 7f81a67fc700 1 -- 172.21.15.179:0/360753478 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a00070d0 con 0x7f81b009a140 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.118+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b015cbf0 con 0x7f81b009a140 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.118+0000 7f81a67fc700 1 -- 172.21.15.179:0/360753478 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0007460 con 0x7f81b009a140 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.118+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b015d1b0 con 0x7f81b009a140 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.118+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b015d340 con 0x7f81b009a140 2023-12-07T00:15:05.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.119+0000 7f81a67fc700 1 -- 172.21.15.179:0/360753478 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81a00075c0 con 0x7f81b009a140 2023-12-07T00:15:05.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.119+0000 7f81a67fc700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f819406aed0 0x7f819406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.119+0000 7f81a67fc700 1 -- 172.21.15.179:0/360753478 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f81a0088f70 con 0x7f81b009a140 2023-12-07T00:15:05.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.119+0000 7f81b57d5700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f819406aed0 0x7f819406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.120 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.120+0000 7f81b57d5700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f819406aed0 0x7f819406d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f81b0153b70 tx=0x7f81ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:05.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.124+0000 7f81a67fc700 1 -- 172.21.15.179:0/360753478 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81a00bbe90 con 0x7f81b009a140 2023-12-07T00:15:05.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.328+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f81b00685f0 con 0x7f81b009a140 2023-12-07T00:15:05.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.328+0000 7f81a67fc700 1 -- 172.21.15.179:0/360753478 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f81a0053c70 con 0x7f81b009a140 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f819406aed0 msgr2=0x7f819406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f819406aed0 0x7f819406d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f81b0153b70 tx=0x7f81ac008030 comp rx=0 tx=0).stop 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81b009a140 msgr2=0x7f81b006cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81b009a140 0x7f81b006cec0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c700 tx=0x7f81a000cac0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 shutdown_connections 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f819406aed0 0x7f819406d390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81b015bde0 0x7f81b015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81b009a140 0x7f81b006cec0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 --2- 172.21.15.179:0/360753478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f81b00d06b0 0x7f81b015c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 >> 172.21.15.179:0/360753478 conn(0x7f81b00b3550 msgr2=0x7f81b00739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 shutdown_connections 2023-12-07T00:15:05.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.330+0000 7f81b823a700 1 -- 172.21.15.179:0/360753478 wait complete. 2023-12-07T00:15:05.331 INFO:teuthology.orchestra.run.smithi179.stderr:listed 0 entries 2023-12-07T00:15:05.342 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-07T00:15:05.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:05.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-07T00:15:05.395 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:15:05.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:05.395 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-07T00:15:05.412 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:15:05.412 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:05.433 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:15:05.433 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:05.495 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:15:05.495 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:05.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:05.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.678+0000 7fb05bbda700 1 Processor -- start 2023-12-07T00:15:05.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.678+0000 7fb05bbda700 1 -- start start 2023-12-07T00:15:05.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.679+0000 7fb05bbda700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb054158560 0x7fb0540b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.679+0000 7fb05bbda700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb05415b010 0x7fb0540b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.679+0000 7fb05bbda700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0540b2ef0 con 0x7fb0540b2aa0 2023-12-07T00:15:05.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.679+0000 7fb05bbda700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05415b8d0 con 0x7fb05415b010 2023-12-07T00:15:05.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.679+0000 7fb05bbda700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05415bbb0 con 0x7fb054158560 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.679+0000 7fb059175700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb05415b010 0x7fb0540b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb05a177700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb0540b2aa0 0x7fb05406e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47458/0 (socket says 172.21.15.179:47458) 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb059175700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb05415b010 0x7fb0540b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40556/0 (socket says 172.21.15.179:40556) 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb05a177700 1 -- 172.21.15.179:0/2381737215 learned_addr learned my addr 172.21.15.179:0/2381737215 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb059976700 1 --2- 172.21.15.179:0/2381737215 >> v2:172.21.15.190:3300/0 conn(0x7fb054158560 0x7fb0540b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb059175700 1 -- 172.21.15.179:0/2381737215 >> v2:172.21.15.190:3300/0 conn(0x7fb054158560 msgr2=0x7fb0540b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb059175700 1 --2- 172.21.15.179:0/2381737215 >> v2:172.21.15.190:3300/0 conn(0x7fb054158560 0x7fb0540b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb059175700 1 -- 172.21.15.179:0/2381737215 >> v1:172.21.15.179:6789/0 conn(0x7fb0540b2aa0 legacy=0x7fb05406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb058974700 1 -- 172.21.15.179:0/2381737215 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447923068 0 0) 0x7fb04c001490 con 0x7fb0540b2aa0 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb059175700 1 -- 172.21.15.179:0/2381737215 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05415be90 con 0x7fb05415b010 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb059175700 1 --2- 172.21.15.179:0/2381737215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb0540b2560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb0540b5da0 tx=0x7fb050009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18bdeedc584ac0c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb058974700 1 -- 172.21.15.179:0/2381737215 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb050005e30 con 0x7fb05415b010 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb058974700 1 -- 172.21.15.179:0/2381737215 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb050006030 con 0x7fb05415b010 2023-12-07T00:15:05.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.680+0000 7fb058974700 1 -- 172.21.15.179:0/2381737215 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0500063c0 con 0x7fb05415b010 2023-12-07T00:15:05.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.681+0000 7fb05bbda700 1 -- 172.21.15.179:0/2381737215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 msgr2=0x7fb0540b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.681+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2381737215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb0540b2560 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb0540b5da0 tx=0x7fb050009b00 comp rx=0 tx=0).stop 2023-12-07T00:15:05.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.681+0000 7fb05bbda700 1 -- 172.21.15.179:0/2381737215 shutdown_connections 2023-12-07T00:15:05.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.681+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2381737215 >> v2:172.21.15.190:3300/0 conn(0x7fb054158560 0x7fb0540b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.681+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2381737215 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb0540b2560 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.681+0000 7fb05bbda700 1 -- 172.21.15.179:0/2381737215 >> 172.21.15.179:0/2381737215 conn(0x7fb054072970 msgr2=0x7fb054072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:05.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.681+0000 7fb05bbda700 1 -- 172.21.15.179:0/2381737215 shutdown_connections 2023-12-07T00:15:05.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.681+0000 7fb05bbda700 1 -- 172.21.15.179:0/2381737215 wait complete. 2023-12-07T00:15:05.685 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.682+0000 7fb05bbda700 1 Processor -- start 2023-12-07T00:15:05.685 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.682+0000 7fb05bbda700 1 -- start start 2023-12-07T00:15:05.685 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05bbda700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0540b2aa0 0x7fb0541530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.685 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05bbda700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb054158560 0x7fb05413c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05bbda700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb05413c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05bbda700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054152c40 con 0x7fb05415b010 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05bbda700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb054152030 con 0x7fb0540b2aa0 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05bbda700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb054152310 con 0x7fb054158560 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb05413c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb05413c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40564/0 (socket says 172.21.15.179:40564) 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 -- 172.21.15.179:0/2761224098 learned_addr learned my addr 172.21.15.179:0/2761224098 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 -- 172.21.15.179:0/2761224098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb054158560 msgr2=0x7fb05413c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb059175700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb054158560 0x7fb05413c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb059976700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0540b2aa0 0x7fb0541530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb054158560 0x7fb05413c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.686 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 -- 172.21.15.179:0/2761224098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0540b2aa0 msgr2=0x7fb0541530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0540b2aa0 0x7fb0541530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 -- 172.21.15.179:0/2761224098 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050009430 con 0x7fb05415b010 2023-12-07T00:15:05.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05a177700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb05413c690 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00cba0 tx=0x7fb04c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:05.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb04a7fc700 1 -- 172.21.15.179:0/2761224098 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00ab80 con 0x7fb05415b010 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb04a7fc700 1 -- 172.21.15.179:0/2761224098 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c00ad00 con 0x7fb05415b010 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb04a7fc700 1 -- 172.21.15.179:0/2761224098 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c007310 con 0x7fb05415b010 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0541525f0 con 0x7fb05415b010 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.683+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb054151ce0 con 0x7fb05415b010 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.685+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05404f290 con 0x7fb05415b010 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.685+0000 7fb04a7fc700 1 -- 172.21.15.179:0/2761224098 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb04c007470 con 0x7fb05415b010 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.685+0000 7fb04a7fc700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb03806aed0 0x7fb03806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.685+0000 7fb04a7fc700 1 -- 172.21.15.179:0/2761224098 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb04c089200 con 0x7fb05415b010 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.685+0000 7fb059976700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb03806aed0 0x7fb03806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:05.688 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.686+0000 7fb059976700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb03806aed0 0x7fb03806d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb044009ab0 tx=0x7fb044008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:05.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.690+0000 7fb04a7fc700 1 -- 172.21.15.179:0/2761224098 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb04c053f80 con 0x7fb05415b010 2023-12-07T00:15:05.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.879+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0540b2ef0 con 0x7fb05415b010 2023-12-07T00:15:05.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.881+0000 7fb04a7fc700 1 -- 172.21.15.179:0/2761224098 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7fb0540b2ef0 con 0x7fb05415b010 2023-12-07T00:15:05.880 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:05.880 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:05.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb03806aed0 msgr2=0x7fb03806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb03806aed0 0x7fb03806d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb044009ab0 tx=0x7fb044008040 comp rx=0 tx=0).stop 2023-12-07T00:15:05.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 msgr2=0x7fb05413c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:05.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb05413c690 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00cba0 tx=0x7fb04c00cf60 comp rx=0 tx=0).stop 2023-12-07T00:15:05.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 shutdown_connections 2023-12-07T00:15:05.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb03806aed0 0x7fb03806d390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb05415b010 0x7fb05413c690 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0540b2aa0 0x7fb0541530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 --2- 172.21.15.179:0/2761224098 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb054158560 0x7fb05413c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:05.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 >> 172.21.15.179:0/2761224098 conn(0x7fb054072970 msgr2=0x7fb0540d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:05.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 shutdown_connections 2023-12-07T00:15:05.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:05.883+0000 7fb05bbda700 1 -- 172.21.15.179:0/2761224098 wait complete. 2023-12-07T00:15:05.894 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:15:05.895 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:15:06.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.019+0000 7f95d5409700 1 Processor -- start 2023-12-07T00:15:06.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.019+0000 7f95d5409700 1 -- start start 2023-12-07T00:15:06.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95d5409700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 0x7f95d00cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95d5409700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d00ccac0 con 0x7f95d00cc590 2023-12-07T00:15:06.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95d5409700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d00ccda0 con 0x7f95d015bd70 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95d5409700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00cd740 con 0x7f95d009a2a0 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95ce7fc700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f95d00cc590 0x7f95d0099b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47470/0 (socket says 172.21.15.179:47470) 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95ce7fc700 1 -- 172.21.15.179:0/230474081 learned_addr learned my addr 172.21.15.179:0/230474081 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cf7fe700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 0x7f95d00cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225381801 0 0) 0x7f95d00ccac0 con 0x7f95d00cc590 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b80035b0 con 0x7f95d00cc590 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649665532 0 0) 0x7f95d00ccda0 con 0x7f95d015bd70 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d00ccac0 con 0x7f95d015bd70 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4151094323 0 0) 0x7f95b80035b0 con 0x7f95d00cc590 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 msgr2=0x7f95d00cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 0x7f95d00cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 >> v1:172.21.15.190:6789/0 conn(0x7f95d015bd70 legacy=0x7f95d00d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d00cd080 con 0x7f95d00cc590 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f95c0001670 con 0x7f95d00cc590 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.020+0000 7f95cf7fe700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 0x7f95d00cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 >> v1:172.21.15.179:6789/0 conn(0x7f95d00cc590 legacy=0x7f95d0099b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95b8003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95b8004850 0x7f95b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 0x7f95b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d00cd740 con 0x7f95b8003bc0 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b800bb20 con 0x7f95b8004850 2023-12-07T00:15:06.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b800bce0 con 0x7f95d009a2a0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95ceffd700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95b8003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95ce7fc700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95b8004850 0x7f95b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cf7fe700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 0x7f95b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95ceffd700 1 -- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 msgr2=0x7f95b8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95ceffd700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 0x7f95b8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95ceffd700 1 -- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95b8004850 msgr2=0x7f95b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95ceffd700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95b8004850 0x7f95b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95ceffd700 1 -- 172.21.15.179:0/230474081 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c8009a70 con 0x7f95b8003bc0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cf7fe700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d009a2a0 0x7f95b8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95ceffd700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95b8003fc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f95c4007fd0 tx=0x7f95b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0f60fc1b14b3ee server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4001d80 con 0x7f95b8003bc0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c40052d0 con 0x7f95b8003bc0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.021+0000 7f95cdffb700 1 -- 172.21.15.179:0/230474081 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4001470 con 0x7f95b8003bc0 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.022+0000 7f95d5409700 1 -- 172.21.15.179:0/230474081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 msgr2=0x7f95b8003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.022+0000 7f95d5409700 1 --2- 172.21.15.179:0/230474081 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95b8003fc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f95c4007fd0 tx=0x7f95b8005880 comp rx=0 tx=0).stop 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.022+0000 7f95cf7fe700 1 -- 172.21.15.179:0/230474081 reap_dead start 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.022+0000 7f95d5409700 1 -- 172.21.15.179:0/230474081 shutdown_connections 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.022+0000 7f95d5409700 1 -- 172.21.15.179:0/230474081 >> 172.21.15.179:0/230474081 conn(0x7f95d00b34e0 msgr2=0x7f95d00b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.022+0000 7f95d5409700 1 -- 172.21.15.179:0/230474081 shutdown_connections 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.022+0000 7f95d5409700 1 -- 172.21.15.179:0/230474081 wait complete. 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.023+0000 7f95d5409700 1 Processor -- start 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.023+0000 7f95d5409700 1 -- start start 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95d5409700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95d015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95d5409700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d0152a40 0x7f95d00ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95d5409700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95d00c8ac0 0x7f95d00c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95d5409700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d01521e0 con 0x7f95b8003bc0 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95d5409700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d0152ec0 con 0x7f95d00c8ac0 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95d5409700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d01531a0 con 0x7f95d0152a40 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95d015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95d015eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40580/0 (socket says 172.21.15.179:40580) 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 -- 172.21.15.179:0/974061164 learned_addr learned my addr 172.21.15.179:0/974061164 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95cf7fe700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95d00c8ac0 0x7f95d00c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 -- 172.21.15.179:0/974061164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d0152a40 msgr2=0x7f95d00ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d0152a40 0x7f95d00ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 -- 172.21.15.179:0/974061164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95d00c8ac0 msgr2=0x7f95d00c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95d00c8ac0 0x7f95d00c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 -- 172.21.15.179:0/974061164 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d0153480 con 0x7f95b8003bc0 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.024+0000 7f95ceffd700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95d015eb50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f95b800baf0 tx=0x7f95c4001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.025+0000 7f95b77fe700 1 -- 172.21.15.179:0/974061164 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4001d80 con 0x7f95b8003bc0 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.025+0000 7f95b77fe700 1 -- 172.21.15.179:0/974061164 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c4001410 con 0x7f95b8003bc0 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.025+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d0153760 con 0x7f95b8003bc0 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.025+0000 7f95b77fe700 1 -- 172.21.15.179:0/974061164 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4001110 con 0x7f95b8003bc0 2023-12-07T00:15:06.029 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.025+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d015f090 con 0x7f95b8003bc0 2023-12-07T00:15:06.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.026+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d00685f0 con 0x7f95b8003bc0 2023-12-07T00:15:06.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.026+0000 7f95b77fe700 1 -- 172.21.15.179:0/974061164 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95c40072a0 con 0x7f95b8003bc0 2023-12-07T00:15:06.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.026+0000 7f95b77fe700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f95bc06aed0 0x7f95bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.026+0000 7f95b77fe700 1 -- 172.21.15.179:0/974061164 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95c408a970 con 0x7f95b8003bc0 2023-12-07T00:15:06.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.026+0000 7f95ce7fc700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f95bc06aed0 0x7f95bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.027+0000 7f95ce7fc700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f95bc06aed0 0x7f95bc06d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95c0000f60 tx=0x7f95c0000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.031+0000 7f95b77fe700 1 -- 172.21.15.179:0/974061164 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95c40556f0 con 0x7f95b8003bc0 2023-12-07T00:15:06.218 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.219+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95d00b43d0 con 0x7f95b8003bc0 2023-12-07T00:15:06.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.220+0000 7f95b77fe700 1 -- 172.21.15.179:0/974061164 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95c4058d10 con 0x7f95b8003bc0 2023-12-07T00:15:06.219 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:15:06.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f95bc06aed0 msgr2=0x7f95bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f95bc06aed0 0x7f95bc06d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95c0000f60 tx=0x7f95c0000ed0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 msgr2=0x7f95d015eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95d015eb50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f95b800baf0 tx=0x7f95c4001310 comp rx=0 tx=0).stop 2023-12-07T00:15:06.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 shutdown_connections 2023-12-07T00:15:06.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f95bc06aed0 0x7f95bc06d390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95d00c8ac0 0x7f95d00c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f95b8003bc0 0x7f95d015eb50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 --2- 172.21.15.179:0/974061164 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95d0152a40 0x7f95d00ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 >> 172.21.15.179:0/974061164 conn(0x7f95d00b34e0 msgr2=0x7f95d0099b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:06.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 shutdown_connections 2023-12-07T00:15:06.223 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.222+0000 7f95d5409700 1 -- 172.21.15.179:0/974061164 wait complete. 2023-12-07T00:15:06.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:15:06.356 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.357+0000 7ffa9a02b700 1 Processor -- start 2023-12-07T00:15:06.356 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.357+0000 7ffa9a02b700 1 -- start start 2023-12-07T00:15:06.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa9a02b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa94099c00 0x7ffa9406c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa9a02b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffa940b2b90 0x7ffa94099fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa9a02b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa940cc390 con 0x7ffa940cfb40 2023-12-07T00:15:06.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa9a02b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9409a520 con 0x7ffa940b2b90 2023-12-07T00:15:06.360 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa9a02b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9415e510 con 0x7ffa94099c00 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa93fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ffa940cfb40 0x7ffa940cffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47494/0 (socket says 172.21.15.179:47494) 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa93fff700 1 -- 172.21.15.179:0/3924123998 learned_addr learned my addr 172.21.15.179:0/3924123998 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa937fe700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa94099c00 0x7ffa9406c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa92ffd700 1 --2- 172.21.15.179:0/3924123998 >> v2:172.21.15.190:3300/0 conn(0x7ffa940b2b90 0x7ffa94099fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617005816 0 0) 0x7ffa940cc390 con 0x7ffa940cfb40 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa7c0035b0 con 0x7ffa940cfb40 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4018649351 0 0) 0x7ffa7c0035b0 con 0x7ffa940cfb40 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa94099c00 msgr2=0x7ffa9406c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa94099c00 0x7ffa9406c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 >> v2:172.21.15.190:3300/0 conn(0x7ffa940b2b90 msgr2=0x7ffa94099fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 --2- 172.21.15.179:0/3924123998 >> v2:172.21.15.190:3300/0 conn(0x7ffa940b2b90 0x7ffa94099fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940d0fc0 con 0x7ffa940cfb40 2023-12-07T00:15:06.361 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7ffa8c0019f0 con 0x7ffa940cfb40 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 >> v1:172.21.15.179:6789/0 conn(0x7ffa940cfb40 legacy=0x7ffa940cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa94099c00 0x7ffa7c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.358+0000 7ffa927fc700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7c003f80 0x7ffa7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa927fc700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa7c004d90 0x7ffa7c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9409a520 con 0x7ffa7c003f80 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9415e510 con 0x7ffa7c004d90 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c00ba60 con 0x7ffa94099c00 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa92ffd700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7c003f80 0x7ffa7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa937fe700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa94099c00 0x7ffa7c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa93fff700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa7c004d90 0x7ffa7c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa92ffd700 1 -- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa94099c00 msgr2=0x7ffa7c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa92ffd700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa94099c00 0x7ffa7c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa92ffd700 1 -- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa7c004d90 msgr2=0x7ffa7c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa92ffd700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa7c004d90 0x7ffa7c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa92ffd700 1 -- 172.21.15.179:0/3924123998 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0035b0 con 0x7ffa7c003f80 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa93fff700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa7c004d90 0x7ffa7c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa92ffd700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7c003f80 0x7ffa7c004850 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009b90 tx=0x7ffa7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c6f9f1356e5ccd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400e6c0 con 0x7ffa7c003f80 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8400e820 con 0x7ffa7c003f80 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.359+0000 7ffa927fc700 1 -- 172.21.15.179:0/3924123998 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8400eb90 con 0x7ffa7c003f80 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.360+0000 7ffa9a02b700 1 -- 172.21.15.179:0/3924123998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7c003f80 msgr2=0x7ffa7c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.360+0000 7ffa9a02b700 1 --2- 172.21.15.179:0/3924123998 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa7c003f80 0x7ffa7c004850 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ffa84009b90 tx=0x7ffa7c005880 comp rx=0 tx=0).stop 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.360+0000 7ffa93fff700 1 -- 172.21.15.179:0/3924123998 reap_dead start 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.360+0000 7ffa9a02b700 1 -- 172.21.15.179:0/3924123998 shutdown_connections 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.360+0000 7ffa9a02b700 1 -- 172.21.15.179:0/3924123998 >> 172.21.15.179:0/3924123998 conn(0x7ffa940b34c0 msgr2=0x7ffa940b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.360+0000 7ffa9a02b700 1 -- 172.21.15.179:0/3924123998 shutdown_connections 2023-12-07T00:15:06.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.360+0000 7ffa9a02b700 1 -- 172.21.15.179:0/3924123998 wait complete. 2023-12-07T00:15:06.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.361+0000 7ffa9a02b700 1 Processor -- start 2023-12-07T00:15:06.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.361+0000 7ffa9a02b700 1 -- start start 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa9a02b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa7c003f80 0x7ffa94148d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa9a02b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa940b5970 0x7ffa940b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa9a02b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa940b6570 0x7ffa9415cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa9a02b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940b54e0 con 0x7ffa940b6570 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa9a02b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940b45f0 con 0x7ffa940b5970 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa9a02b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa940b48d0 con 0x7ffa7c003f80 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa940b6570 0x7ffa9415cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa940b6570 0x7ffa9415cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40604/0 (socket says 172.21.15.179:40604) 2023-12-07T00:15:06.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 -- 172.21.15.179:0/1139011119 learned_addr learned my addr 172.21.15.179:0/1139011119 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 -- 172.21.15.179:0/1139011119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa7c003f80 msgr2=0x7ffa94148d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa7c003f80 0x7ffa94148d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa92ffd700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa940b5970 0x7ffa940b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 -- 172.21.15.179:0/1139011119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa940b5970 msgr2=0x7ffa940b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa940b5970 0x7ffa940b6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 -- 172.21.15.179:0/1139011119 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940b4bb0 con 0x7ffa940b6570 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.362+0000 7ffa93fff700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa940b6570 0x7ffa9415cef0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c001370 tx=0x7ffa8c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.363+0000 7ffa7bfff700 1 -- 172.21.15.179:0/1139011119 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c00ee20 con 0x7ffa940b6570 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.363+0000 7ffa7bfff700 1 -- 172.21.15.179:0/1139011119 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c013420 con 0x7ffa940b6570 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.363+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa940b4e90 con 0x7ffa940b6570 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.363+0000 7ffa7bfff700 1 -- 172.21.15.179:0/1139011119 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c013790 con 0x7ffa940b6570 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.363+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa941492b0 con 0x7ffa940b6570 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.364+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa94067ee0 con 0x7ffa940b6570 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.364+0000 7ffa7bfff700 1 -- 172.21.15.179:0/1139011119 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa8c0138f0 con 0x7ffa940b6570 2023-12-07T00:15:06.367 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.364+0000 7ffa7bfff700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa8006aed0 0x7ffa8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.368 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.364+0000 7ffa7bfff700 1 -- 172.21.15.179:0/1139011119 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffa8c08a140 con 0x7ffa940b6570 2023-12-07T00:15:06.368 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.364+0000 7ffa937fe700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa8006aed0 0x7ffa8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.368 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.365+0000 7ffa937fe700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa8006aed0 0x7ffa8006d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa88006dd0 tx=0x7ffa88006cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.368 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.369+0000 7ffa7bfff700 1 -- 172.21.15.179:0/1139011119 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa8c054e30 con 0x7ffa940b6570 2023-12-07T00:15:06.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.559+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa940b5620 con 0x7ffa940b6570 2023-12-07T00:15:06.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.560+0000 7ffa7bfff700 1 -- 172.21.15.179:0/1139011119 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa940b5620 con 0x7ffa940b6570 2023-12-07T00:15:06.559 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:06.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa8006aed0 msgr2=0x7ffa8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa8006aed0 0x7ffa8006d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ffa88006dd0 tx=0x7ffa88006cc0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.561 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa940b6570 msgr2=0x7ffa9415cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa940b6570 0x7ffa9415cef0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c001370 tx=0x7ffa8c007c90 comp rx=0 tx=0).stop 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 shutdown_connections 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa8006aed0 0x7ffa8006d390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffa940b6570 0x7ffa9415cef0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffa7c003f80 0x7ffa94148d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 --2- 172.21.15.179:0/1139011119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffa940b5970 0x7ffa940b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 >> 172.21.15.179:0/1139011119 conn(0x7ffa940b34c0 msgr2=0x7ffa9406d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 shutdown_connections 2023-12-07T00:15:06.562 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.562+0000 7ffa9a02b700 1 -- 172.21.15.179:0/1139011119 wait complete. 2023-12-07T00:15:06.573 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:15:06.699 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.699+0000 7fb10ed6e700 1 Processor -- start 2023-12-07T00:15:06.699 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.700+0000 7fb10ed6e700 1 -- start start 2023-12-07T00:15:06.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.700+0000 7fb10ed6e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb10806b680 0x7fb1080cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.700+0000 7fb10ed6e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb108161c70 0x7fb108162090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.700+0000 7fb10ed6e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1080cb0f0 con 0x7fb108161360 2023-12-07T00:15:06.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.700+0000 7fb10ed6e700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb108161740 con 0x7fb10806b680 2023-12-07T00:15:06.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.700+0000 7fb10ed6e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1080cb340 con 0x7fb108161c70 2023-12-07T00:15:06.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.700+0000 7fb107fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb10806b680 0x7fb1080cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.700+0000 7fb107fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb10806b680 0x7fb1080cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40610/0 (socket says 172.21.15.179:40610) 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb107fff700 1 -- 172.21.15.179:0/3900233737 learned_addr learned my addr 172.21.15.179:0/3900233737 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb10d30b700 1 --2- 172.21.15.179:0/3900233737 >> v2:172.21.15.190:3300/0 conn(0x7fb108161c70 0x7fb108162090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb107fff700 1 -- 172.21.15.179:0/3900233737 >> v2:172.21.15.190:3300/0 conn(0x7fb108161c70 msgr2=0x7fb108162090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb107fff700 1 --2- 172.21.15.179:0/3900233737 >> v2:172.21.15.190:3300/0 conn(0x7fb108161c70 0x7fb108162090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb107fff700 1 -- 172.21.15.179:0/3900233737 >> v1:172.21.15.190:6789/0 conn(0x7fb108161360 legacy=0x7fb10806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb107fff700 1 -- 172.21.15.179:0/3900233737 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080cb620 con 0x7fb10806b680 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb10d30b700 1 --2- 172.21.15.179:0/3900233737 >> v2:172.21.15.190:3300/0 conn(0x7fb108161c70 0x7fb108162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb107fff700 1 --2- 172.21.15.179:0/3900233737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806b680 0x7fb1080cc100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb1080c7af0 tx=0x7fb0f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea7a19844283e47 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb1077fe700 1 -- 172.21.15.179:0/3900233737 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4004230 con 0x7fb10806b680 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb1077fe700 1 -- 172.21.15.179:0/3900233737 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4004390 con 0x7fb10806b680 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.701+0000 7fb1077fe700 1 -- 172.21.15.179:0/3900233737 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f40036a0 con 0x7fb10806b680 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.702+0000 7fb10ed6e700 1 -- 172.21.15.179:0/3900233737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806b680 msgr2=0x7fb1080cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.702+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/3900233737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806b680 0x7fb1080cc100 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb1080c7af0 tx=0x7fb0f4009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.702+0000 7fb10ed6e700 1 -- 172.21.15.179:0/3900233737 shutdown_connections 2023-12-07T00:15:06.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.702+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/3900233737 >> v2:172.21.15.190:3300/0 conn(0x7fb108161c70 0x7fb108162090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.702+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/3900233737 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb10806b680 0x7fb1080cc100 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.702+0000 7fb10ed6e700 1 -- 172.21.15.179:0/3900233737 >> 172.21.15.179:0/3900233737 conn(0x7fb108099a40 msgr2=0x7fb108099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:06.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.702+0000 7fb10ed6e700 1 -- 172.21.15.179:0/3900233737 shutdown_connections 2023-12-07T00:15:06.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.702+0000 7fb10ed6e700 1 -- 172.21.15.179:0/3900233737 wait complete. 2023-12-07T00:15:06.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.703+0000 7fb10ed6e700 1 Processor -- start 2023-12-07T00:15:06.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.703+0000 7fb10ed6e700 1 -- start start 2023-12-07T00:15:06.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb10ed6e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb10806b680 0x7fb1081e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb10ed6e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb108161360 0x7fb10815fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb10ed6e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb108161c70 0x7fb1081e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb10ed6e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1081e9be0 con 0x7fb108161360 2023-12-07T00:15:06.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb10ed6e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1081e9210 con 0x7fb10806b680 2023-12-07T00:15:06.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb10ed6e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1081e8600 con 0x7fb108161c70 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb108161360 0x7fb10815fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb108161360 0x7fb10815fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40616/0 (socket says 172.21.15.179:40616) 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 -- 172.21.15.179:0/413575784 learned_addr learned my addr 172.21.15.179:0/413575784 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 -- 172.21.15.179:0/413575784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb108161c70 msgr2=0x7fb1081e7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb108161c70 0x7fb1081e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb10cb0a700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb10806b680 0x7fb1081e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 -- 172.21.15.179:0/413575784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb10806b680 msgr2=0x7fb1081e96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb10806b680 0x7fb1081e96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 -- 172.21.15.179:0/413575784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4009550 con 0x7fb108161360 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.704+0000 7fb107fff700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb108161360 0x7fb10815fb80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb1080d1ba0 tx=0x7fb0f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.705+0000 7fb1057fa700 1 -- 172.21.15.179:0/413575784 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4011630 con 0x7fb108161360 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.705+0000 7fb1057fa700 1 -- 172.21.15.179:0/413575784 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4011790 con 0x7fb108161360 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.705+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1081e88e0 con 0x7fb108161360 2023-12-07T00:15:06.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.705+0000 7fb1057fa700 1 -- 172.21.15.179:0/413575784 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4011b40 con 0x7fb108161360 2023-12-07T00:15:06.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.705+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1081e8ea0 con 0x7fb108161360 2023-12-07T00:15:06.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.706+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1081e93c0 con 0x7fb108161360 2023-12-07T00:15:06.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.706+0000 7fb1057fa700 1 -- 172.21.15.179:0/413575784 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0f4011ca0 con 0x7fb108161360 2023-12-07T00:15:06.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.706+0000 7fb1057fa700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb0ec06aed0 0x7fb0ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:06.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.707+0000 7fb10cb0a700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb0ec06aed0 0x7fb0ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:06.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.707+0000 7fb1057fa700 1 -- 172.21.15.179:0/413575784 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb0f408b020 con 0x7fb108161360 2023-12-07T00:15:06.708 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.707+0000 7fb10cb0a700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb0ec06aed0 0x7fb0ec06d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00a7d0 tx=0x7fb0fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:06.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.711+0000 7fb1057fa700 1 -- 172.21.15.179:0/413575784 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1081e93c0 con 0x7fb108161360 2023-12-07T00:15:06.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.904+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1081e93c0 con 0x7fb108161360 2023-12-07T00:15:06.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.904+0000 7fb1057fa700 1 -- 172.21.15.179:0/413575784 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1081e93c0 con 0x7fb108161360 2023-12-07T00:15:06.903 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:15:06.905 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb0ec06aed0 msgr2=0x7fb0ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb0ec06aed0 0x7fb0ec06d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00a7d0 tx=0x7fb0fc008040 comp rx=0 tx=0).stop 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb108161360 msgr2=0x7fb10815fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb108161360 0x7fb10815fb80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb1080d1ba0 tx=0x7fb0f4004750 comp rx=0 tx=0).stop 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 shutdown_connections 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb0ec06aed0 0x7fb0ec06d390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb108161c70 0x7fb1081e7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb10806b680 0x7fb1081e96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 --2- 172.21.15.179:0/413575784 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb108161360 0x7fb10815fb80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 >> 172.21.15.179:0/413575784 conn(0x7fb108099a40 msgr2=0x7fb1080cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 shutdown_connections 2023-12-07T00:15:06.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:06.906+0000 7fb10ed6e700 1 -- 172.21.15.179:0/413575784 wait complete. 2023-12-07T00:15:06.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:15:07.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.042+0000 7fb06a67c700 1 Processor -- start 2023-12-07T00:15:07.041 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.042+0000 7fb06a67c700 1 -- start start 2023-12-07T00:15:07.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb06a67c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 0x7fb064070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb06a67c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06406f960 con 0x7fb0640ce770 2023-12-07T00:15:07.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb06a67c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0640cf110 con 0x7fb06415ab70 2023-12-07T00:15:07.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb06a67c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb06415af50 con 0x7fb0640d0ed0 2023-12-07T00:15:07.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb0637fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb0640ce770 0x7fb0640adb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47526/0 (socket says 172.21.15.179:47526) 2023-12-07T00:15:07.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb0637fe700 1 -- 172.21.15.179:0/1766923889 learned_addr learned my addr 172.21.15.179:0/1766923889 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:07.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb068c19700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 0x7fb064070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1700430828 0 0) 0x7fb06406f960 con 0x7fb0640ce770 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb04c0035b0 con 0x7fb0640ce770 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946325065 0 0) 0x7fb04c0035b0 con 0x7fb0640ce770 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 msgr2=0x7fb064070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 0x7fb064070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 >> v1:172.21.15.190:6789/0 conn(0x7fb06415ab70 legacy=0x7fb0640d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640cf3f0 con 0x7fb0640ce770 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fb058001670 con 0x7fb0640ce770 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.043+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 >> v1:172.21.15.179:6789/0 conn(0x7fb0640ce770 legacy=0x7fb0640adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c003a30 0x7fb04c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04c004850 0x7fb04c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 0x7fb04c005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06415af50 con 0x7fb04c004850 2023-12-07T00:15:07.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c00bb70 con 0x7fb04c003a30 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c00bd30 con 0x7fb0640d0ed0 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb0637fe700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04c004850 0x7fb04c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb063fff700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c003a30 0x7fb04c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb068c19700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 0x7fb04c005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb0637fe700 1 -- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 msgr2=0x7fb04c005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb0637fe700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 0x7fb04c005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb0637fe700 1 -- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c003a30 msgr2=0x7fb04c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb0637fe700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb04c003a30 0x7fb04c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb0637fe700 1 -- 172.21.15.179:0/1766923889 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0035b0 con 0x7fb04c004850 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb068c19700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0640d0ed0 0x7fb04c005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb0637fe700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04c004850 0x7fb04c004cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb0640cebb0 tx=0x7fb04c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746b1bfe764b12ba server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05800ce00 con 0x7fb04c004850 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb058005960 con 0x7fb04c004850 2023-12-07T00:15:07.047 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.044+0000 7fb062ffd700 1 -- 172.21.15.179:0/1766923889 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb058005d10 con 0x7fb04c004850 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.045+0000 7fb06a67c700 1 -- 172.21.15.179:0/1766923889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04c004850 msgr2=0x7fb04c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.045+0000 7fb06a67c700 1 --2- 172.21.15.179:0/1766923889 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb04c004850 0x7fb04c004cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb0640cebb0 tx=0x7fb04c005880 comp rx=0 tx=0).stop 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.045+0000 7fb068c19700 1 -- 172.21.15.179:0/1766923889 reap_dead start 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.045+0000 7fb06a67c700 1 -- 172.21.15.179:0/1766923889 shutdown_connections 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.045+0000 7fb06a67c700 1 -- 172.21.15.179:0/1766923889 >> 172.21.15.179:0/1766923889 conn(0x7fb064099a40 msgr2=0x7fb064099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.045+0000 7fb06a67c700 1 -- 172.21.15.179:0/1766923889 shutdown_connections 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.045+0000 7fb06a67c700 1 -- 172.21.15.179:0/1766923889 wait complete. 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.046+0000 7fb06a67c700 1 Processor -- start 2023-12-07T00:15:07.048 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.046+0000 7fb06a67c700 1 -- start start 2023-12-07T00:15:07.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb06a67c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb04c004850 0x7fb064154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb06a67c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0640aeae0 0x7fb0640aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb06a67c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640ccad0 0x7fb0640ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb06a67c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06406fc40 con 0x7fb0640ccad0 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb06a67c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640af4a0 con 0x7fb0640aeae0 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb06a67c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0640ca700 con 0x7fb04c004850 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640ccad0 0x7fb0640ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640ccad0 0x7fb0640ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40636/0 (socket says 172.21.15.179:40636) 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 -- 172.21.15.179:0/3476941258 learned_addr learned my addr 172.21.15.179:0/3476941258 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb063fff700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb04c004850 0x7fb064154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb0637fe700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0640aeae0 0x7fb0640aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 -- 172.21.15.179:0/3476941258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb04c004850 msgr2=0x7fb064154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb04c004850 0x7fb064154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 -- 172.21.15.179:0/3476941258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0640aeae0 msgr2=0x7fb0640aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.051 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0640aeae0 0x7fb0640aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 -- 172.21.15.179:0/3476941258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0640c9af0 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb068c19700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640ccad0 0x7fb0640ccf50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb0640cee70 tx=0x7fb05c0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.047+0000 7fb060ff9700 1 -- 172.21.15.179:0/3476941258 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c00e030 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.048+0000 7fb060ff9700 1 -- 172.21.15.179:0/3476941258 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb05c011c80 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.048+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0640c9dd0 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.048+0000 7fb060ff9700 1 -- 172.21.15.179:0/3476941258 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb05c016470 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.048+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0640ca390 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.049+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0640685f0 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.049+0000 7fb060ff9700 1 -- 172.21.15.179:0/3476941258 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb05c0165f0 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.050+0000 7fb060ff9700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb05006aed0 0x7fb05006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.050+0000 7fb063fff700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb05006aed0 0x7fb05006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.050+0000 7fb060ff9700 1 -- 172.21.15.179:0/3476941258 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb05c00f070 con 0x7fb0640ccad0 2023-12-07T00:15:07.052 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.050+0000 7fb063fff700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb05006aed0 0x7fb05006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb0540011a0 tx=0x7fb054009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.053 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.054+0000 7fb060ff9700 1 -- 172.21.15.179:0/3476941258 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb05c0551f0 con 0x7fb0640ccad0 2023-12-07T00:15:07.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.247+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb0640ca840 con 0x7fb0640ccad0 2023-12-07T00:15:07.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.247+0000 7fb060ff9700 1 -- 172.21.15.179:0/3476941258 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb0640ca840 con 0x7fb0640ccad0 2023-12-07T00:15:07.247 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:07.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb05006aed0 msgr2=0x7fb05006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb05006aed0 0x7fb05006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb0540011a0 tx=0x7fb054009040 comp rx=0 tx=0).stop 2023-12-07T00:15:07.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640ccad0 msgr2=0x7fb0640ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640ccad0 0x7fb0640ccf50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb0640cee70 tx=0x7fb05c0114b0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 shutdown_connections 2023-12-07T00:15:07.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb05006aed0 0x7fb05006d390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0640ccad0 0x7fb0640ccf50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb04c004850 0x7fb064154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 --2- 172.21.15.179:0/3476941258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0640aeae0 0x7fb0640aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 >> 172.21.15.179:0/3476941258 conn(0x7fb064099a40 msgr2=0x7fb06415e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:07.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 shutdown_connections 2023-12-07T00:15:07.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.249+0000 7fb06a67c700 1 -- 172.21.15.179:0/3476941258 wait complete. 2023-12-07T00:15:07.261 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T00:15:07.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.383+0000 7f644478a700 1 Processor -- start 2023-12-07T00:15:07.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.383+0000 7f644478a700 1 -- start start 2023-12-07T00:15:07.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f644478a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f643c0b2c70 0x7f643c168a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f644478a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c15f330 con 0x7f643c15de40 2023-12-07T00:15:07.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f644478a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c15e720 con 0x7f643c15e220 2023-12-07T00:15:07.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f644478a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c0d1820 con 0x7f643c0b2c70 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6442d27700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f643c0b2c70 0x7f643c168a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6442526700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f643c15de40 0x7f643c0b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47542/0 (socket says 172.21.15.179:47542) 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6442d27700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f643c0b2c70 0x7f643c168a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40644/0 (socket says 172.21.15.179:40644) 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6442526700 1 -- 172.21.15.179:0/591767392 learned_addr learned my addr 172.21.15.179:0/591767392 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6442d27700 1 -- 172.21.15.179:0/591767392 >> v1:172.21.15.190:6789/0 conn(0x7f643c15e220 legacy=0x7f643c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6442d27700 1 -- 172.21.15.179:0/591767392 >> v1:172.21.15.179:6789/0 conn(0x7f643c15de40 legacy=0x7f643c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6441524700 1 -- 172.21.15.179:0/591767392 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335336151 0 0) 0x7f643c15f330 con 0x7f643c15de40 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6442d27700 1 -- 172.21.15.179:0/591767392 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c15ea00 con 0x7f643c0b2c70 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6442d27700 1 --2- 172.21.15.179:0/591767392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c0b2c70 0x7f643c168a00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6434009dc0 tx=0x7f643400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175a0a835368ae1e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6441524700 1 -- 172.21.15.179:0/591767392 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643400e070 con 0x7f643c0b2c70 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6441524700 1 -- 172.21.15.179:0/591767392 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643400bb90 con 0x7f643c0b2c70 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.384+0000 7f6441524700 1 -- 172.21.15.179:0/591767392 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434012430 con 0x7f643c0b2c70 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.385+0000 7f644478a700 1 -- 172.21.15.179:0/591767392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c0b2c70 msgr2=0x7f643c168a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.385+0000 7f644478a700 1 --2- 172.21.15.179:0/591767392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c0b2c70 0x7f643c168a00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6434009dc0 tx=0x7f643400b330 comp rx=0 tx=0).stop 2023-12-07T00:15:07.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.385+0000 7f644478a700 1 -- 172.21.15.179:0/591767392 shutdown_connections 2023-12-07T00:15:07.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.385+0000 7f644478a700 1 --2- 172.21.15.179:0/591767392 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c0b2c70 0x7f643c168a00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.385+0000 7f644478a700 1 -- 172.21.15.179:0/591767392 >> 172.21.15.179:0/591767392 conn(0x7f643c072970 msgr2=0x7f643c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:07.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.385+0000 7f644478a700 1 -- 172.21.15.179:0/591767392 shutdown_connections 2023-12-07T00:15:07.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.385+0000 7f644478a700 1 -- 172.21.15.179:0/591767392 wait complete. 2023-12-07T00:15:07.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.386+0000 7f644478a700 1 Processor -- start 2023-12-07T00:15:07.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.386+0000 7f644478a700 1 -- start start 2023-12-07T00:15:07.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f644478a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c0b2c70 0x7f643c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f644478a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c15de40 0x7f643c1e9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f644478a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643c15e220 0x7f643c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f644478a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c1e6130 con 0x7f643c15de40 2023-12-07T00:15:07.388 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f644478a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c1e9f60 con 0x7f643c0b2c70 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f644478a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0ccb50 con 0x7f643c15e220 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6441d25700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c15de40 0x7f643c1e9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6441d25700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c15de40 0x7f643c1e9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40648/0 (socket says 172.21.15.179:40648) 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6441d25700 1 -- 172.21.15.179:0/2507622865 learned_addr learned my addr 172.21.15.179:0/2507622865 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6442526700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c0b2c70 0x7f643c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6442d27700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643c15e220 0x7f643c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6441d25700 1 -- 172.21.15.179:0/2507622865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643c15e220 msgr2=0x7f643c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6441d25700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643c15e220 0x7f643c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6441d25700 1 -- 172.21.15.179:0/2507622865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c0b2c70 msgr2=0x7f643c159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6441d25700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c0b2c70 0x7f643c159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.387+0000 7f6441d25700 1 -- 172.21.15.179:0/2507622865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434009a70 con 0x7f643c15de40 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.388+0000 7f6441d25700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c15de40 0x7f643c1e9a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f642c00c400 tx=0x7f642c00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.388+0000 7f6432ffd700 1 -- 172.21.15.179:0/2507622865 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0052d0 con 0x7f643c15de40 2023-12-07T00:15:07.389 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.388+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c1e6380 con 0x7f643c15de40 2023-12-07T00:15:07.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.388+0000 7f6432ffd700 1 -- 172.21.15.179:0/2507622865 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c005450 con 0x7f643c15de40 2023-12-07T00:15:07.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.388+0000 7f6432ffd700 1 -- 172.21.15.179:0/2507622865 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c003910 con 0x7f643c15de40 2023-12-07T00:15:07.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.388+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c1e6940 con 0x7f643c15de40 2023-12-07T00:15:07.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.389+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c04f290 con 0x7f643c15de40 2023-12-07T00:15:07.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.389+0000 7f6432ffd700 1 -- 172.21.15.179:0/2507622865 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f642c003a70 con 0x7f643c15de40 2023-12-07T00:15:07.390 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.390+0000 7f6432ffd700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f642006aed0 0x7f642006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.390+0000 7f6442526700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f642006aed0 0x7f642006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.390+0000 7f6432ffd700 1 -- 172.21.15.179:0/2507622865 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f642c088e70 con 0x7f643c15de40 2023-12-07T00:15:07.391 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.390+0000 7f6442526700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f642006aed0 0x7f642006d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6438000f60 tx=0x7f6438007c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.393 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.394+0000 7f6432ffd700 1 -- 172.21.15.179:0/2507622865 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f642c053ae0 con 0x7f643c15de40 2023-12-07T00:15:07.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.600+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f643c1e6ad0 con 0x7f643c15de40 2023-12-07T00:15:07.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.600+0000 7f6432ffd700 1 -- 172.21.15.179:0/2507622865 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f642c057100 con 0x7f643c15de40 2023-12-07T00:15:07.601 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f642006aed0 msgr2=0x7f642006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f642006aed0 0x7f642006d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6438000f60 tx=0x7f6438007c40 comp rx=0 tx=0).stop 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c15de40 msgr2=0x7f643c1e9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c15de40 0x7f643c1e9a20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f642c00c400 tx=0x7f642c00c7c0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 shutdown_connections 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f642006aed0 0x7f642006d390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643c15e220 0x7f643c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c0b2c70 0x7f643c159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 --2- 172.21.15.179:0/2507622865 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f643c15de40 0x7f643c1e9a20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 >> 172.21.15.179:0/2507622865 conn(0x7f643c072970 msgr2=0x7f643c0b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 shutdown_connections 2023-12-07T00:15:07.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.602+0000 7f644478a700 1 -- 172.21.15.179:0/2507622865 wait complete. 2023-12-07T00:15:07.603 INFO:teuthology.orchestra.run.smithi179.stderr:listed 0 entries 2023-12-07T00:15:07.613 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-07T00:15:07.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:07.614 DEBUG:teuthology.orchestra.run.smithi190:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-07T00:15:07.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T00:15:07.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:07.661 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T00:15:07.695 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:15:07.695 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:07.712 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:15:07.713 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:07.770 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:15:07.770 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:07.828 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:07.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.989+0000 7f1a836df700 1 Processor -- start 2023-12-07T00:15:07.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.989+0000 7f1a836df700 1 -- start start 2023-12-07T00:15:07.990 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a836df700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c0d0070 0x7f1a7c0b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.990 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a836df700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a7c066ef0 0x7f1a7c0d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a836df700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7c0673b0 con 0x7f1a7c06af70 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a836df700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7c0b04a0 con 0x7f1a7c066ef0 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a836df700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c15e440 con 0x7f1a7c0d0070 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a80c7a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a7c066ef0 0x7f1a7c0d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a80c7a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a7c066ef0 0x7f1a7c0d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40656/0 (socket says 172.21.15.179:40656) 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a81c7c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1a7c06af70 0x7f1a7c06b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47560/0 (socket says 172.21.15.179:47560) 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a80c7a700 1 -- 172.21.15.179:0/2420263151 learned_addr learned my addr 172.21.15.179:0/2420263151 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a80c7a700 1 -- 172.21.15.179:0/2420263151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c0d0070 msgr2=0x7f1a7c0b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a80c7a700 1 --2- 172.21.15.179:0/2420263151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c0d0070 0x7f1a7c0b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a80c7a700 1 -- 172.21.15.179:0/2420263151 >> v1:172.21.15.179:6789/0 conn(0x7f1a7c06af70 legacy=0x7f1a7c06b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a73fff700 1 -- 172.21.15.179:0/2420263151 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 180320751 0 0) 0x7f1a7c0673b0 con 0x7f1a7c06af70 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a80c7a700 1 -- 172.21.15.179:0/2420263151 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c0d0990 con 0x7f1a7c066ef0 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a80c7a700 1 --2- 172.21.15.179:0/2420263151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c066ef0 0x7f1a7c0d0450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0098f0 tx=0x7f1a6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32f99d7c77f177e server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a73fff700 1 -- 172.21.15.179:0/2420263151 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00b8a0 con 0x7f1a7c066ef0 2023-12-07T00:15:07.991 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a73fff700 1 -- 172.21.15.179:0/2420263151 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00ba00 con 0x7f1a7c066ef0 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.990+0000 7f1a73fff700 1 -- 172.21.15.179:0/2420263151 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00bd90 con 0x7f1a7c066ef0 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.991+0000 7f1a836df700 1 -- 172.21.15.179:0/2420263151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c066ef0 msgr2=0x7f1a7c0d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.991+0000 7f1a836df700 1 --2- 172.21.15.179:0/2420263151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c066ef0 0x7f1a7c0d0450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0098f0 tx=0x7f1a6c009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.991+0000 7f1a836df700 1 -- 172.21.15.179:0/2420263151 shutdown_connections 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.991+0000 7f1a836df700 1 --2- 172.21.15.179:0/2420263151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c0d0070 0x7f1a7c0b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.991+0000 7f1a836df700 1 --2- 172.21.15.179:0/2420263151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c066ef0 0x7f1a7c0d0450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.991+0000 7f1a836df700 1 -- 172.21.15.179:0/2420263151 >> 172.21.15.179:0/2420263151 conn(0x7f1a7c072660 msgr2=0x7f1a7c0b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.991+0000 7f1a836df700 1 -- 172.21.15.179:0/2420263151 shutdown_connections 2023-12-07T00:15:07.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.991+0000 7f1a836df700 1 -- 172.21.15.179:0/2420263151 wait complete. 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.992+0000 7f1a836df700 1 Processor -- start 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.992+0000 7f1a836df700 1 -- start start 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a836df700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c066ef0 0x7f1a7c0cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a836df700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a7c06af70 0x7f1a7c1f7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a836df700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c0d0070 0x7f1a7c0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a836df700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0c9450 con 0x7f1a7c0d0070 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a836df700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c0cc2a0 con 0x7f1a7c06af70 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a836df700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c1f7aa0 con 0x7f1a7c066ef0 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a81c7c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c0d0070 0x7f1a7c0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a81c7c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c0d0070 0x7f1a7c0caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40664/0 (socket says 172.21.15.179:40664) 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a81c7c700 1 -- 172.21.15.179:0/1067107627 learned_addr learned my addr 172.21.15.179:0/1067107627 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a8147b700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c066ef0 0x7f1a7c0cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a80c7a700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a7c06af70 0x7f1a7c1f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a81c7c700 1 -- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c066ef0 msgr2=0x7f1a7c0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a81c7c700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c066ef0 0x7f1a7c0cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a81c7c700 1 -- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a7c06af70 msgr2=0x7f1a7c1f7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a81c7c700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a7c06af70 0x7f1a7c1f7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a81c7c700 1 -- 172.21.15.179:0/1067107627 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c009550 con 0x7f1a7c0d0070 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.993+0000 7f1a80c7a700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a7c06af70 0x7f1a7c1f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.994+0000 7f1a81c7c700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c0d0070 0x7f1a7c0caea0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400cb60 tx=0x7f1a7400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.994+0000 7f1a71ffb700 1 -- 172.21.15.179:0/1067107627 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400ab50 con 0x7f1a7c0d0070 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.994+0000 7f1a71ffb700 1 -- 172.21.15.179:0/1067107627 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400acb0 con 0x7f1a7c0d0070 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.994+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7c1f7d80 con 0x7f1a7c0d0070 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.994+0000 7f1a71ffb700 1 -- 172.21.15.179:0/1067107627 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a74007310 con 0x7f1a7c0d0070 2023-12-07T00:15:07.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.994+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c0c9940 con 0x7f1a7c0d0070 2023-12-07T00:15:07.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.995+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c0685f0 con 0x7f1a7c0d0070 2023-12-07T00:15:07.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.995+0000 7f1a71ffb700 1 -- 172.21.15.179:0/1067107627 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a74007470 con 0x7f1a7c0d0070 2023-12-07T00:15:07.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.996+0000 7f1a71ffb700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a6006aed0 0x7f1a6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:07.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.996+0000 7f1a8147b700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a6006aed0 0x7f1a6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:07.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.996+0000 7f1a71ffb700 1 -- 172.21.15.179:0/1067107627 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1a740897f0 con 0x7f1a7c0d0070 2023-12-07T00:15:07.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:07.996+0000 7f1a8147b700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a6006aed0 0x7f1a6006d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a78006fd0 tx=0x7f1a78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:07.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.000+0000 7f1a71ffb700 1 -- 172.21.15.179:0/1067107627 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a740544e0 con 0x7f1a7c0d0070 2023-12-07T00:15:08.192 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.193+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a7c0d0b80 con 0x7f1a7c0d0070 2023-12-07T00:15:08.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.195+0000 7f1a71ffb700 1 -- 172.21.15.179:0/1067107627 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7f1a74018090 con 0x7f1a7c0d0070 2023-12-07T00:15:08.194 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:08.194 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:08.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a6006aed0 msgr2=0x7f1a6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a6006aed0 0x7f1a6006d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1a78006fd0 tx=0x7f1a78008040 comp rx=0 tx=0).stop 2023-12-07T00:15:08.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c0d0070 msgr2=0x7f1a7c0caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c0d0070 0x7f1a7c0caea0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1a7400cb60 tx=0x7f1a7400cf20 comp rx=0 tx=0).stop 2023-12-07T00:15:08.196 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 shutdown_connections 2023-12-07T00:15:08.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1a6006aed0 0x7f1a6006d390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a7c0d0070 0x7f1a7c0caea0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a7c066ef0 0x7f1a7c0cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 --2- 172.21.15.179:0/1067107627 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a7c06af70 0x7f1a7c1f7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 >> 172.21.15.179:0/1067107627 conn(0x7f1a7c072660 msgr2=0x7f1a7c0739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:08.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 shutdown_connections 2023-12-07T00:15:08.197 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.197+0000 7f1a836df700 1 -- 172.21.15.179:0/1067107627 wait complete. 2023-12-07T00:15:08.209 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:15:08.209 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:15:08.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.334+0000 7f220e9c3700 1 Processor -- start 2023-12-07T00:15:08.333 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.334+0000 7f220e9c3700 1 -- start start 2023-12-07T00:15:08.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f220e9c3700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f220815bd70 0x7f22080cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f220e9c3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2208099b90 0x7f220809a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f220e9c3700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22080ccac0 con 0x7f22080cc590 2023-12-07T00:15:08.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f220e9c3700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080cd740 con 0x7f220815bd70 2023-12-07T00:15:08.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f220e9c3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220809a580 con 0x7f2208099b90 2023-12-07T00:15:08.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2207fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f220815bd70 0x7f22080cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f22077fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f22080cc590 0x7f22080d01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47570/0 (socket says 172.21.15.179:47570) 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2207fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f220815bd70 0x7f22080cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40668/0 (socket says 172.21.15.179:40668) 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f22077fe700 1 -- 172.21.15.179:0/3403635327 learned_addr learned my addr 172.21.15.179:0/3403635327 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f220cf60700 1 --2- 172.21.15.179:0/3403635327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2208099b90 0x7f220809a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2207fff700 1 -- 172.21.15.179:0/3403635327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2208099b90 msgr2=0x7f220809a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2207fff700 1 --2- 172.21.15.179:0/3403635327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2208099b90 0x7f220809a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2207fff700 1 -- 172.21.15.179:0/3403635327 >> v1:172.21.15.179:6789/0 conn(0x7f22080cc590 legacy=0x7f22080d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2207fff700 1 -- 172.21.15.179:0/3403635327 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22080ccda0 con 0x7f220815bd70 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2206ffd700 1 -- 172.21.15.179:0/3403635327 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080326500 0 0) 0x7f22080ccac0 con 0x7f22080cc590 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2207fff700 1 --2- 172.21.15.179:0/3403635327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f220815bd70 0x7f22080cdb60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009840 tx=0x7f21fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc3c16bb2908b5a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2206ffd700 1 -- 172.21.15.179:0/3403635327 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011830 con 0x7f220815bd70 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2206ffd700 1 -- 172.21.15.179:0/3403635327 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc011990 con 0x7f220815bd70 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.335+0000 7f2206ffd700 1 -- 172.21.15.179:0/3403635327 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc011d20 con 0x7f220815bd70 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.336+0000 7f220e9c3700 1 -- 172.21.15.179:0/3403635327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f220815bd70 msgr2=0x7f22080cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.336+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3403635327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f220815bd70 0x7f22080cdb60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009840 tx=0x7f21fc009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:08.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.336+0000 7f220e9c3700 1 -- 172.21.15.179:0/3403635327 shutdown_connections 2023-12-07T00:15:08.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.336+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3403635327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2208099b90 0x7f220809a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.336+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3403635327 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f220815bd70 0x7f22080cdb60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.336+0000 7f220e9c3700 1 -- 172.21.15.179:0/3403635327 >> 172.21.15.179:0/3403635327 conn(0x7f22080b34e0 msgr2=0x7f22080b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:08.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.336+0000 7f220e9c3700 1 -- 172.21.15.179:0/3403635327 shutdown_connections 2023-12-07T00:15:08.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.336+0000 7f220e9c3700 1 -- 172.21.15.179:0/3403635327 wait complete. 2023-12-07T00:15:08.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.337+0000 7f220e9c3700 1 Processor -- start 2023-12-07T00:15:08.338 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.337+0000 7f220e9c3700 1 -- start start 2023-12-07T00:15:08.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f220e9c3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2208099b90 0x7f22080ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f220e9c3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22080cc590 0x7f2208155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f220e9c3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815bd70 0x7f220806db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.340 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f220e9c3700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22081563a0 con 0x7f22080cc590 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f220e9c3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220806e0a0 con 0x7f2208099b90 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f220e9c3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080caed0 con 0x7f220815bd70 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f22077fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22080cc590 0x7f2208155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f22077fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22080cc590 0x7f2208155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40676/0 (socket says 172.21.15.179:40676) 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f22077fe700 1 -- 172.21.15.179:0/3442405609 learned_addr learned my addr 172.21.15.179:0/3442405609 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f220cf60700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815bd70 0x7f220806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f2207fff700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2208099b90 0x7f22080ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f22077fe700 1 -- 172.21.15.179:0/3442405609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815bd70 msgr2=0x7f220806db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f22077fe700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815bd70 0x7f220806db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f22077fe700 1 -- 172.21.15.179:0/3442405609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2208099b90 msgr2=0x7f22080ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f22077fe700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2208099b90 0x7f22080ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.338+0000 7f22077fe700 1 -- 172.21.15.179:0/3442405609 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc0094a0 con 0x7f22080cc590 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.339+0000 7f22077fe700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22080cc590 0x7f2208155e60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c540 tx=0x7f21f800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.339+0000 7f2204ff9700 1 -- 172.21.15.179:0/3442405609 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8004c80 con 0x7f22080cc590 2023-12-07T00:15:08.341 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.339+0000 7f2204ff9700 1 -- 172.21.15.179:0/3442405609 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f8004de0 con 0x7f22080cc590 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.339+0000 7f2204ff9700 1 -- 172.21.15.179:0/3442405609 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8007310 con 0x7f22080cc590 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.339+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22080cb1b0 con 0x7f22080cc590 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.339+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22080b5960 con 0x7f22080cc590 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.340+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22080cb3f0 con 0x7f22080cc590 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.340+0000 7f2204ff9700 1 -- 172.21.15.179:0/3442405609 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21f8007470 con 0x7f22080cc590 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.341+0000 7f2204ff9700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f21f406aed0 0x7f21f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.341+0000 7f2204ff9700 1 -- 172.21.15.179:0/3442405609 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21f8089690 con 0x7f22080cc590 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.341+0000 7f2207fff700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f21f406aed0 0x7f21f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.342 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.341+0000 7f2207fff700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f21f406aed0 0x7f21f406d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0090b0 tx=0x7f21fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:08.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.345+0000 7f2204ff9700 1 -- 172.21.15.179:0/3442405609 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21f8054410 con 0x7f22080cc590 2023-12-07T00:15:08.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.533+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22080685f0 con 0x7f22080cc590 2023-12-07T00:15:08.532 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.533+0000 7f2204ff9700 1 -- 172.21.15.179:0/3442405609 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21f8057a30 con 0x7f22080cc590 2023-12-07T00:15:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:15:08.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f21f406aed0 msgr2=0x7f21f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f21f406aed0 0x7f21f406d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0090b0 tx=0x7f21fc008030 comp rx=0 tx=0).stop 2023-12-07T00:15:08.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22080cc590 msgr2=0x7f2208155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22080cc590 0x7f2208155e60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f21f800c540 tx=0x7f21f800c900 comp rx=0 tx=0).stop 2023-12-07T00:15:08.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 shutdown_connections 2023-12-07T00:15:08.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f21f406aed0 0x7f21f406d390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f220815bd70 0x7f220806db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.535 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2208099b90 0x7f22080ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 --2- 172.21.15.179:0/3442405609 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f22080cc590 0x7f2208155e60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 >> 172.21.15.179:0/3442405609 conn(0x7f22080b34e0 msgr2=0x7f22080cfbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:08.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 shutdown_connections 2023-12-07T00:15:08.536 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.535+0000 7f220e9c3700 1 -- 172.21.15.179:0/3442405609 wait complete. 2023-12-07T00:15:08.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:15:08.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.672+0000 7ffac06a4700 1 Processor -- start 2023-12-07T00:15:08.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.672+0000 7ffac06a4700 1 -- start start 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.673+0000 7ffac06a4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab806af70 0x7ffab806b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.673+0000 7ffac06a4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffab815e0b0 0x7ffab815e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.673+0000 7ffac06a4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab806e9a0 con 0x7ffab80af8b0 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.673+0000 7ffac06a4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab806b890 con 0x7ffab815e0b0 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.673+0000 7ffac06a4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab815eb40 con 0x7ffab806af70 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabec41700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffab815e0b0 0x7ffab815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabe440700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab806af70 0x7ffab806b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabec41700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffab815e0b0 0x7ffab815e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:42938/0 (socket says 172.21.15.179:42938) 2023-12-07T00:15:08.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabe440700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab806af70 0x7ffab806b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41096/0 (socket says 172.21.15.179:41096) 2023-12-07T00:15:08.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabec41700 1 -- 172.21.15.179:0/4075514351 learned_addr learned my addr 172.21.15.179:0/4075514351 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:08.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabe440700 1 -- 172.21.15.179:0/4075514351 >> v2:172.21.15.190:3300/0 conn(0x7ffab815e0b0 msgr2=0x7ffab815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:08.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabe440700 1 --2- 172.21.15.179:0/4075514351 >> v2:172.21.15.190:3300/0 conn(0x7ffab815e0b0 0x7ffab815e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabe440700 1 -- 172.21.15.179:0/4075514351 >> v1:172.21.15.190:6789/0 conn(0x7ffab80af8b0 legacy=0x7ffab80cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabe440700 1 -- 172.21.15.179:0/4075514351 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab815ee20 con 0x7ffab806af70 2023-12-07T00:15:08.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.674+0000 7ffabe440700 1 --2- 172.21.15.179:0/4075514351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab806af70 0x7ffab806b350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009840 tx=0x7ffab4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e211191598cafabd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:08.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.676+0000 7ffabd43e700 1 -- 172.21.15.179:0/4075514351 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011830 con 0x7ffab806af70 2023-12-07T00:15:08.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.676+0000 7ffabd43e700 1 -- 172.21.15.179:0/4075514351 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4011990 con 0x7ffab806af70 2023-12-07T00:15:08.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.676+0000 7ffabd43e700 1 -- 172.21.15.179:0/4075514351 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011d20 con 0x7ffab806af70 2023-12-07T00:15:08.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.677+0000 7ffac06a4700 1 -- 172.21.15.179:0/4075514351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab806af70 msgr2=0x7ffab806b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.677+0000 7ffac06a4700 1 --2- 172.21.15.179:0/4075514351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab806af70 0x7ffab806b350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009840 tx=0x7ffab4009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:08.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.677+0000 7ffac06a4700 1 -- 172.21.15.179:0/4075514351 shutdown_connections 2023-12-07T00:15:08.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.677+0000 7ffac06a4700 1 --2- 172.21.15.179:0/4075514351 >> v2:172.21.15.190:3300/0 conn(0x7ffab815e0b0 0x7ffab815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.677+0000 7ffac06a4700 1 --2- 172.21.15.179:0/4075514351 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab806af70 0x7ffab806b350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.677+0000 7ffac06a4700 1 -- 172.21.15.179:0/4075514351 >> 172.21.15.179:0/4075514351 conn(0x7ffab8099a40 msgr2=0x7ffab8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:08.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.677+0000 7ffac06a4700 1 -- 172.21.15.179:0/4075514351 shutdown_connections 2023-12-07T00:15:08.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.677+0000 7ffac06a4700 1 -- 172.21.15.179:0/4075514351 wait complete. 2023-12-07T00:15:08.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.678+0000 7ffac06a4700 1 Processor -- start 2023-12-07T00:15:08.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.678+0000 7ffac06a4700 1 -- start start 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffac06a4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab806af70 0x7ffab80c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffac06a4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80af8b0 0x7ffab80cb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffac06a4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab815e0b0 0x7ffab8148980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffac06a4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80c8020 con 0x7ffab806af70 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffac06a4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81e7940 con 0x7ffab80af8b0 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffac06a4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81e7c20 con 0x7ffab815e0b0 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabe440700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab806af70 0x7ffab80c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabec41700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab815e0b0 0x7ffab8148980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabe440700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab806af70 0x7ffab80c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40688/0 (socket says 172.21.15.179:40688) 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabe440700 1 -- 172.21.15.179:0/447002130 learned_addr learned my addr 172.21.15.179:0/447002130 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabdc3f700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80af8b0 0x7ffab80cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabe440700 1 -- 172.21.15.179:0/447002130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab815e0b0 msgr2=0x7ffab8148980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabe440700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab815e0b0 0x7ffab8148980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabe440700 1 -- 172.21.15.179:0/447002130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80af8b0 msgr2=0x7ffab80cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.679+0000 7ffabe440700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80af8b0 0x7ffab80cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.680+0000 7ffabe440700 1 -- 172.21.15.179:0/447002130 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40094a0 con 0x7ffab806af70 2023-12-07T00:15:08.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.680+0000 7ffabe440700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab806af70 0x7ffab80c7960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffab4000c00 tx=0x7ffab4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:08.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.681+0000 7ffaaeffd700 1 -- 172.21.15.179:0/447002130 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab40036a0 con 0x7ffab806af70 2023-12-07T00:15:08.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.682+0000 7ffaaeffd700 1 -- 172.21.15.179:0/447002130 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab401f070 con 0x7ffab806af70 2023-12-07T00:15:08.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.682+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab80cba30 con 0x7ffab806af70 2023-12-07T00:15:08.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.682+0000 7ffaaeffd700 1 -- 172.21.15.179:0/447002130 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4003a60 con 0x7ffab806af70 2023-12-07T00:15:08.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.682+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab8148ec0 con 0x7ffab806af70 2023-12-07T00:15:08.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.683+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab80cb8a0 con 0x7ffab806af70 2023-12-07T00:15:08.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.683+0000 7ffaaeffd700 1 -- 172.21.15.179:0/447002130 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffab4003bc0 con 0x7ffab806af70 2023-12-07T00:15:08.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.683+0000 7ffaaeffd700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa9c06aed0 0x7ffa9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:08.682 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.683+0000 7ffaaeffd700 1 -- 172.21.15.179:0/447002130 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffab4021070 con 0x7ffab806af70 2023-12-07T00:15:08.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.683+0000 7ffabdc3f700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa9c06aed0 0x7ffa9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:08.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.684+0000 7ffabdc3f700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa9c06aed0 0x7ffa9c06d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffab806fdb0 tx=0x7ffaa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:08.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.688+0000 7ffaaeffd700 1 -- 172.21.15.179:0/447002130 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffab4055e90 con 0x7ffab806af70 2023-12-07T00:15:08.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.878+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffab80cbc20 con 0x7ffab806af70 2023-12-07T00:15:08.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.878+0000 7ffaaeffd700 1 -- 172.21.15.179:0/447002130 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffab402b020 con 0x7ffab806af70 2023-12-07T00:15:08.877 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:08.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa9c06aed0 msgr2=0x7ffa9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa9c06aed0 0x7ffa9c06d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffab806fdb0 tx=0x7ffaa8009040 comp rx=0 tx=0).stop 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab806af70 msgr2=0x7ffab80c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab806af70 0x7ffab80c7960 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffab4000c00 tx=0x7ffab4004750 comp rx=0 tx=0).stop 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 shutdown_connections 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ffa9c06aed0 0x7ffa9c06d390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffab815e0b0 0x7ffab8148980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffab806af70 0x7ffab80c7960 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 --2- 172.21.15.179:0/447002130 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffab80af8b0 0x7ffab80cb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 >> 172.21.15.179:0/447002130 conn(0x7ffab8099a40 msgr2=0x7ffab8161810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 shutdown_connections 2023-12-07T00:15:08.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:08.880+0000 7ffac06a4700 1 -- 172.21.15.179:0/447002130 wait complete. 2023-12-07T00:15:08.891 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.015+0000 7f2b87d6f700 1 Processor -- start 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.015+0000 7f2b87d6f700 1 -- start start 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b87d6f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b8015bba0 0x7f2b8015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b87d6f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800cf890 0x7f2b800cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b87d6f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8015f640 con 0x7f2b800ccee0 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b87d6f700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b800b03e0 con 0x7f2b8015bba0 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b87d6f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800d0220 con 0x7f2b800cf890 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b85b0b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b8015bba0 0x7f2b8015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b8530a700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2b800ccee0 0x7f2b8015fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47600/0 (socket says 172.21.15.179:47600) 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b85b0b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2b8015bba0 0x7f2b8015bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40696/0 (socket says 172.21.15.179:40696) 2023-12-07T00:15:09.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b8530a700 1 -- 172.21.15.179:0/2349077853 learned_addr learned my addr 172.21.15.179:0/2349077853 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b85b0b700 1 -- 172.21.15.179:0/2349077853 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800cf890 msgr2=0x7f2b800cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b8630c700 1 --2- 172.21.15.179:0/2349077853 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800cf890 0x7f2b800cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b85b0b700 1 --2- 172.21.15.179:0/2349077853 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800cf890 0x7f2b800cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b85b0b700 1 -- 172.21.15.179:0/2349077853 >> v1:172.21.15.179:6789/0 conn(0x7f2b800ccee0 legacy=0x7f2b8015fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b85b0b700 1 -- 172.21.15.179:0/2349077853 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b801604c0 con 0x7f2b8015bba0 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b8630c700 1 --2- 172.21.15.179:0/2349077853 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800cf890 0x7f2b800cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.016+0000 7f2b85b0b700 1 --2- 172.21.15.179:0/2349077853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b8015bf80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009840 tx=0x7f2b7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff13e942ec276d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b84b09700 1 -- 172.21.15.179:0/2349077853 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011830 con 0x7f2b8015bba0 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b84b09700 1 -- 172.21.15.179:0/2349077853 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7c011990 con 0x7f2b8015bba0 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b84b09700 1 -- 172.21.15.179:0/2349077853 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7c011d20 con 0x7f2b8015bba0 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b87d6f700 1 -- 172.21.15.179:0/2349077853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 msgr2=0x7f2b8015bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/2349077853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b8015bf80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009840 tx=0x7f2b7c009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b87d6f700 1 -- 172.21.15.179:0/2349077853 shutdown_connections 2023-12-07T00:15:09.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/2349077853 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800cf890 0x7f2b800cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/2349077853 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b8015bf80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b87d6f700 1 -- 172.21.15.179:0/2349077853 >> 172.21.15.179:0/2349077853 conn(0x7f2b80099a40 msgr2=0x7f2b80099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:09.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b87d6f700 1 -- 172.21.15.179:0/2349077853 shutdown_connections 2023-12-07T00:15:09.019 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.017+0000 7f2b87d6f700 1 -- 172.21.15.179:0/2349077853 wait complete. 2023-12-07T00:15:09.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.018+0000 7f2b87d6f700 1 Processor -- start 2023-12-07T00:15:09.021 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.018+0000 7f2b87d6f700 1 -- start start 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b87d6f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800ccee0 0x7f2b800c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b87d6f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b800cf890 0x7f2b801f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b87d6f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b80156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b87d6f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b800c4c60 con 0x7f2b8015bba0 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b87d6f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b801545a0 con 0x7f2b800cf890 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b87d6f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80156550 con 0x7f2b800ccee0 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b8630c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b80156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b8630c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b80156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40706/0 (socket says 172.21.15.179:40706) 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b8630c700 1 -- 172.21.15.179:0/1381265923 learned_addr learned my addr 172.21.15.179:0/1381265923 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b85b0b700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800ccee0 0x7f2b800c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.019+0000 7f2b8530a700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b800cf890 0x7f2b801f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b8630c700 1 -- 172.21.15.179:0/1381265923 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800ccee0 msgr2=0x7f2b800c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b8630c700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800ccee0 0x7f2b800c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b8630c700 1 -- 172.21.15.179:0/1381265923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b800cf890 msgr2=0x7f2b801f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b8630c700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b800cf890 0x7f2b801f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b8630c700 1 -- 172.21.15.179:0/1381265923 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0094a0 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b8630c700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b80156820 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800cef0 tx=0x7f2b7800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b767fc700 1 -- 172.21.15.179:0/1381265923 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7800adf0 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b767fc700 1 -- 172.21.15.179:0/1381265923 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b78015440 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b800c55c0 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b767fc700 1 -- 172.21.15.179:0/1381265923 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780157f0 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.020+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b80156270 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.021+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b800c4ed0 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.021+0000 7f2b767fc700 1 -- 172.21.15.179:0/1381265923 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b7800d430 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.022+0000 7f2b767fc700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2b6406aed0 0x7f2b6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.022+0000 7f2b767fc700 1 -- 172.21.15.179:0/1381265923 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2b78089ec0 con 0x7f2b8015bba0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.022+0000 7f2b85b0b700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2b6406aed0 0x7f2b6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.022+0000 7f2b85b0b700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2b6406aed0 0x7f2b6406d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0090b0 tx=0x7f2b7c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.025 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.026+0000 7f2b767fc700 1 -- 172.21.15.179:0/1381265923 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b78054c40 con 0x7f2b8015bba0 2023-12-07T00:15:09.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.217+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b8015f870 con 0x7f2b8015bba0 2023-12-07T00:15:09.217 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.218+0000 7f2b767fc700 1 -- 172.21.15.179:0/1381265923 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b8015f870 con 0x7f2b8015bba0 2023-12-07T00:15:09.217 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:15:09.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2b6406aed0 msgr2=0x7f2b6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2b6406aed0 0x7f2b6406d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c0090b0 tx=0x7f2b7c01c040 comp rx=0 tx=0).stop 2023-12-07T00:15:09.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 msgr2=0x7f2b80156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b80156820 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2b7800cef0 tx=0x7f2b7800a340 comp rx=0 tx=0).stop 2023-12-07T00:15:09.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 shutdown_connections 2023-12-07T00:15:09.219 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2b6406aed0 0x7f2b6406d390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2b8015bba0 0x7f2b80156820 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2b800ccee0 0x7f2b800c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 --2- 172.21.15.179:0/1381265923 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2b800cf890 0x7f2b801f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 >> 172.21.15.179:0/1381265923 conn(0x7f2b80099a40 msgr2=0x7f2b8015d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:09.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 shutdown_connections 2023-12-07T00:15:09.220 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.220+0000 7f2b87d6f700 1 -- 172.21.15.179:0/1381265923 wait complete. 2023-12-07T00:15:09.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:15:09.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.355+0000 7faa53a85700 1 Processor -- start 2023-12-07T00:15:09.355 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.355+0000 7faa53a85700 1 -- start start 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.356+0000 7faa53a85700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faa4c15bba0 0x7faa4c15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.356+0000 7faa53a85700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa4c0cf890 0x7faa4c0cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.356+0000 7faa53a85700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4c15f640 con 0x7faa4c0ccee0 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.356+0000 7faa53a85700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0b03e0 con 0x7faa4c0cf890 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.356+0000 7faa53a85700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4c0d01d0 con 0x7faa4c15bba0 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.356+0000 7faa52022700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7faa4c0cf890 0x7faa4c0cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.356+0000 7faa51020700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7faa4c0ccee0 0x7faa4c15fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47614/0 (socket says 172.21.15.179:47614) 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.356+0000 7faa51020700 1 -- 172.21.15.179:0/4068916194 learned_addr learned my addr 172.21.15.179:0/4068916194 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:09.357 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa5081f700 1 -- 172.21.15.179:0/4068916194 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325299650 0 0) 0x7faa4c15f640 con 0x7faa4c0ccee0 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa51821700 1 --2- 172.21.15.179:0/4068916194 >> v2:172.21.15.190:3300/0 conn(0x7faa4c15bba0 0x7faa4c15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa5081f700 1 -- 172.21.15.179:0/4068916194 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa380035b0 con 0x7faa4c0ccee0 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa52022700 1 -- 172.21.15.179:0/4068916194 >> v2:172.21.15.190:3300/0 conn(0x7faa4c15bba0 msgr2=0x7faa4c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa52022700 1 --2- 172.21.15.179:0/4068916194 >> v2:172.21.15.190:3300/0 conn(0x7faa4c15bba0 0x7faa4c15bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa52022700 1 -- 172.21.15.179:0/4068916194 >> v1:172.21.15.179:6789/0 conn(0x7faa4c0ccee0 legacy=0x7faa4c15fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa52022700 1 -- 172.21.15.179:0/4068916194 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c1604c0 con 0x7faa4c0cf890 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa52022700 1 --2- 172.21.15.179:0/4068916194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0cf890 0x7faa4c0cfc90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0715a0 tx=0x7faa4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3532cc365f6c6bd server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa5081f700 1 -- 172.21.15.179:0/4068916194 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400e070 con 0x7faa4c0cf890 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa5081f700 1 -- 172.21.15.179:0/4068916194 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4400bb20 con 0x7faa4c0cf890 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.357+0000 7faa5081f700 1 -- 172.21.15.179:0/4068916194 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44012430 con 0x7faa4c0cf890 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.358+0000 7faa53a85700 1 -- 172.21.15.179:0/4068916194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0cf890 msgr2=0x7faa4c0cfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.358 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.358+0000 7faa53a85700 1 --2- 172.21.15.179:0/4068916194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0cf890 0x7faa4c0cfc90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0715a0 tx=0x7faa4400b330 comp rx=0 tx=0).stop 2023-12-07T00:15:09.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.358+0000 7faa53a85700 1 -- 172.21.15.179:0/4068916194 shutdown_connections 2023-12-07T00:15:09.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.358+0000 7faa53a85700 1 --2- 172.21.15.179:0/4068916194 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0cf890 0x7faa4c0cfc90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.358+0000 7faa53a85700 1 --2- 172.21.15.179:0/4068916194 >> v2:172.21.15.190:3300/0 conn(0x7faa4c15bba0 0x7faa4c15bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.358+0000 7faa53a85700 1 -- 172.21.15.179:0/4068916194 >> 172.21.15.179:0/4068916194 conn(0x7faa4c099a40 msgr2=0x7faa4c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:09.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.358+0000 7faa53a85700 1 -- 172.21.15.179:0/4068916194 shutdown_connections 2023-12-07T00:15:09.359 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.358+0000 7faa53a85700 1 -- 172.21.15.179:0/4068916194 wait complete. 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.359+0000 7faa53a85700 1 Processor -- start 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.359+0000 7faa53a85700 1 -- start start 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa53a85700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0ccee0 0x7faa4c14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa53a85700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa4c0cf890 0x7faa4c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa53a85700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa4c15bba0 0x7faa4c0c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa53a85700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c156cc0 con 0x7faa4c0ccee0 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa53a85700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c0af110 con 0x7faa4c0cf890 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa53a85700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c156f30 con 0x7faa4c15bba0 2023-12-07T00:15:09.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0ccee0 0x7faa4c14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0ccee0 0x7faa4c14be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40716/0 (socket says 172.21.15.179:40716) 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 -- 172.21.15.179:0/731682647 learned_addr learned my addr 172.21.15.179:0/731682647 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51020700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa4c0cf890 0x7faa4c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa52022700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa4c15bba0 0x7faa4c0c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 -- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa4c15bba0 msgr2=0x7faa4c0c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa4c15bba0 0x7faa4c0c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 -- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa4c0cf890 msgr2=0x7faa4c0c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa4c0cf890 0x7faa4c0c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 -- 172.21.15.179:0/731682647 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44009a70 con 0x7faa4c0ccee0 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51020700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa4c0cf890 0x7faa4c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa51821700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0ccee0 0x7faa4c14be40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00d800 tx=0x7faa3c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa427fc700 1 -- 172.21.15.179:0/731682647 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0125f0 con 0x7faa4c0ccee0 2023-12-07T00:15:09.363 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa427fc700 1 -- 172.21.15.179:0/731682647 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c012750 con 0x7faa4c0ccee0 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4c157210 con 0x7faa4c0ccee0 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa427fc700 1 -- 172.21.15.179:0/731682647 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c012b00 con 0x7faa4c0ccee0 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.360+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4c0af3f0 con 0x7faa4c0ccee0 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.361+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa4c09a340 con 0x7faa4c0ccee0 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.362+0000 7faa427fc700 1 -- 172.21.15.179:0/731682647 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa3c012c60 con 0x7faa4c0ccee0 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.362+0000 7faa427fc700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa3006aed0 0x7faa3006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.362+0000 7faa51020700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa3006aed0 0x7faa3006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.362+0000 7faa427fc700 1 -- 172.21.15.179:0/731682647 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa3c089d60 con 0x7faa4c0ccee0 2023-12-07T00:15:09.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.363+0000 7faa51020700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa3006aed0 0x7faa3006d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa4c1f4ba0 tx=0x7faa48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.366 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.367+0000 7faa427fc700 1 -- 172.21.15.179:0/731682647 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa3c054a50 con 0x7faa4c0ccee0 2023-12-07T00:15:09.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.558+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faa4c0685f0 con 0x7faa4c0ccee0 2023-12-07T00:15:09.557 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.558+0000 7faa427fc700 1 -- 172.21.15.179:0/731682647 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7faa3c058070 con 0x7faa4c0ccee0 2023-12-07T00:15:09.557 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:09.559 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa3006aed0 msgr2=0x7faa3006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa3006aed0 0x7faa3006d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faa4c1f4ba0 tx=0x7faa48009040 comp rx=0 tx=0).stop 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0ccee0 msgr2=0x7faa4c14be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0ccee0 0x7faa4c14be40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00d800 tx=0x7faa3c00dbc0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 shutdown_connections 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7faa3006aed0 0x7faa3006d390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faa4c15bba0 0x7faa4c0c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7faa4c0ccee0 0x7faa4c14be40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 --2- 172.21.15.179:0/731682647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faa4c0cf890 0x7faa4c0c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 >> 172.21.15.179:0/731682647 conn(0x7faa4c099a40 msgr2=0x7faa4c15b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 shutdown_connections 2023-12-07T00:15:09.560 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.560+0000 7faa53a85700 1 -- 172.21.15.179:0/731682647 wait complete. 2023-12-07T00:15:09.572 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T00:15:09.695 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.696+0000 7f275397c700 1 Processor -- start 2023-12-07T00:15:09.695 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.696+0000 7f275397c700 1 -- start start 2023-12-07T00:15:09.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f275397c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f274c0b4470 0x7f274c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f275397c700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c15b8d0 con 0x7f274c0b2aa0 2023-12-07T00:15:09.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f275397c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c15bbb0 con 0x7f274c158560 2023-12-07T00:15:09.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f275397c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0b2f30 con 0x7f274c0b4470 2023-12-07T00:15:09.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f2751f19700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f274c0b2aa0 0x7f274c0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47630/0 (socket says 172.21.15.179:47630) 2023-12-07T00:15:09.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f2751f19700 1 -- 172.21.15.179:0/3087768972 learned_addr learned my addr 172.21.15.179:0/3087768972 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:09.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f2750f17700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f274c0b4470 0x7f274c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612432037 0 0) 0x7f274c15b8d0 con 0x7f274c0b2aa0 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.697+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27380057c0 con 0x7f274c0b2aa0 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790507676 0 0) 0x7f274c15bbb0 con 0x7f274c158560 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274c15b8d0 con 0x7f274c158560 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2217917475 0 0) 0x7f27380057c0 con 0x7f274c0b2aa0 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f274c0b4470 msgr2=0x7f274c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f274c0b4470 0x7f274c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 >> v1:172.21.15.190:6789/0 conn(0x7f274c158560 legacy=0x7f274c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c15be90 con 0x7f274c0b2aa0 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f27440019f0 con 0x7f274c0b2aa0 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 >> v1:172.21.15.179:6789/0 conn(0x7f274c0b2aa0 legacy=0x7f274c0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f274c0b4470 0x7f2738005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2738006330 0x7f2738006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.702 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2738006fa0 0x7f2738007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0b2f30 con 0x7f2738006330 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273800dd00 con 0x7f2738006fa0 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273800dec0 con 0x7f274c0b4470 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2750f17700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2738006330 0x7f2738006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2751718700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f274c0b4470 0x7f2738005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2751f19700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2738006fa0 0x7f2738007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2750f17700 1 -- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f274c0b4470 msgr2=0x7f2738005dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2750f17700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f274c0b4470 0x7f2738005dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2750f17700 1 -- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2738006fa0 msgr2=0x7f2738007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2750f17700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2738006fa0 0x7f2738007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2750f17700 1 -- 172.21.15.179:0/3087768972 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380057c0 con 0x7f2738006330 2023-12-07T00:15:09.703 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2750f17700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2738006330 0x7f2738006a60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2748009b10 tx=0x7f2738007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a227a0c526d2094 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748005a20 con 0x7f2738006330 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748005b80 con 0x7f2738006330 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.698+0000 7f2743fff700 1 -- 172.21.15.179:0/3087768972 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274800e6c0 con 0x7f2738006330 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.699+0000 7f275397c700 1 -- 172.21.15.179:0/3087768972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2738006330 msgr2=0x7f2738006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.699+0000 7f275397c700 1 --2- 172.21.15.179:0/3087768972 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2738006330 0x7f2738006a60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2748009b10 tx=0x7f2738007a90 comp rx=0 tx=0).stop 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.699+0000 7f2751f19700 1 -- 172.21.15.179:0/3087768972 reap_dead start 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.699+0000 7f275397c700 1 -- 172.21.15.179:0/3087768972 shutdown_connections 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.699+0000 7f275397c700 1 -- 172.21.15.179:0/3087768972 >> 172.21.15.179:0/3087768972 conn(0x7f274c072970 msgr2=0x7f274c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.699+0000 7f275397c700 1 -- 172.21.15.179:0/3087768972 shutdown_connections 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.699+0000 7f275397c700 1 -- 172.21.15.179:0/3087768972 wait complete. 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.700+0000 7f275397c700 1 Processor -- start 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.700+0000 7f275397c700 1 -- start start 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f275397c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2738006330 0x7f274c14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f275397c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f274c14d9c0 0x7f274c06beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f275397c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f274c14d040 0x7f274c06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f275397c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1503f0 con 0x7f274c14d9c0 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f275397c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1f7810 con 0x7f274c14d040 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f275397c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c14ca70 con 0x7f2738006330 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f274c14d9c0 0x7f274c06beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f274c14d9c0 0x7f274c06beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40736/0 (socket says 172.21.15.179:40736) 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 -- 172.21.15.179:0/2403064451 learned_addr learned my addr 172.21.15.179:0/2403064451 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2751f19700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f274c14d040 0x7f274c06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2751718700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2738006330 0x7f274c14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 -- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2738006330 msgr2=0x7f274c14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2738006330 0x7f274c14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 -- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f274c14d040 msgr2=0x7f274c06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f274c14d040 0x7f274c06c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 -- 172.21.15.179:0/2403064451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c150110 con 0x7f274c14d9c0 2023-12-07T00:15:09.705 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2751718700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2738006330 0x7f274c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:09.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.701+0000 7f2750f17700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f274c14d9c0 0x7f274c06beb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f273800dcd0 tx=0x7f27480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.702+0000 7f2741ffb700 1 -- 172.21.15.179:0/2403064451 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748021070 con 0x7f274c14d9c0 2023-12-07T00:15:09.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.702+0000 7f2741ffb700 1 -- 172.21.15.179:0/2403064451 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748004030 con 0x7f274c14d9c0 2023-12-07T00:15:09.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.702+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c1503f0 con 0x7f274c14d9c0 2023-12-07T00:15:09.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.702+0000 7f2741ffb700 1 -- 172.21.15.179:0/2403064451 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480041e0 con 0x7f274c14d9c0 2023-12-07T00:15:09.706 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.702+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c1f74a0 con 0x7f274c14d9c0 2023-12-07T00:15:09.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.703+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c04f290 con 0x7f274c14d9c0 2023-12-07T00:15:09.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.703+0000 7f2741ffb700 1 -- 172.21.15.179:0/2403064451 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2748004340 con 0x7f274c14d9c0 2023-12-07T00:15:09.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.703+0000 7f2741ffb700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f273006aed0 0x7f273006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:09.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.704+0000 7f2751718700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f273006aed0 0x7f273006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:09.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.704+0000 7f2741ffb700 1 -- 172.21.15.179:0/2403064451 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f274808aae0 con 0x7f274c14d9c0 2023-12-07T00:15:09.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.704+0000 7f2751718700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f273006aed0 0x7f273006d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f273c0010e0 tx=0x7f273c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:09.707 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.708+0000 7f2741ffb700 1 -- 172.21.15.179:0/2403064451 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2748055860 con 0x7f274c14d9c0 2023-12-07T00:15:09.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.914+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f274c0685f0 con 0x7f274c14d9c0 2023-12-07T00:15:09.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.914+0000 7f2741ffb700 1 -- 172.21.15.179:0/2403064451 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2748058e80 con 0x7f274c14d9c0 2023-12-07T00:15:09.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f273006aed0 msgr2=0x7f273006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f273006aed0 0x7f273006d390 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f273c0010e0 tx=0x7f273c009040 comp rx=0 tx=0).stop 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f274c14d9c0 msgr2=0x7f274c06beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f274c14d9c0 0x7f274c06beb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f273800dcd0 tx=0x7f27480047c0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 shutdown_connections 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f273006aed0 0x7f273006d390 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f274c14d040 0x7f274c06c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2738006330 0x7f274c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 --2- 172.21.15.179:0/2403064451 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f274c14d9c0 0x7f274c06beb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 >> 172.21.15.179:0/2403064451 conn(0x7f274c072970 msgr2=0x7f274c15aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 shutdown_connections 2023-12-07T00:15:09.916 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:09.916+0000 7f275397c700 1 -- 172.21.15.179:0/2403064451 wait complete. 2023-12-07T00:15:09.917 INFO:teuthology.orchestra.run.smithi179.stderr:listed 0 entries 2023-12-07T00:15:09.927 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-07T00:15:09.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:09.928 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-07T00:15:09.970 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T00:15:09.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:09.971 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-07T00:15:10.029 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:15:10.029 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:10.051 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:15:10.051 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:10.112 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T00:15:10.112 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:10.171 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:10.291 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.292+0000 7f4e9a178700 1 Processor -- start 2023-12-07T00:15:10.292 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.292+0000 7f4e9a178700 1 -- start start 2023-12-07T00:15:10.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e9a178700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e9415a170 0x7f4e940ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e9a178700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9406e070 0x7f4e9406e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e9a178700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e940cc9c0 con 0x7f4e940ce950 2023-12-07T00:15:10.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e9a178700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e940ccf80 con 0x7f4e9415a170 2023-12-07T00:15:10.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e9a178700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940ccca0 con 0x7f4e9406e070 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e92ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4e940ce950 0x7f4e940cedc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47646/0 (socket says 172.21.15.179:47646) 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e92ffd700 1 -- 172.21.15.179:0/260545415 learned_addr learned my addr 172.21.15.179:0/260545415 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516687802 0 0) 0x7f4e940cc9c0 con 0x7f4e940ce950 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e937fe700 1 --2- 172.21.15.179:0/260545415 >> v2:172.21.15.190:3300/0 conn(0x7f4e9415a170 0x7f4e940ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e7c0035b0 con 0x7f4e940ce950 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.293+0000 7f4e93fff700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9406e070 0x7f4e9406e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 681815783 0 0) 0x7f4e7c0035b0 con 0x7f4e940ce950 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9406e070 msgr2=0x7f4e9406e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9406e070 0x7f4e9406e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 >> v2:172.21.15.190:3300/0 conn(0x7f4e9415a170 msgr2=0x7f4e940ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 --2- 172.21.15.179:0/260545415 >> v2:172.21.15.190:3300/0 conn(0x7f4e9415a170 0x7f4e940ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9406d870 con 0x7f4e940ce950 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f4e84001670 con 0x7f4e940ce950 2023-12-07T00:15:10.296 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 >> v1:172.21.15.179:6789/0 conn(0x7f4e940ce950 legacy=0x7f4e940cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e7c003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9406e070 0x7f4e7c00a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e7c00ae70 0x7f4e7c00d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940ccf80 con 0x7f4e7c003bd0 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940ccca0 con 0x7f4e7c00ae70 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c00db60 con 0x7f4e9406e070 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e937fe700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e7c003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e93fff700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e7c00ae70 0x7f4e7c00d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e92ffd700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9406e070 0x7f4e7c00a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e937fe700 1 -- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9406e070 msgr2=0x7f4e7c00a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e937fe700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9406e070 0x7f4e7c00a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e937fe700 1 -- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e7c00ae70 msgr2=0x7f4e7c00d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e937fe700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e7c00ae70 0x7f4e7c00d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e937fe700 1 -- 172.21.15.179:0/260545415 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0035b0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e93fff700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e7c00ae70 0x7f4e7c00d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e937fe700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e7c003ff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009b60 tx=0x7f4e7c003860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ef5e97089b5619 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800e6c0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8800e820 con 0x7f4e7c003bd0 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.294+0000 7f4e927fc700 1 -- 172.21.15.179:0/260545415 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800eb90 con 0x7f4e7c003bd0 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.295+0000 7f4e9a178700 1 -- 172.21.15.179:0/260545415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 msgr2=0x7f4e7c003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.295+0000 7f4e9a178700 1 --2- 172.21.15.179:0/260545415 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e7c003ff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009b60 tx=0x7f4e7c003860 comp rx=0 tx=0).stop 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.295+0000 7f4e93fff700 1 -- 172.21.15.179:0/260545415 reap_dead start 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.295+0000 7f4e9a178700 1 -- 172.21.15.179:0/260545415 shutdown_connections 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.295+0000 7f4e9a178700 1 -- 172.21.15.179:0/260545415 >> 172.21.15.179:0/260545415 conn(0x7f4e9406b150 msgr2=0x7f4e9406b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.295+0000 7f4e9a178700 1 -- 172.21.15.179:0/260545415 shutdown_connections 2023-12-07T00:15:10.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.295+0000 7f4e9a178700 1 -- 172.21.15.179:0/260545415 wait complete. 2023-12-07T00:15:10.299 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.296+0000 7f4e9a178700 1 Processor -- start 2023-12-07T00:15:10.299 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.296+0000 7f4e9a178700 1 -- start start 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e9a178700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e9413d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e9a178700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e941564b0 0x7f4e9415a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e9a178700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9415ac10 0x7f4e940b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e9a178700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9415d3a0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e9a178700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e94156930 con 0x7f4e941564b0 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e9a178700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e940c9a30 con 0x7f4e9415ac10 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e937fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e9413d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e937fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e9413d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40756/0 (socket says 172.21.15.179:40756) 2023-12-07T00:15:10.301 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e937fe700 1 -- 172.21.15.179:0/1581198654 learned_addr learned my addr 172.21.15.179:0/1581198654 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e92ffd700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e941564b0 0x7f4e9415a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e93fff700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9415ac10 0x7f4e940b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e937fe700 1 -- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9415ac10 msgr2=0x7f4e940b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e937fe700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9415ac10 0x7f4e940b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e937fe700 1 -- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e941564b0 msgr2=0x7f4e9415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e937fe700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e941564b0 0x7f4e9415a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e937fe700 1 -- 172.21.15.179:0/1581198654 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940c9d10 con 0x7f4e7c003bd0 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.297+0000 7f4e93fff700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9415ac10 0x7f4e940b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.298+0000 7f4e937fe700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e9413d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e880090b0 tx=0x7f4e880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.298+0000 7f4e7bfff700 1 -- 172.21.15.179:0/1581198654 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800e6c0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.298+0000 7f4e7bfff700 1 -- 172.21.15.179:0/1581198654 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e88003ad0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.298+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e940c9ff0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.298+0000 7f4e7bfff700 1 -- 172.21.15.179:0/1581198654 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e88003e80 con 0x7f4e7c003bd0 2023-12-07T00:15:10.302 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.298+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e940ca5b0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.299+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e940ca740 con 0x7f4e7c003bd0 2023-12-07T00:15:10.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.299+0000 7f4e7bfff700 1 -- 172.21.15.179:0/1581198654 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e88013470 con 0x7f4e7c003bd0 2023-12-07T00:15:10.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.300+0000 7f4e7bfff700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4e8006aed0 0x7f4e8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.300+0000 7f4e92ffd700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4e8006aed0 0x7f4e8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.300+0000 7f4e7bfff700 1 -- 172.21.15.179:0/1581198654 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e8808b2a0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.300+0000 7f4e92ffd700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4e8006aed0 0x7f4e8006d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4e9406fa20 tx=0x7f4e84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.303 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.304+0000 7f4e7bfff700 1 -- 172.21.15.179:0/1581198654 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e88056020 con 0x7f4e7c003bd0 2023-12-07T00:15:10.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.496+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e94067ee0 con 0x7f4e7c003bd0 2023-12-07T00:15:10.496 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.497+0000 7f4e7bfff700 1 -- 172.21.15.179:0/1581198654 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7f4e88059640 con 0x7f4e7c003bd0 2023-12-07T00:15:10.497 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:10.497 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:10.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.499+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4e8006aed0 msgr2=0x7f4e8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.499+0000 7f4e9a178700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4e8006aed0 0x7f4e8006d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4e9406fa20 tx=0x7f4e84009040 comp rx=0 tx=0).stop 2023-12-07T00:15:10.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.499+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 msgr2=0x7f4e9413d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.499+0000 7f4e9a178700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e9413d330 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e880090b0 tx=0x7f4e880047c0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.500+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 shutdown_connections 2023-12-07T00:15:10.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.500+0000 7f4e9a178700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4e8006aed0 0x7f4e8006d390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.500+0000 7f4e9a178700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e9415ac10 0x7f4e940b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.499 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.500+0000 7f4e9a178700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e7c003bd0 0x7f4e9413d330 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.500 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.500+0000 7f4e9a178700 1 --2- 172.21.15.179:0/1581198654 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e941564b0 0x7f4e9415a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.500 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.500+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 >> 172.21.15.179:0/1581198654 conn(0x7f4e9406b150 msgr2=0x7f4e940cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:10.500 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.500+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 shutdown_connections 2023-12-07T00:15:10.500 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.500+0000 7f4e9a178700 1 -- 172.21.15.179:0/1581198654 wait complete. 2023-12-07T00:15:10.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:15:10.512 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:15:10.639 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.636+0000 7f92f848a700 1 Processor -- start 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.636+0000 7f92f848a700 1 -- start start 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f848a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f00cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f848a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92f006af70 0x7f92f006b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f848a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f00cb0f0 con 0x7f92f0161c70 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f848a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f0162810 con 0x7f92f006af70 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f848a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f006b930 con 0x7f92f0161360 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f5a25700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92f006af70 0x7f92f006b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f5a25700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92f006af70 0x7f92f006b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40762/0 (socket says 172.21.15.179:40762) 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f5a25700 1 -- 172.21.15.179:0/992966335 learned_addr learned my addr 172.21.15.179:0/992966335 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.637+0000 7f92f6226700 1 --2- 172.21.15.179:0/992966335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f00cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f5a25700 1 -- 172.21.15.179:0/992966335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 msgr2=0x7f92f00cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f5a25700 1 --2- 172.21.15.179:0/992966335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f00cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f5a25700 1 -- 172.21.15.179:0/992966335 >> v1:172.21.15.190:6789/0 conn(0x7f92f0161c70 legacy=0x7f92f0162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.640 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f5a25700 1 -- 172.21.15.179:0/992966335 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0161740 con 0x7f92f006af70 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f6226700 1 --2- 172.21.15.179:0/992966335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f00cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f5a25700 1 --2- 172.21.15.179:0/992966335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f006b3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f92e00098f0 tx=0x7f92e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff697336ca8786b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f5224700 1 -- 172.21.15.179:0/992966335 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e000b8a0 con 0x7f92f006af70 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f5224700 1 -- 172.21.15.179:0/992966335 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e000ba00 con 0x7f92f006af70 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.638+0000 7f92f5224700 1 -- 172.21.15.179:0/992966335 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e000bd90 con 0x7f92f006af70 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.639+0000 7f92f848a700 1 -- 172.21.15.179:0/992966335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 msgr2=0x7f92f006b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.639+0000 7f92f848a700 1 --2- 172.21.15.179:0/992966335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f006b3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f92e00098f0 tx=0x7f92e0009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.639+0000 7f92f848a700 1 -- 172.21.15.179:0/992966335 shutdown_connections 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.639+0000 7f92f848a700 1 --2- 172.21.15.179:0/992966335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f00cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.639+0000 7f92f848a700 1 --2- 172.21.15.179:0/992966335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f006b3f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.639+0000 7f92f848a700 1 -- 172.21.15.179:0/992966335 >> 172.21.15.179:0/992966335 conn(0x7f92f0099a40 msgr2=0x7f92f0099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.639+0000 7f92f848a700 1 -- 172.21.15.179:0/992966335 shutdown_connections 2023-12-07T00:15:10.641 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.639+0000 7f92f848a700 1 -- 172.21.15.179:0/992966335 wait complete. 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.640+0000 7f92f848a700 1 Processor -- start 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.640+0000 7f92f848a700 1 -- start start 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f848a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f01552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f848a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f015db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f848a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92f0161c70 0x7f92f015e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f848a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f01557e0 con 0x7f92f006af70 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f848a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f0159330 con 0x7f92f0161c70 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f848a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f0159050 con 0x7f92f0161360 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f01552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f01552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40766/0 (socket says 172.21.15.179:40766) 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 -- 172.21.15.179:0/1025209499 learned_addr learned my addr 172.21.15.179:0/1025209499 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f5a25700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f015db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6a27700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92f0161c70 0x7f92f015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.644 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 -- 172.21.15.179:0/1025209499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 msgr2=0x7f92f015db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f015db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 -- 172.21.15.179:0/1025209499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92f0161c70 msgr2=0x7f92f015e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92f0161c70 0x7f92f015e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 -- 172.21.15.179:0/1025209499 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e0009550 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f6226700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f01552a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00e810 tx=0x7f92ec00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92e6ffd700 1 -- 172.21.15.179:0/1025209499 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec00c070 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92e6ffd700 1 -- 172.21.15.179:0/1025209499 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec004230 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f00af280 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92e6ffd700 1 -- 172.21.15.179:0/1025209499 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec0036a0 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.641+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f0160a40 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.642+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f00685f0 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.643+0000 7f92e6ffd700 1 -- 172.21.15.179:0/1025209499 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92ec003800 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.643+0000 7f92e6ffd700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f92d406aed0 0x7f92d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.643+0000 7f92e6ffd700 1 -- 172.21.15.179:0/1025209499 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f92ec089580 con 0x7f92f006af70 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.643+0000 7f92f5a25700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f92d406aed0 0x7f92d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.645 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.644+0000 7f92f5a25700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f92d406aed0 0x7f92d406d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92e0014040 tx=0x7f92e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.649 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.648+0000 7f92e6ffd700 1 -- 172.21.15.179:0/1025209499 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92ec054300 con 0x7f92f006af70 2023-12-07T00:15:10.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.847+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92f0070b70 con 0x7f92f006af70 2023-12-07T00:15:10.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.847+0000 7f92e6ffd700 1 -- 172.21.15.179:0/1025209499 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92ec057920 con 0x7f92f006af70 2023-12-07T00:15:10.847 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f92d406aed0 msgr2=0x7f92d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f92d406aed0 0x7f92d406d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f92e0014040 tx=0x7f92e0008030 comp rx=0 tx=0).stop 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 msgr2=0x7f92f01552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f01552a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00e810 tx=0x7f92ec00eb20 comp rx=0 tx=0).stop 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 shutdown_connections 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f92d406aed0 0x7f92d406d390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92f0161c70 0x7f92f015e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92f006af70 0x7f92f01552a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 --2- 172.21.15.179:0/1025209499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92f0161360 0x7f92f015db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 >> 172.21.15.179:0/1025209499 conn(0x7f92f0099a40 msgr2=0x7f92f00cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:10.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 shutdown_connections 2023-12-07T00:15:10.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.849+0000 7f92f848a700 1 -- 172.21.15.179:0/1025209499 wait complete. 2023-12-07T00:15:10.861 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:15:10.985 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.985+0000 7fdf87fc3700 1 Processor -- start 2023-12-07T00:15:10.985 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.985+0000 7fdf87fc3700 1 -- start start 2023-12-07T00:15:10.987 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf87fc3700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdf800cc590 0x7fdf800cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.987 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf87fc3700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf80099b90 0x7fdf8009a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf87fc3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf800ccac0 con 0x7fdf8015bd70 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf87fc3700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf800cd740 con 0x7fdf80099b90 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf87fc3700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8009a580 con 0x7fdf800cc590 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf86560700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf80099b90 0x7fdf8009a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf86560700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdf80099b90 0x7fdf8009a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40778/0 (socket says 172.21.15.179:40778) 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf86560700 1 -- 172.21.15.179:0/2684649252 learned_addr learned my addr 172.21.15.179:0/2684649252 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf86560700 1 -- 172.21.15.179:0/2684649252 >> v2:172.21.15.190:3300/0 conn(0x7fdf800cc590 msgr2=0x7fdf800cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf8555e700 1 --2- 172.21.15.179:0/2684649252 >> v2:172.21.15.190:3300/0 conn(0x7fdf800cc590 0x7fdf800cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf86560700 1 --2- 172.21.15.179:0/2684649252 >> v2:172.21.15.190:3300/0 conn(0x7fdf800cc590 0x7fdf800cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf86560700 1 -- 172.21.15.179:0/2684649252 >> v1:172.21.15.190:6789/0 conn(0x7fdf8015bd70 legacy=0x7fdf800d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf86560700 1 -- 172.21.15.179:0/2684649252 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf800ccda0 con 0x7fdf80099b90 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.986+0000 7fdf86560700 1 --2- 172.21.15.179:0/2684649252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf80099b90 0x7fdf8009a040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdf8015f730 tx=0x7fdf7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a523ae22fe956d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf84d5d700 1 -- 172.21.15.179:0/2684649252 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7800e070 con 0x7fdf80099b90 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf84d5d700 1 -- 172.21.15.179:0/2684649252 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78003a20 con 0x7fdf80099b90 2023-12-07T00:15:10.988 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf84d5d700 1 -- 172.21.15.179:0/2684649252 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78003dd0 con 0x7fdf80099b90 2023-12-07T00:15:10.989 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf87fc3700 1 -- 172.21.15.179:0/2684649252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf80099b90 msgr2=0x7fdf8009a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.989 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/2684649252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf80099b90 0x7fdf8009a040 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdf8015f730 tx=0x7fdf7800b330 comp rx=0 tx=0).stop 2023-12-07T00:15:10.989 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf87fc3700 1 -- 172.21.15.179:0/2684649252 shutdown_connections 2023-12-07T00:15:10.989 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/2684649252 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf80099b90 0x7fdf8009a040 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.989 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/2684649252 >> v2:172.21.15.190:3300/0 conn(0x7fdf800cc590 0x7fdf800cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.989 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf87fc3700 1 -- 172.21.15.179:0/2684649252 >> 172.21.15.179:0/2684649252 conn(0x7fdf800b34e0 msgr2=0x7fdf800b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:10.989 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf87fc3700 1 -- 172.21.15.179:0/2684649252 shutdown_connections 2023-12-07T00:15:10.989 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.987+0000 7fdf87fc3700 1 -- 172.21.15.179:0/2684649252 wait complete. 2023-12-07T00:15:10.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.988+0000 7fdf87fc3700 1 Processor -- start 2023-12-07T00:15:10.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf87fc3700 1 -- start start 2023-12-07T00:15:10.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf87fc3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf80099b90 0x7fdf80158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf87fc3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf800cc590 0x7fdf8015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.992 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf87fc3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015bd70 0x7fdf8015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf87fc3700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800ae9c0 con 0x7fdf800cc590 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf87fc3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800aeca0 con 0x7fdf80099b90 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf87fc3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf800b4720 con 0x7fdf8015bd70 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf8555e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf800cc590 0x7fdf8015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf8555e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf800cc590 0x7fdf8015e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40782/0 (socket says 172.21.15.179:40782) 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf8555e700 1 -- 172.21.15.179:0/1035219688 learned_addr learned my addr 172.21.15.179:0/1035219688 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf86560700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015bd70 0x7fdf8015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.989+0000 7fdf85d5f700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf80099b90 0x7fdf80158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf8555e700 1 -- 172.21.15.179:0/1035219688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015bd70 msgr2=0x7fdf8015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf8555e700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015bd70 0x7fdf8015eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf8555e700 1 -- 172.21.15.179:0/1035219688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf80099b90 msgr2=0x7fdf80158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf8555e700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf80099b90 0x7fdf80158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf8555e700 1 -- 172.21.15.179:0/1035219688 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78009b30 con 0x7fdf800cc590 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf8555e700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf800cc590 0x7fdf8015e5c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c7f0 tx=0x7fdf7000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.993 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf767fc700 1 -- 172.21.15.179:0/1035219688 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf70004220 con 0x7fdf800cc590 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf767fc700 1 -- 172.21.15.179:0/1035219688 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf70004380 con 0x7fdf800cc590 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf800b4a00 con 0x7fdf800cc590 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf767fc700 1 -- 172.21.15.179:0/1035219688 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf700036a0 con 0x7fdf800cc590 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.990+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf800ae5e0 con 0x7fdf800cc590 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.991+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf800685f0 con 0x7fdf800cc590 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.992+0000 7fdf767fc700 1 -- 172.21.15.179:0/1035219688 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf70003800 con 0x7fdf800cc590 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.992+0000 7fdf767fc700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdf6406aed0 0x7fdf6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.992+0000 7fdf767fc700 1 -- 172.21.15.179:0/1035219688 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdf700899b0 con 0x7fdf800cc590 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.992+0000 7fdf85d5f700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdf6406aed0 0x7fdf6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:10.994 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.992+0000 7fdf85d5f700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdf6406aed0 0x7fdf6406d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c004f30 tx=0x7fdf7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:10.995 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:10.996+0000 7fdf767fc700 1 -- 172.21.15.179:0/1035219688 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf70054730 con 0x7fdf800cc590 2023-12-07T00:15:11.186 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.186+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf800b43d0 con 0x7fdf800cc590 2023-12-07T00:15:11.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.187+0000 7fdf767fc700 1 -- 172.21.15.179:0/1035219688 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdf7001e020 con 0x7fdf800cc590 2023-12-07T00:15:11.187 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:11.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdf6406aed0 msgr2=0x7fdf6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdf6406aed0 0x7fdf6406d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c004f30 tx=0x7fdf7c009040 comp rx=0 tx=0).stop 2023-12-07T00:15:11.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf800cc590 msgr2=0x7fdf8015e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf800cc590 0x7fdf8015e5c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdf7000c7f0 tx=0x7fdf7000cbb0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 shutdown_connections 2023-12-07T00:15:11.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdf6406aed0 0x7fdf6406d390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdf8015bd70 0x7fdf8015eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdf80099b90 0x7fdf80158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 --2- 172.21.15.179:0/1035219688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdf800cc590 0x7fdf8015e5c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 >> 172.21.15.179:0/1035219688 conn(0x7fdf800b34e0 msgr2=0x7fdf8015b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:11.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 shutdown_connections 2023-12-07T00:15:11.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.189+0000 7fdf87fc3700 1 -- 172.21.15.179:0/1035219688 wait complete. 2023-12-07T00:15:11.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:15:11.324 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.323+0000 7f4c5ac87700 1 Processor -- start 2023-12-07T00:15:11.324 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.324+0000 7f4c5ac87700 1 -- start start 2023-12-07T00:15:11.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.324+0000 7f4c5ac87700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4c54161360 0x7f4c540cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.324+0000 7f4c5ac87700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162380 0x7f4c5406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.324+0000 7f4c5ac87700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c540cb0f0 con 0x7f4c5406af70 2023-12-07T00:15:11.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.324+0000 7f4c5ac87700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5406b930 con 0x7f4c54161360 2023-12-07T00:15:11.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.324+0000 7f4c5ac87700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c541627f0 con 0x7f4c54162380 2023-12-07T00:15:11.327 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c59224700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162380 0x7f4c5406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c58a23700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4c54161360 0x7f4c540cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c59224700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162380 0x7f4c5406b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41206/0 (socket says 172.21.15.179:41206) 2023-12-07T00:15:11.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c59224700 1 -- 172.21.15.179:0/1035086721 learned_addr learned my addr 172.21.15.179:0/1035086721 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:11.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c59224700 1 -- 172.21.15.179:0/1035086721 >> v2:172.21.15.190:3300/0 conn(0x7f4c54161360 msgr2=0x7f4c540cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:11.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c59224700 1 --2- 172.21.15.179:0/1035086721 >> v2:172.21.15.190:3300/0 conn(0x7f4c54161360 0x7f4c540cc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c59224700 1 -- 172.21.15.179:0/1035086721 >> v1:172.21.15.190:6789/0 conn(0x7f4c5406af70 legacy=0x7f4c54161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c59224700 1 -- 172.21.15.179:0/1035086721 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c54161740 con 0x7f4c54162380 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c58a23700 1 --2- 172.21.15.179:0/1035086721 >> v2:172.21.15.190:3300/0 conn(0x7f4c54161360 0x7f4c540cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c59224700 1 --2- 172.21.15.179:0/1035086721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162380 0x7f4c5406b3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009e50 tx=0x7f4c4c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfbaba9a7979d204 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c537fe700 1 -- 172.21.15.179:0/1035086721 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00e070 con 0x7f4c54162380 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c537fe700 1 -- 172.21.15.179:0/1035086721 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c00b910 con 0x7f4c54162380 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.325+0000 7f4c537fe700 1 -- 172.21.15.179:0/1035086721 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00bcc0 con 0x7f4c54162380 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.326+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1035086721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162380 msgr2=0x7f4c5406b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.326+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1035086721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162380 0x7f4c5406b3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c009e50 tx=0x7f4c4c00b330 comp rx=0 tx=0).stop 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.326+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1035086721 shutdown_connections 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.326+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1035086721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54162380 0x7f4c5406b3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.326+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1035086721 >> v2:172.21.15.190:3300/0 conn(0x7f4c54161360 0x7f4c540cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.326+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1035086721 >> 172.21.15.179:0/1035086721 conn(0x7f4c54099a40 msgr2=0x7f4c54099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:11.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.326+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1035086721 shutdown_connections 2023-12-07T00:15:11.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.326+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1035086721 wait complete. 2023-12-07T00:15:11.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.327+0000 7f4c5ac87700 1 Processor -- start 2023-12-07T00:15:11.331 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.327+0000 7f4c5ac87700 1 -- start start 2023-12-07T00:15:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c5ac87700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5406af70 0x7f4c54155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c5ac87700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54161360 0x7f4c54157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c5ac87700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c54162380 0x7f4c5415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c5ac87700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54155ba0 con 0x7f4c5406af70 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c5ac87700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c54156b70 con 0x7f4c54162380 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c5ac87700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c541570f0 con 0x7f4c54161360 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c58a23700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5406af70 0x7f4c54155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c58a23700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5406af70 0x7f4c54155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40796/0 (socket says 172.21.15.179:40796) 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c58a23700 1 -- 172.21.15.179:0/1594573084 learned_addr learned my addr 172.21.15.179:0/1594573084 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c53fff700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54161360 0x7f4c54157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.328+0000 7f4c59224700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c54162380 0x7f4c5415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c58a23700 1 -- 172.21.15.179:0/1594573084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54161360 msgr2=0x7f4c54157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c58a23700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54161360 0x7f4c54157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c58a23700 1 -- 172.21.15.179:0/1594573084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c54162380 msgr2=0x7f4c5415aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c58a23700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c54162380 0x7f4c5415aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c58a23700 1 -- 172.21.15.179:0/1594573084 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480094a0 con 0x7f4c5406af70 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c58a23700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5406af70 0x7f4c54155660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800ebe0 tx=0x7f4c4800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c517fa700 1 -- 172.21.15.179:0/1594573084 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48009760 con 0x7f4c5406af70 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c517fa700 1 -- 172.21.15.179:0/1594573084 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4800c850 con 0x7f4c5406af70 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c009b30 con 0x7f4c5406af70 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c517fa700 1 -- 172.21.15.179:0/1594573084 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800cbe0 con 0x7f4c5406af70 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.329+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c54157ac0 con 0x7f4c5406af70 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.330+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c540cb5e0 con 0x7f4c5406af70 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.330+0000 7f4c517fa700 1 -- 172.21.15.179:0/1594573084 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c4800cd40 con 0x7f4c5406af70 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.331+0000 7f4c517fa700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c3806aed0 0x7f4c3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.331+0000 7f4c53fff700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c3806aed0 0x7f4c3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.331+0000 7f4c517fa700 1 -- 172.21.15.179:0/1594573084 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4c48089a50 con 0x7f4c5406af70 2023-12-07T00:15:11.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.331+0000 7f4c53fff700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c3806aed0 0x7f4c3806d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4c54099f90 tx=0x7f4c40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:11.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.335+0000 7f4c517fa700 1 -- 172.21.15.179:0/1594573084 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c480546a0 con 0x7f4c5406af70 2023-12-07T00:15:11.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.525+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4c540685f0 con 0x7f4c5406af70 2023-12-07T00:15:11.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.526+0000 7f4c517fa700 1 -- 172.21.15.179:0/1594573084 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c48057cc0 con 0x7f4c5406af70 2023-12-07T00:15:11.527 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:15:11.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c3806aed0 msgr2=0x7f4c3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c3806aed0 0x7f4c3806d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4c54099f90 tx=0x7f4c40009040 comp rx=0 tx=0).stop 2023-12-07T00:15:11.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5406af70 msgr2=0x7f4c54155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5406af70 0x7f4c54155660 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800ebe0 tx=0x7f4c4800eef0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 shutdown_connections 2023-12-07T00:15:11.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c3806aed0 0x7f4c3806d390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c54162380 0x7f4c5415aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c5406af70 0x7f4c54155660 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 --2- 172.21.15.179:0/1594573084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c54161360 0x7f4c54157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 >> 172.21.15.179:0/1594573084 conn(0x7f4c54099a40 msgr2=0x7f4c540d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:11.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 shutdown_connections 2023-12-07T00:15:11.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.528+0000 7f4c5ac87700 1 -- 172.21.15.179:0/1594573084 wait complete. 2023-12-07T00:15:11.541 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:15:11.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.664+0000 7fba8eb54700 1 Processor -- start 2023-12-07T00:15:11.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.664+0000 7fba8eb54700 1 -- start start 2023-12-07T00:15:11.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba8eb54700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fba88162100 0x7fba881624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba8eb54700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fba880cfcc0 0x7fba88099b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba8eb54700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba880d06a0 con 0x7fba880d0150 2023-12-07T00:15:11.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba8eb54700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba88162a20 con 0x7fba880cfcc0 2023-12-07T00:15:11.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba8eb54700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880d0980 con 0x7fba88162100 2023-12-07T00:15:11.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba87fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fba880cfcc0 0x7fba88099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba87fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fba880cfcc0 0x7fba88099b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40804/0 (socket says 172.21.15.179:40804) 2023-12-07T00:15:11.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba8d0f1700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fba880d0150 0x7fba8815d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47708/0 (socket says 172.21.15.179:47708) 2023-12-07T00:15:11.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.665+0000 7fba87fff700 1 -- 172.21.15.179:0/2836575141 learned_addr learned my addr 172.21.15.179:0/2836575141 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:11.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba8c8f0700 1 --2- 172.21.15.179:0/2836575141 >> v2:172.21.15.190:3300/0 conn(0x7fba88162100 0x7fba881624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba87fff700 1 -- 172.21.15.179:0/2836575141 >> v2:172.21.15.190:3300/0 conn(0x7fba88162100 msgr2=0x7fba881624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba87fff700 1 --2- 172.21.15.179:0/2836575141 >> v2:172.21.15.190:3300/0 conn(0x7fba88162100 0x7fba881624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba87fff700 1 -- 172.21.15.179:0/2836575141 >> v1:172.21.15.179:6789/0 conn(0x7fba880d0150 legacy=0x7fba8815d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba877fe700 1 -- 172.21.15.179:0/2836575141 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571099564 0 0) 0x7fba880d06a0 con 0x7fba880d0150 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba87fff700 1 -- 172.21.15.179:0/2836575141 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba880d0c60 con 0x7fba880cfcc0 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba87fff700 1 --2- 172.21.15.179:0/2836575141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880cfcc0 0x7fba88099b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fba740098f0 tx=0x7fba74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d9c6bfc1a91229 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba877fe700 1 -- 172.21.15.179:0/2836575141 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400b860 con 0x7fba880cfcc0 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba877fe700 1 -- 172.21.15.179:0/2836575141 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400b9c0 con 0x7fba880cfcc0 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba877fe700 1 -- 172.21.15.179:0/2836575141 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7400bd50 con 0x7fba880cfcc0 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba8eb54700 1 -- 172.21.15.179:0/2836575141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880cfcc0 msgr2=0x7fba88099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.666+0000 7fba8eb54700 1 --2- 172.21.15.179:0/2836575141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880cfcc0 0x7fba88099b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fba740098f0 tx=0x7fba74009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.667+0000 7fba8eb54700 1 -- 172.21.15.179:0/2836575141 shutdown_connections 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.667+0000 7fba8eb54700 1 --2- 172.21.15.179:0/2836575141 >> v2:172.21.15.190:3300/0 conn(0x7fba88162100 0x7fba881624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.667+0000 7fba8eb54700 1 --2- 172.21.15.179:0/2836575141 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880cfcc0 0x7fba88099b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.667+0000 7fba8eb54700 1 -- 172.21.15.179:0/2836575141 >> 172.21.15.179:0/2836575141 conn(0x7fba880b34e0 msgr2=0x7fba880b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:11.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.667+0000 7fba8eb54700 1 -- 172.21.15.179:0/2836575141 shutdown_connections 2023-12-07T00:15:11.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.667+0000 7fba8eb54700 1 -- 172.21.15.179:0/2836575141 wait complete. 2023-12-07T00:15:11.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.668+0000 7fba8eb54700 1 Processor -- start 2023-12-07T00:15:11.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.668+0000 7fba8eb54700 1 -- start start 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8eb54700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba880cfcc0 0x7fba881587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8eb54700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880d0150 0x7fba880c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8eb54700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba88162100 0x7fba8815cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8eb54700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba880b2740 con 0x7fba880d0150 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8eb54700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba880c55c0 con 0x7fba880cfcc0 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8eb54700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba880c58a0 con 0x7fba88162100 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880d0150 0x7fba880c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880d0150 0x7fba880c60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40810/0 (socket says 172.21.15.179:40810) 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 -- 172.21.15.179:0/1647661764 learned_addr learned my addr 172.21.15.179:0/1647661764 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8c8f0700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba880cfcc0 0x7fba881587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8d0f1700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba88162100 0x7fba8815cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 -- 172.21.15.179:0/1647661764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba88162100 msgr2=0x7fba8815cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba88162100 0x7fba8815cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 -- 172.21.15.179:0/1647661764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba880cfcc0 msgr2=0x7fba881587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba880cfcc0 0x7fba881587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 -- 172.21.15.179:0/1647661764 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74009550 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba87fff700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880d0150 0x7fba880c60a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fba880733b0 tx=0x7fba74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba857fa700 1 -- 172.21.15.179:0/1647661764 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74011930 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba857fa700 1 -- 172.21.15.179:0/1647661764 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7401f070 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba880c5b80 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.669+0000 7fba857fa700 1 -- 172.21.15.179:0/1647661764 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74011cb0 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.670+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba880b23a0 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.670+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba880c5d10 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.671+0000 7fba857fa700 1 -- 172.21.15.179:0/1647661764 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba7401a430 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.671+0000 7fba857fa700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fba6c06aed0 0x7fba6c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.671+0000 7fba857fa700 1 -- 172.21.15.179:0/1647661764 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fba74021070 con 0x7fba880d0150 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.671+0000 7fba8c8f0700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fba6c06aed0 0x7fba6c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:11.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.672+0000 7fba8c8f0700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fba6c06aed0 0x7fba6c06d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00b9b0 tx=0x7fba7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:11.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.676+0000 7fba857fa700 1 -- 172.21.15.179:0/1647661764 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba74056150 con 0x7fba880d0150 2023-12-07T00:15:11.869 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.868+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fba880d06a0 con 0x7fba880d0150 2023-12-07T00:15:11.869 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.869+0000 7fba857fa700 1 -- 172.21.15.179:0/1647661764 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fba74059770 con 0x7fba880d0150 2023-12-07T00:15:11.869 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:11.871 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fba6c06aed0 msgr2=0x7fba6c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.871 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fba6c06aed0 0x7fba6c06d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00b9b0 tx=0x7fba7c008040 comp rx=0 tx=0).stop 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880d0150 msgr2=0x7fba880c60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880d0150 0x7fba880c60a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fba880733b0 tx=0x7fba74004750 comp rx=0 tx=0).stop 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 shutdown_connections 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fba6c06aed0 0x7fba6c06d390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fba88162100 0x7fba8815cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fba880cfcc0 0x7fba881587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 --2- 172.21.15.179:0/1647661764 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fba880d0150 0x7fba880c60a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 >> 172.21.15.179:0/1647661764 conn(0x7fba880b34e0 msgr2=0x7fba880b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 shutdown_connections 2023-12-07T00:15:11.872 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:11.871+0000 7fba8eb54700 1 -- 172.21.15.179:0/1647661764 wait complete. 2023-12-07T00:15:11.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T00:15:12.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.004+0000 7fddaa704700 1 Processor -- start 2023-12-07T00:15:12.004 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.004+0000 7fddaa704700 1 -- start start 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fddaa704700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdda4158560 0x7fdda40b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fddaa704700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdda415b010 0x7fdda40b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fddaa704700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40b2ef0 con 0x7fdda40b2aa0 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fddaa704700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda415b8d0 con 0x7fdda4158560 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fddaa704700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda415bbb0 con 0x7fdda415b010 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda3fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdda4158560 0x7fdda40b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda8ca1700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fdda40b2aa0 0x7fdda406e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47722/0 (socket says 172.21.15.179:47722) 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda8ca1700 1 -- 172.21.15.179:0/1894402528 learned_addr learned my addr 172.21.15.179:0/1894402528 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda37fe700 1 --2- 172.21.15.179:0/1894402528 >> v2:172.21.15.190:3300/0 conn(0x7fdda415b010 0x7fdda40b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda3fff700 1 -- 172.21.15.179:0/1894402528 >> v2:172.21.15.190:3300/0 conn(0x7fdda415b010 msgr2=0x7fdda40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda3fff700 1 --2- 172.21.15.179:0/1894402528 >> v2:172.21.15.190:3300/0 conn(0x7fdda415b010 0x7fdda40b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda3fff700 1 -- 172.21.15.179:0/1894402528 >> v1:172.21.15.179:6789/0 conn(0x7fdda40b2aa0 legacy=0x7fdda406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda2ffd700 1 -- 172.21.15.179:0/1894402528 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363894720 0 0) 0x7fdd9c001490 con 0x7fdda40b2aa0 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda3fff700 1 -- 172.21.15.179:0/1894402528 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda415be90 con 0x7fdda4158560 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda3fff700 1 --2- 172.21.15.179:0/1894402528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda4158560 0x7fdda40b4470 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdda40b49b0 tx=0x7fdd9400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d93c896ac5fadd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda2ffd700 1 -- 172.21.15.179:0/1894402528 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400dc70 con 0x7fdda4158560 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda2ffd700 1 -- 172.21.15.179:0/1894402528 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400ddd0 con 0x7fdda4158560 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.005+0000 7fdda2ffd700 1 -- 172.21.15.179:0/1894402528 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94010690 con 0x7fdda4158560 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.006+0000 7fddaa704700 1 -- 172.21.15.179:0/1894402528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda4158560 msgr2=0x7fdda40b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.006+0000 7fddaa704700 1 --2- 172.21.15.179:0/1894402528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda4158560 0x7fdda40b4470 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdda40b49b0 tx=0x7fdd9400bdc0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.008 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.006+0000 7fddaa704700 1 -- 172.21.15.179:0/1894402528 shutdown_connections 2023-12-07T00:15:12.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.006+0000 7fddaa704700 1 --2- 172.21.15.179:0/1894402528 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda4158560 0x7fdda40b4470 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.006+0000 7fddaa704700 1 --2- 172.21.15.179:0/1894402528 >> v2:172.21.15.190:3300/0 conn(0x7fdda415b010 0x7fdda40b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.006+0000 7fddaa704700 1 -- 172.21.15.179:0/1894402528 >> 172.21.15.179:0/1894402528 conn(0x7fdda4072970 msgr2=0x7fdda4072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:12.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.006+0000 7fddaa704700 1 -- 172.21.15.179:0/1894402528 shutdown_connections 2023-12-07T00:15:12.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.006+0000 7fddaa704700 1 -- 172.21.15.179:0/1894402528 wait complete. 2023-12-07T00:15:12.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.007+0000 7fddaa704700 1 Processor -- start 2023-12-07T00:15:12.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.007+0000 7fddaa704700 1 -- start start 2023-12-07T00:15:12.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fddaa704700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdda40b2aa0 0x7fdda413ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fddaa704700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda4158560 0x7fdda41596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fddaa704700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda415b010 0x7fdda4159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fddaa704700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda413f190 con 0x7fdda415b010 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fddaa704700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda4153990 con 0x7fdda4158560 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fddaa704700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda4142420 con 0x7fdda40b2aa0 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda8ca1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda415b010 0x7fdda4159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda8ca1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda415b010 0x7fdda4159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40826/0 (socket says 172.21.15.179:40826) 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda8ca1700 1 -- 172.21.15.179:0/54363151 learned_addr learned my addr 172.21.15.179:0/54363151 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda37fe700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda4158560 0x7fdda41596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda3fff700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdda40b2aa0 0x7fdda413ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda8ca1700 1 -- 172.21.15.179:0/54363151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdda40b2aa0 msgr2=0x7fdda413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda8ca1700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdda40b2aa0 0x7fdda413ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda8ca1700 1 -- 172.21.15.179:0/54363151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda4158560 msgr2=0x7fdda41596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda8ca1700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda4158560 0x7fdda41596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.008+0000 7fdda8ca1700 1 -- 172.21.15.179:0/54363151 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9400b740 con 0x7fdda415b010 2023-12-07T00:15:12.012 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.009+0000 7fdda8ca1700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda415b010 0x7fdda4159be0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00cba0 tx=0x7fdd9c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.009+0000 7fdda0ff9700 1 -- 172.21.15.179:0/54363151 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00ab80 con 0x7fdda415b010 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.009+0000 7fdda0ff9700 1 -- 172.21.15.179:0/54363151 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c00ad00 con 0x7fdda415b010 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.009+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda4142140 con 0x7fdda415b010 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.009+0000 7fdda0ff9700 1 -- 172.21.15.179:0/54363151 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c007310 con 0x7fdda415b010 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.009+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda413f820 con 0x7fdda415b010 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.010+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda404f290 con 0x7fdda415b010 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.010+0000 7fdda0ff9700 1 -- 172.21.15.179:0/54363151 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd9c007470 con 0x7fdda415b010 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.011+0000 7fdda0ff9700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdd9006aed0 0x7fdd9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.011+0000 7fdda0ff9700 1 -- 172.21.15.179:0/54363151 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd9c089670 con 0x7fdda415b010 2023-12-07T00:15:12.013 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.011+0000 7fdda3fff700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdd9006aed0 0x7fdd9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.011+0000 7fdda3fff700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdd9006aed0 0x7fdd9006d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400b2c0 tx=0x7fdd94013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.015+0000 7fdda0ff9700 1 -- 172.21.15.179:0/54363151 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd9c054360 con 0x7fdda415b010 2023-12-07T00:15:12.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.222+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdda413fe70 con 0x7fdda415b010 2023-12-07T00:15:12.222 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.222+0000 7fdda0ff9700 1 -- 172.21.15.179:0/54363151 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdd9c057980 con 0x7fdda415b010 2023-12-07T00:15:12.227 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.224+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdd9006aed0 msgr2=0x7fdd9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.224+0000 7fddaa704700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdd9006aed0 0x7fdd9006d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400b2c0 tx=0x7fdd94013000 comp rx=0 tx=0).stop 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.224+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda415b010 msgr2=0x7fdda4159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.224+0000 7fddaa704700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda415b010 0x7fdda4159be0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00cba0 tx=0x7fdd9c00cf60 comp rx=0 tx=0).stop 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.224+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 shutdown_connections 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.224+0000 7fddaa704700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fdd9006aed0 0x7fdd9006d390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.224+0000 7fddaa704700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdda415b010 0x7fdda4159be0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.224+0000 7fddaa704700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdda40b2aa0 0x7fdda413ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.225+0000 7fddaa704700 1 --2- 172.21.15.179:0/54363151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdda4158560 0x7fdda41596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.225+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 >> 172.21.15.179:0/54363151 conn(0x7fdda4072970 msgr2=0x7fdda4072d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.225+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 shutdown_connections 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.225+0000 7fddaa704700 1 -- 172.21.15.179:0/54363151 wait complete. 2023-12-07T00:15:12.228 INFO:teuthology.orchestra.run.smithi179.stderr:listed 0 entries 2023-12-07T00:15:12.237 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-07T00:15:12.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:12.237 DEBUG:teuthology.orchestra.run.smithi190:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-07T00:15:12.287 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T00:15:12.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:12.288 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-07T00:15:12.307 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-07T00:15:12.307 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:15:12.428 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.428+0000 7f5aee3b2700 1 Processor -- start 2023-12-07T00:15:12.429 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.428+0000 7f5aee3b2700 1 -- start start 2023-12-07T00:15:12.431 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aee3b2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5ae80d06b0 0x7f5ae8099c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aee3b2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ae809a140 0x7f5ae80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aee3b2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae809a550 con 0x7f5ae815bde0 2023-12-07T00:15:12.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aee3b2700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae809ab50 con 0x7f5ae809a140 2023-12-07T00:15:12.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aee3b2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae80cf630 con 0x7f5ae80d06b0 2023-12-07T00:15:12.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aec94f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ae809a140 0x7f5ae80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.432 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aec94f700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f5ae809a140 0x7f5ae80b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40834/0 (socket says 172.21.15.179:40834) 2023-12-07T00:15:12.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aec94f700 1 -- 172.21.15.179:0/269841890 learned_addr learned my addr 172.21.15.179:0/269841890 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:12.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5ae77fe700 1 --2- 172.21.15.179:0/269841890 >> v2:172.21.15.190:3300/0 conn(0x7f5ae80d06b0 0x7f5ae8099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aec94f700 1 -- 172.21.15.179:0/269841890 >> v2:172.21.15.190:3300/0 conn(0x7f5ae80d06b0 msgr2=0x7f5ae8099c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:12.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aec94f700 1 --2- 172.21.15.179:0/269841890 >> v2:172.21.15.190:3300/0 conn(0x7f5ae80d06b0 0x7f5ae8099c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aec94f700 1 -- 172.21.15.179:0/269841890 >> v1:172.21.15.190:6789/0 conn(0x7f5ae815bde0 legacy=0x7f5ae80cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aec94f700 1 -- 172.21.15.179:0/269841890 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80cf8f0 con 0x7f5ae809a140 2023-12-07T00:15:12.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5ae77fe700 1 --2- 172.21.15.179:0/269841890 >> v2:172.21.15.190:3300/0 conn(0x7f5ae80d06b0 0x7f5ae8099c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:12.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.429+0000 7f5aec94f700 1 --2- 172.21.15.179:0/269841890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae809a140 0x7f5ae80b1230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80b4100 tx=0x7f5ae000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705cd45b7b81f073 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5ae6ffd700 1 -- 172.21.15.179:0/269841890 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000e070 con 0x7f5ae809a140 2023-12-07T00:15:12.434 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5ae6ffd700 1 -- 172.21.15.179:0/269841890 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae000b9c0 con 0x7f5ae809a140 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5ae6ffd700 1 -- 172.21.15.179:0/269841890 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000bd70 con 0x7f5ae809a140 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5aee3b2700 1 -- 172.21.15.179:0/269841890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae809a140 msgr2=0x7f5ae80b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/269841890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae809a140 0x7f5ae80b1230 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80b4100 tx=0x7f5ae000b330 comp rx=0 tx=0).stop 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5aee3b2700 1 -- 172.21.15.179:0/269841890 shutdown_connections 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/269841890 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae809a140 0x7f5ae80b1230 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/269841890 >> v2:172.21.15.190:3300/0 conn(0x7f5ae80d06b0 0x7f5ae8099c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5aee3b2700 1 -- 172.21.15.179:0/269841890 >> 172.21.15.179:0/269841890 conn(0x7f5ae80b3550 msgr2=0x7f5ae80b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5aee3b2700 1 -- 172.21.15.179:0/269841890 shutdown_connections 2023-12-07T00:15:12.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.430+0000 7f5aee3b2700 1 -- 172.21.15.179:0/269841890 wait complete. 2023-12-07T00:15:12.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.431+0000 7f5aee3b2700 1 Processor -- start 2023-12-07T00:15:12.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.431+0000 7f5aee3b2700 1 -- start start 2023-12-07T00:15:12.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aee3b2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ae809a140 0x7f5ae81f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aee3b2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ae80d06b0 0x7f5ae814dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.440 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aee3b2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae815bde0 0x7f5ae815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aee3b2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae815d100 con 0x7f5ae815bde0 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aee3b2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae81f24f0 con 0x7f5ae80d06b0 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aee3b2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae814e400 con 0x7f5ae809a140 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aec94f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae815bde0 0x7f5ae815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aec94f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae815bde0 0x7f5ae815ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40840/0 (socket says 172.21.15.179:40840) 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5aec94f700 1 -- 172.21.15.179:0/3177333906 learned_addr learned my addr 172.21.15.179:0/3177333906 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5ae77fe700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ae80d06b0 0x7f5ae814dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.432+0000 7f5ae7fff700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ae809a140 0x7f5ae81f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5aec94f700 1 -- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ae809a140 msgr2=0x7f5ae81f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5aec94f700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ae809a140 0x7f5ae81f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5aec94f700 1 -- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ae80d06b0 msgr2=0x7f5ae814dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.441 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5aec94f700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ae80d06b0 0x7f5ae814dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5aec94f700 1 -- 172.21.15.179:0/3177333906 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae0009b30 con 0x7f5ae815bde0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5ae7fff700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ae809a140 0x7f5ae81f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5aec94f700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae815bde0 0x7f5ae815ddf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000b730 tx=0x7f5ae0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5ae4ff9700 1 -- 172.21.15.179:0/3177333906 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0004920 con 0x7f5ae815bde0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5ae4ff9700 1 -- 172.21.15.179:0/3177333906 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae00099b0 con 0x7f5ae815bde0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae815c4f0 con 0x7f5ae815bde0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5ae4ff9700 1 -- 172.21.15.179:0/3177333906 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae001b670 con 0x7f5ae815bde0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.433+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae815cab0 con 0x7f5ae815bde0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.434+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae815d2b0 con 0x7f5ae815bde0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.434+0000 7f5ae4ff9700 1 -- 172.21.15.179:0/3177333906 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ae001b7d0 con 0x7f5ae815bde0 2023-12-07T00:15:12.442 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.435+0000 7f5ae4ff9700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f5ad406aed0 0x7f5ad406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.435+0000 7f5ae4ff9700 1 -- 172.21.15.179:0/3177333906 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ae008aed0 con 0x7f5ae815bde0 2023-12-07T00:15:12.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.435+0000 7f5ae7fff700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f5ad406aed0 0x7f5ad406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.435+0000 7f5ae7fff700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f5ad406aed0 0x7f5ad406d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5adc000f60 tx=0x7f5adc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.443 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.439+0000 7f5ae4ff9700 1 -- 172.21.15.179:0/3177333906 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ae815d2b0 con 0x7f5ae815bde0 2023-12-07T00:15:12.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:15:12.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:15:12.680 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.680+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ae815d2b0 con 0x7f5ae815bde0 2023-12-07T00:15:12.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.681+0000 7f5ae4ff9700 1 -- 172.21.15.179:0/3177333906 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f5ae815d2b0 con 0x7f5ae815bde0 2023-12-07T00:15:12.681 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:12.681 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:31.106814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T00:15:12.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f5ad406aed0 msgr2=0x7f5ad406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f5ad406aed0 0x7f5ad406d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5adc000f60 tx=0x7f5adc009040 comp rx=0 tx=0).stop 2023-12-07T00:15:12.683 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae815bde0 msgr2=0x7f5ae815ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae815bde0 0x7f5ae815ddf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000b730 tx=0x7f5ae0004ad0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 shutdown_connections 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f5ad406aed0 0x7f5ad406d390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5ae815bde0 0x7f5ae815ddf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5ae809a140 0x7f5ae81f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 --2- 172.21.15.179:0/3177333906 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5ae80d06b0 0x7f5ae814dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 >> 172.21.15.179:0/3177333906 conn(0x7f5ae80b3550 msgr2=0x7f5ae80ccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 shutdown_connections 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.683+0000 7f5aee3b2700 1 -- 172.21.15.179:0/3177333906 wait complete. 2023-12-07T00:15:12.684 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 9 2023-12-07T00:15:12.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:12.816 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.816+0000 7f37760d6700 1 Processor -- start 2023-12-07T00:15:12.867 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.816+0000 7f37760d6700 1 -- start start 2023-12-07T00:15:12.873 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f37760d6700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f377015de40 0x7f37700b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f37760d6700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377015f330 con 0x7f377015e220 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f37760d6700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377015e720 con 0x7f37700b2c70 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f37760d6700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37700d1820 con 0x7f377015de40 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376effd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f377015e220 0x7f37700b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47748/0 (socket says 172.21.15.179:47748) 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376effd700 1 -- 172.21.15.179:0/1933271059 learned_addr learned my addr 172.21.15.179:0/1933271059 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938680523 0 0) 0x7f377015f330 con 0x7f377015e220 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f375c0035b0 con 0x7f377015e220 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376f7fe700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f377015de40 0x7f37700b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3513612168 0 0) 0x7f375c0035b0 con 0x7f377015e220 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f377015de40 msgr2=0x7f37700b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376e7fc700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f377015de40 0x7f37700b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 >> v1:172.21.15.190:6789/0 conn(0x7f37700b2c70 legacy=0x7f377015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377015ea00 con 0x7f377015e220 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.817+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f37600017f0 con 0x7f377015e220 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 >> v1:172.21.15.179:6789/0 conn(0x7f377015e220 legacy=0x7f37700b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f377015de40 0x7f375c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f375c004060 0x7f375c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004d90 0x7f375c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00bba0 con 0x7f375c004060 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00bd10 con 0x7f375c004d90 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c00bed0 con 0x7f377015de40 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376effd700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f375c004060 0x7f375c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376f7fe700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f377015de40 0x7f375c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376ffff700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004d90 0x7f375c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376effd700 1 -- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f377015de40 msgr2=0x7f375c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376effd700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f377015de40 0x7f375c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376effd700 1 -- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004d90 msgr2=0x7f375c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376effd700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004d90 0x7f375c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376effd700 1 -- 172.21.15.179:0/1933271059 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0035b0 con 0x7f375c004060 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376effd700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f375c004060 0x7f375c004850 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f376000c240 tx=0x7f375c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6672915e3db9f2f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376000cde0 con 0x7f375c004060 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760007b80 con 0x7f375c004060 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.818+0000 7f376e7fc700 1 -- 172.21.15.179:0/1933271059 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600072d0 con 0x7f375c004060 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.819+0000 7f37760d6700 1 -- 172.21.15.179:0/1933271059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f375c004060 msgr2=0x7f375c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.819+0000 7f37760d6700 1 --2- 172.21.15.179:0/1933271059 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f375c004060 0x7f375c004850 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f376000c240 tx=0x7f375c005880 comp rx=0 tx=0).stop 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.819+0000 7f376ffff700 1 -- 172.21.15.179:0/1933271059 reap_dead start 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.819+0000 7f37760d6700 1 -- 172.21.15.179:0/1933271059 shutdown_connections 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.819+0000 7f37760d6700 1 -- 172.21.15.179:0/1933271059 >> 172.21.15.179:0/1933271059 conn(0x7f3770072970 msgr2=0x7f3770072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:12.876 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.819+0000 7f37760d6700 1 -- 172.21.15.179:0/1933271059 shutdown_connections 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.819+0000 7f37760d6700 1 -- 172.21.15.179:0/1933271059 wait complete. 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.820+0000 7f37760d6700 1 Processor -- start 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.820+0000 7f37760d6700 1 -- start start 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f37760d6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004060 0x7f3770151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f37760d6700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3770152380 0x7f37701f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f37760d6700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37700d02f0 0x7f37700d0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f37760d6700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37700d0cc0 con 0x7f37700d02f0 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f37760d6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3770153490 con 0x7f375c004060 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f37760d6700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3770152880 con 0x7f3770152380 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37700d02f0 0x7f37700d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37700d02f0 0x7f37700d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40860/0 (socket says 172.21.15.179:40860) 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 -- 172.21.15.179:0/197457396 learned_addr learned my addr 172.21.15.179:0/197457396 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376effd700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3770152380 0x7f37701f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376f7fe700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004060 0x7f3770151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 -- 172.21.15.179:0/197457396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3770152380 msgr2=0x7f37701f35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3770152380 0x7f37701f35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 -- 172.21.15.179:0/197457396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004060 msgr2=0x7f3770151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004060 0x7f3770151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 -- 172.21.15.179:0/197457396 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3770152b60 con 0x7f37700d02f0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.821+0000 7f376ffff700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37700d02f0 0x7f37700d0780 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f37700cd810 tx=0x7f376800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.822+0000 7f3767fff700 1 -- 172.21.15.179:0/197457396 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768003c10 con 0x7f37700d02f0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.822+0000 7f3767fff700 1 -- 172.21.15.179:0/197457396 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3768003d90 con 0x7f37700d02f0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.822+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3770152e40 con 0x7f37700d02f0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.822+0000 7f3767fff700 1 -- 172.21.15.179:0/197457396 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376800dbd0 con 0x7f37700d02f0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.822+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37700b2510 con 0x7f37700d02f0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.823+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377004f290 con 0x7f37700d02f0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.823+0000 7f3767fff700 1 -- 172.21.15.179:0/197457396 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f376800dd30 con 0x7f37700d02f0 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.823+0000 7f3767fff700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f375006aed0 0x7f375006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:12.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.823+0000 7f3767fff700 1 -- 172.21.15.179:0/197457396 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3768089c50 con 0x7f37700d02f0 2023-12-07T00:15:12.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.823+0000 7f376f7fe700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f375006aed0 0x7f375006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:12.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.824+0000 7f376f7fe700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f375006aed0 0x7f375006d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3758009950 tx=0x7f3758008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:12.879 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:12.828+0000 7f3767fff700 1 -- 172.21.15.179:0/197457396 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3768054940 con 0x7f37700d02f0 2023-12-07T00:15:13.022 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.022+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37700685f0 con 0x7f37700d02f0 2023-12-07T00:15:13.023 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.023+0000 7f3767fff700 1 -- 172.21.15.179:0/197457396 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7f3768057f60 con 0x7f37700d02f0 2023-12-07T00:15:13.024 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:13.024 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f375006aed0 msgr2=0x7f375006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f375006aed0 0x7f375006d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3758009950 tx=0x7f3758008040 comp rx=0 tx=0).stop 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37700d02f0 msgr2=0x7f37700d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37700d02f0 0x7f37700d0780 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f37700cd810 tx=0x7f376800d430 comp rx=0 tx=0).stop 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 shutdown_connections 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f375006aed0 0x7f375006d390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f37700d02f0 0x7f37700d0780 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f375c004060 0x7f3770151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 --2- 172.21.15.179:0/197457396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3770152380 0x7f37701f35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.025+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 >> 172.21.15.179:0/197457396 conn(0x7f3770072970 msgr2=0x7f37701552b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.026+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 shutdown_connections 2023-12-07T00:15:13.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.026+0000 7f37760d6700 1 -- 172.21.15.179:0/197457396 wait complete. 2023-12-07T00:15:13.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:14:11.897021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:14:12.979971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-07T00:14:16.661445+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-07T00:15:13.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:15:13.162 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.161+0000 7f33a8ca5700 1 Processor -- start 2023-12-07T00:15:13.162 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.161+0000 7f33a8ca5700 1 -- start start 2023-12-07T00:15:13.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a8ca5700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f33a415ab70 0x7f33a4070880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a8ca5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a40adb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a8ca5700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a406f960 con 0x7f33a40ce770 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a8ca5700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a415af50 con 0x7f33a415ab70 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a8ca5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a406fc40 con 0x7f33a40d0ed0 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a259c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f33a415ab70 0x7f33a4070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a2d9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a40adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a1d9b700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f33a40ce770 0x7f33a40d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:54444/0 (socket says 172.21.15.179:54444) 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a259c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f33a415ab70 0x7f33a4070880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:43116/0 (socket says 172.21.15.179:43116) 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a2d9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a40adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41282/0 (socket says 172.21.15.179:41282) 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.162+0000 7f33a1d9b700 1 -- 172.21.15.179:0/3095530150 learned_addr learned my addr 172.21.15.179:0/3095530150 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.163+0000 7f33a259c700 1 -- 172.21.15.179:0/3095530150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 msgr2=0x7f33a40adb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.163+0000 7f33a259c700 1 --2- 172.21.15.179:0/3095530150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a40adb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.163+0000 7f33a259c700 1 -- 172.21.15.179:0/3095530150 >> v1:172.21.15.190:6789/0 conn(0x7f33a40ce770 legacy=0x7f33a40d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.165 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.163+0000 7f33a259c700 1 -- 172.21.15.179:0/3095530150 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a40cf110 con 0x7f33a415ab70 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.163+0000 7f33a259c700 1 --2- 172.21.15.179:0/3095530150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a415ab70 0x7f33a4070880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3398009840 tx=0x7f3398009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0147ac0a0d21b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.163+0000 7f33a159a700 1 -- 172.21.15.179:0/3095530150 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398011830 con 0x7f33a415ab70 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.163+0000 7f33a159a700 1 -- 172.21.15.179:0/3095530150 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3398011990 con 0x7f33a415ab70 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.163+0000 7f33a159a700 1 -- 172.21.15.179:0/3095530150 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398011d20 con 0x7f33a415ab70 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.164+0000 7f33a8ca5700 1 -- 172.21.15.179:0/3095530150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a415ab70 msgr2=0x7f33a4070880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.164+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/3095530150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a415ab70 0x7f33a4070880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3398009840 tx=0x7f3398009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.164+0000 7f33a8ca5700 1 -- 172.21.15.179:0/3095530150 shutdown_connections 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.164+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/3095530150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a40adb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.164+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/3095530150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a415ab70 0x7f33a4070880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.164+0000 7f33a8ca5700 1 -- 172.21.15.179:0/3095530150 >> 172.21.15.179:0/3095530150 conn(0x7f33a4099a40 msgr2=0x7f33a4099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.164+0000 7f33a8ca5700 1 -- 172.21.15.179:0/3095530150 shutdown_connections 2023-12-07T00:15:13.166 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.164+0000 7f33a8ca5700 1 -- 172.21.15.179:0/3095530150 wait complete. 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.165+0000 7f33a8ca5700 1 Processor -- start 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.165+0000 7f33a8ca5700 1 -- start start 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a8ca5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a40ce770 0x7f33a40b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a8ca5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a41f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a8ca5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a415ab70 0x7f33a4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a8ca5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40b4bb0 con 0x7f33a415ab70 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a8ca5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40b3f30 con 0x7f33a40ce770 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a8ca5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a40b4210 con 0x7f33a40d0ed0 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a415ab70 0x7f33a4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a415ab70 0x7f33a4155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40874/0 (socket says 172.21.15.179:40874) 2023-12-07T00:15:13.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 -- 172.21.15.179:0/1812430880 learned_addr learned my addr 172.21.15.179:0/1812430880 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a259c700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a40ce770 0x7f33a40b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a1d9b700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a41f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 -- 172.21.15.179:0/1812430880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 msgr2=0x7f33a41f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a41f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 -- 172.21.15.179:0/1812430880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a40ce770 msgr2=0x7f33a40b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a40ce770 0x7f33a40b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 -- 172.21.15.179:0/1812430880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980094a0 con 0x7f33a415ab70 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f33a2d9d700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a415ab70 0x7f33a4155b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f339c00efc0 tx=0x7f339c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.166+0000 7f3392ffd700 1 -- 172.21.15.179:0/1812430880 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c009ca0 con 0x7f33a415ab70 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.167+0000 7f3392ffd700 1 -- 172.21.15.179:0/1812430880 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c00f040 con 0x7f33a415ab70 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.167+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a40b44f0 con 0x7f33a415ab70 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.167+0000 7f3392ffd700 1 -- 172.21.15.179:0/1812430880 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c014480 con 0x7f33a415ab70 2023-12-07T00:15:13.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.167+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a41f5b20 con 0x7f33a415ab70 2023-12-07T00:15:13.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.167+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a40b4e20 con 0x7f33a415ab70 2023-12-07T00:15:13.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.168+0000 7f3392ffd700 1 -- 172.21.15.179:0/1812430880 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f339c0145e0 con 0x7f33a415ab70 2023-12-07T00:15:13.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.168+0000 7f3392ffd700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f338406aed0 0x7f338406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.168+0000 7f33a259c700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f338406aed0 0x7f338406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.168+0000 7f3392ffd700 1 -- 172.21.15.179:0/1812430880 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f339c08a5d0 con 0x7f33a415ab70 2023-12-07T00:15:13.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.169+0000 7f33a259c700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f338406aed0 0x7f338406d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3398000c00 tx=0x7f339801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.173+0000 7f3392ffd700 1 -- 172.21.15.179:0/1812430880 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f339c055350 con 0x7f33a415ab70 2023-12-07T00:15:13.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.362+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33a40685f0 con 0x7f33a415ab70 2023-12-07T00:15:13.362 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.362+0000 7f3392ffd700 1 -- 172.21.15.179:0/1812430880 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f339c058970 con 0x7f33a415ab70 2023-12-07T00:15:13.362 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:15:13.364 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f338406aed0 msgr2=0x7f338406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f338406aed0 0x7f338406d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3398000c00 tx=0x7f339801c040 comp rx=0 tx=0).stop 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a415ab70 msgr2=0x7f33a4155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a415ab70 0x7f33a4155b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f339c00efc0 tx=0x7f339c00c3a0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 shutdown_connections 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f338406aed0 0x7f338406d390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33a415ab70 0x7f33a4155b70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33a40ce770 0x7f33a40b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 --2- 172.21.15.179:0/1812430880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33a40d0ed0 0x7f33a41f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 >> 172.21.15.179:0/1812430880 conn(0x7f33a4099a40 msgr2=0x7f33a40c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 shutdown_connections 2023-12-07T00:15:13.365 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.364+0000 7f33a8ca5700 1 -- 172.21.15.179:0/1812430880 wait complete. 2023-12-07T00:15:13.377 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T00:15:13.500 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.500+0000 7f309e93d700 1 Processor -- start 2023-12-07T00:15:13.500 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.500+0000 7f309e93d700 1 -- start start 2023-12-07T00:15:13.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.500+0000 7f309e93d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f309806b980 0x7f309806be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.500+0000 7f309e93d700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309806f830 con 0x7f30980b3e20 2023-12-07T00:15:13.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.500+0000 7f309e93d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980703d0 con 0x7f309815e000 2023-12-07T00:15:13.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.500+0000 7f309e93d700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309806ed10 con 0x7f309806b980 2023-12-07T00:15:13.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f309ceda700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f309806b980 0x7f309806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.502 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f30977fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f30980b3e20 0x7f309806fcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47780/0 (socket says 172.21.15.179:47780) 2023-12-07T00:15:13.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f309ceda700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f309806b980 0x7f309806be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40882/0 (socket says 172.21.15.179:40882) 2023-12-07T00:15:13.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f30977fe700 1 -- 172.21.15.179:0/948350067 learned_addr learned my addr 172.21.15.179:0/948350067 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:13.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f309ceda700 1 -- 172.21.15.179:0/948350067 >> v1:172.21.15.190:6789/0 conn(0x7f309815e000 legacy=0x7f309806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:13.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f309ceda700 1 -- 172.21.15.179:0/948350067 >> v1:172.21.15.179:6789/0 conn(0x7f30980b3e20 legacy=0x7f309806fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f3096ffd700 1 -- 172.21.15.179:0/948350067 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158819601 0 0) 0x7f309806f830 con 0x7f30980b3e20 2023-12-07T00:15:13.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f309ceda700 1 -- 172.21.15.179:0/948350067 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309806ef00 con 0x7f309806b980 2023-12-07T00:15:13.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f309ceda700 1 --2- 172.21.15.179:0/948350067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309806b980 0x7f309806be10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3090009d90 tx=0x7f309000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396c0158dde9aced server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.503 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f3096ffd700 1 -- 172.21.15.179:0/948350067 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000e070 con 0x7f309806b980 2023-12-07T00:15:13.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f3096ffd700 1 -- 172.21.15.179:0/948350067 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000bb90 con 0x7f309806b980 2023-12-07T00:15:13.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.501+0000 7f3096ffd700 1 -- 172.21.15.179:0/948350067 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090003a20 con 0x7f309806b980 2023-12-07T00:15:13.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.502+0000 7f309e93d700 1 -- 172.21.15.179:0/948350067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309806b980 msgr2=0x7f309806be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.502+0000 7f309e93d700 1 --2- 172.21.15.179:0/948350067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309806b980 0x7f309806be10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3090009d90 tx=0x7f309000b330 comp rx=0 tx=0).stop 2023-12-07T00:15:13.506 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.502+0000 7f309e93d700 1 -- 172.21.15.179:0/948350067 shutdown_connections 2023-12-07T00:15:13.506 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.502+0000 7f309e93d700 1 --2- 172.21.15.179:0/948350067 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309806b980 0x7f309806be10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.506 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.502+0000 7f309e93d700 1 -- 172.21.15.179:0/948350067 >> 172.21.15.179:0/948350067 conn(0x7f30980b3270 msgr2=0x7f30980b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:13.506 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.502+0000 7f309e93d700 1 -- 172.21.15.179:0/948350067 shutdown_connections 2023-12-07T00:15:13.506 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.502+0000 7f309e93d700 1 -- 172.21.15.179:0/948350067 wait complete. 2023-12-07T00:15:13.508 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.503+0000 7f309e93d700 1 Processor -- start 2023-12-07T00:15:13.508 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.503+0000 7f309e93d700 1 -- start start 2023-12-07T00:15:13.508 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309e93d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f309806b980 0x7f30981581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.508 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309e93d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30980b3e20 0x7f309815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309e93d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309815e000 0x7f309815c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309e93d700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c8350 con 0x7f309815e000 2023-12-07T00:15:13.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309e93d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c77d0 con 0x7f30980b3e20 2023-12-07T00:15:13.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309e93d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c7ab0 con 0x7f309806b980 2023-12-07T00:15:13.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309815e000 0x7f309815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309815e000 0x7f309815c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40888/0 (socket says 172.21.15.179:40888) 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 -- 172.21.15.179:0/211810958 learned_addr learned my addr 172.21.15.179:0/211810958 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 -- 172.21.15.179:0/211810958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f309806b980 msgr2=0x7f30981581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f3097fff700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f309806b980 0x7f30981581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f30977fe700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30980b3e20 0x7f309815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f309806b980 0x7f30981581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 -- 172.21.15.179:0/211810958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30980b3e20 msgr2=0x7f309815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30980b3e20 0x7f309815c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 -- 172.21.15.179:0/211810958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090009a70 con 0x7f309815e000 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.504+0000 7f309ceda700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309815e000 0x7f309815c900 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f309000b730 tx=0x7f3090004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.505+0000 7f3094ff9700 1 -- 172.21.15.179:0/211810958 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090003a20 con 0x7f309815e000 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.505+0000 7f3094ff9700 1 -- 172.21.15.179:0/211810958 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090012860 con 0x7f309815e000 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.505+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980c7d90 con 0x7f309815e000 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.505+0000 7f3094ff9700 1 -- 172.21.15.179:0/211810958 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090012c10 con 0x7f309815e000 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.505+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3098158730 con 0x7f309815e000 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.505+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30980685f0 con 0x7f309815e000 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.506+0000 7f3094ff9700 1 -- 172.21.15.179:0/211810958 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f309002e420 con 0x7f309815e000 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.506+0000 7f3094ff9700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f308406aed0 0x7f308406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.507+0000 7f3094ff9700 1 -- 172.21.15.179:0/211810958 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f309008c3a0 con 0x7f309815e000 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.507+0000 7f3097fff700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f308406aed0 0x7f308406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.507+0000 7f3097fff700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f308406aed0 0x7f308406d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f308800a7d0 tx=0x7f3088008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.512 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.511+0000 7f3094ff9700 1 -- 172.21.15.179:0/211810958 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3090057200 con 0x7f309815e000 2023-12-07T00:15:13.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.704+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30980d0aa0 con 0x7f309815e000 2023-12-07T00:15:13.704 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.704+0000 7f3094ff9700 1 -- 172.21.15.179:0/211810958 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3090004930 con 0x7f309815e000 2023-12-07T00:15:13.704 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:13.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f308406aed0 msgr2=0x7f308406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f308406aed0 0x7f308406d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f308800a7d0 tx=0x7f3088008040 comp rx=0 tx=0).stop 2023-12-07T00:15:13.710 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309815e000 msgr2=0x7f309815c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309815e000 0x7f309815c900 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f309000b730 tx=0x7f3090004ad0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 shutdown_connections 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f308406aed0 0x7f308406d390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f309815e000 0x7f309815c900 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f309806b980 0x7f30981581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 --2- 172.21.15.179:0/211810958 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f30980b3e20 0x7f309815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.706+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 >> 172.21.15.179:0/211810958 conn(0x7f30980b3270 msgr2=0x7f309815b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.707+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 shutdown_connections 2023-12-07T00:15:13.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.707+0000 7f309e93d700 1 -- 172.21.15.179:0/211810958 wait complete. 2023-12-07T00:15:13.719 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T00:15:13.843 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.843+0000 7fa2dc0ed700 1 Processor -- start 2023-12-07T00:15:13.843 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.843+0000 7fa2dc0ed700 1 -- start start 2023-12-07T00:15:13.845 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2dc0ed700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415b970 0x7fa2d40cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.845 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2dc0ed700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2d406b680 0x7fa2d40cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.845 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2dc0ed700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d4160560 con 0x7fa2d415caa0 2023-12-07T00:15:13.845 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2dc0ed700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d415f9e0 con 0x7fa2d406b680 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2dc0ed700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d415fcc0 con 0x7fa2d415b970 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2da68a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2d406b680 0x7fa2d40cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2da68a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa2d406b680 0x7fa2d40cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40896/0 (socket says 172.21.15.179:40896) 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2da68a700 1 -- 172.21.15.179:0/3053531976 learned_addr learned my addr 172.21.15.179:0/3053531976 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2d9e89700 1 --2- 172.21.15.179:0/3053531976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415b970 0x7fa2d40cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2da68a700 1 -- 172.21.15.179:0/3053531976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415b970 msgr2=0x7fa2d40cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2da68a700 1 --2- 172.21.15.179:0/3053531976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415b970 0x7fa2d40cfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2da68a700 1 -- 172.21.15.179:0/3053531976 >> v1:172.21.15.190:6789/0 conn(0x7fa2d415caa0 legacy=0x7fa2d406af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2da68a700 1 -- 172.21.15.179:0/3053531976 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d415ffa0 con 0x7fa2d406b680 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2da68a700 1 --2- 172.21.15.179:0/3053531976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d406b680 0x7fa2d40cc7f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009e50 tx=0x7fa2cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58577b464d5fd58 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2d8e87700 1 -- 172.21.15.179:0/3053531976 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00e070 con 0x7fa2d406b680 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2d8e87700 1 -- 172.21.15.179:0/3053531976 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc00b9c0 con 0x7fa2d406b680 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.844+0000 7fa2d8e87700 1 -- 172.21.15.179:0/3053531976 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00bd70 con 0x7fa2d406b680 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.845+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/3053531976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d406b680 msgr2=0x7fa2d40cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.846 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.845+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/3053531976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d406b680 0x7fa2d40cc7f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009e50 tx=0x7fa2cc00b330 comp rx=0 tx=0).stop 2023-12-07T00:15:13.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.845+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/3053531976 shutdown_connections 2023-12-07T00:15:13.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.845+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/3053531976 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d406b680 0x7fa2d40cc7f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.845+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/3053531976 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415b970 0x7fa2d40cfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.845+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/3053531976 >> 172.21.15.179:0/3053531976 conn(0x7fa2d4099a40 msgr2=0x7fa2d4099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:13.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.845+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/3053531976 shutdown_connections 2023-12-07T00:15:13.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.845+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/3053531976 wait complete. 2023-12-07T00:15:13.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.846+0000 7fa2dc0ed700 1 Processor -- start 2023-12-07T00:15:13.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.846+0000 7fa2dc0ed700 1 -- start start 2023-12-07T00:15:13.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2dc0ed700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2d406b680 0x7fa2d4158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2dc0ed700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d415b970 0x7fa2d40aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2dc0ed700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415caa0 0x7fa2d4157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2dc0ed700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4157cf0 con 0x7fa2d415b970 2023-12-07T00:15:13.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2dc0ed700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d4157fd0 con 0x7fa2d406b680 2023-12-07T00:15:13.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2dc0ed700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d41582b0 con 0x7fa2d415caa0 2023-12-07T00:15:13.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9688700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d415b970 0x7fa2d40aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9688700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d415b970 0x7fa2d40aeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40900/0 (socket says 172.21.15.179:40900) 2023-12-07T00:15:13.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9688700 1 -- 172.21.15.179:0/2629028160 learned_addr learned my addr 172.21.15.179:0/2629028160 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:13.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2da68a700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415caa0 0x7fa2d4157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9e89700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2d406b680 0x7fa2d4158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9688700 1 -- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415caa0 msgr2=0x7fa2d4157270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.851 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9688700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415caa0 0x7fa2d4157270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9688700 1 -- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2d406b680 msgr2=0x7fa2d4158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9688700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2d406b680 0x7fa2d4158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2d9688700 1 -- 172.21.15.179:0/2629028160 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc009b30 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.847+0000 7fa2da68a700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415caa0 0x7fa2d4157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.848+0000 7fa2d9688700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d415b970 0x7fa2d40aeb70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400c4e0 tx=0x7fa2c400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.848+0000 7fa2ca7fc700 1 -- 172.21.15.179:0/2629028160 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40052d0 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.848+0000 7fa2ca7fc700 1 -- 172.21.15.179:0/2629028160 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4005430 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.848+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d4158590 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.848+0000 7fa2ca7fc700 1 -- 172.21.15.179:0/2629028160 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40038c0 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.848+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d40c57e0 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.849+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d40685f0 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.849+0000 7fa2ca7fc700 1 -- 172.21.15.179:0/2629028160 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2c4003a20 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.849+0000 7fa2ca7fc700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa2b806aed0 0x7fa2b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.849+0000 7fa2ca7fc700 1 -- 172.21.15.179:0/2629028160 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa2c4088e70 con 0x7fa2d415b970 2023-12-07T00:15:13.852 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.849+0000 7fa2d9e89700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa2b806aed0 0x7fa2b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:13.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.850+0000 7fa2d9e89700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa2b806aed0 0x7fa2b806d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40cd0d0 tx=0x7fa2d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:13.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:13.854+0000 7fa2ca7fc700 1 -- 172.21.15.179:0/2629028160 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa2c4053b60 con 0x7fa2d415b970 2023-12-07T00:15:14.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.042+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2d40b6a20 con 0x7fa2d415b970 2023-12-07T00:15:14.042 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.042+0000 7fa2ca7fc700 1 -- 172.21.15.179:0/2629028160 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa2c40170a0 con 0x7fa2d415b970 2023-12-07T00:15:14.042 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa2b806aed0 msgr2=0x7fa2b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa2b806aed0 0x7fa2b806d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40cd0d0 tx=0x7fa2d0008040 comp rx=0 tx=0).stop 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d415b970 msgr2=0x7fa2d40aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d415b970 0x7fa2d40aeb70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400c4e0 tx=0x7fa2c400c8a0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 shutdown_connections 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fa2b806aed0 0x7fa2b806d390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa2d415caa0 0x7fa2d4157270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa2d406b680 0x7fa2d4158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 --2- 172.21.15.179:0/2629028160 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa2d415b970 0x7fa2d40aeb70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.045 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 >> 172.21.15.179:0/2629028160 conn(0x7fa2d4099a40 msgr2=0x7fa2d40cc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:14.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 shutdown_connections 2023-12-07T00:15:14.046 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.044+0000 7fa2dc0ed700 1 -- 172.21.15.179:0/2629028160 wait complete. 2023-12-07T00:15:14.056 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-07T00:15:14.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.179+0000 7ff511a76700 1 Processor -- start 2023-12-07T00:15:14.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.179+0000 7ff511a76700 1 -- start start 2023-12-07T00:15:14.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.180+0000 7ff511a76700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.180+0000 7ff511a76700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff50c0c5620 0x7ff50c0ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.180+0000 7ff511a76700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50c0afc40 con 0x7ff50c15e1c0 2023-12-07T00:15:14.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.180+0000 7ff511a76700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c0c5ad0 con 0x7ff50c0c5620 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.180+0000 7ff511a76700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0ad2f0 con 0x7ff50c06e350 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff50c0c5620 0x7ff50c0ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50affd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50affd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41322/0 (socket says 172.21.15.179:41322) 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50b7fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ff50c15e1c0 0x7ff50c0af380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:54486/0 (socket says 172.21.15.179:54486) 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff50c0c5620 0x7ff50c0ae0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:43162/0 (socket says 172.21.15.179:43162) 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50affd700 1 -- 172.21.15.179:0/1382305031 learned_addr learned my addr 172.21.15.179:0/1382305031 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50a7fc700 1 -- 172.21.15.179:0/1382305031 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213137745 0 0) 0x7ff4f4001110 con 0x7ff50c15e1c0 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50a7fc700 1 -- 172.21.15.179:0/1382305031 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ec0035b0 con 0x7ff50c15e1c0 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50bfff700 1 -- 172.21.15.179:0/1382305031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 msgr2=0x7ff50c0c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50bfff700 1 --2- 172.21.15.179:0/1382305031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50bfff700 1 -- 172.21.15.179:0/1382305031 >> v1:172.21.15.190:6789/0 conn(0x7ff50c15e1c0 legacy=0x7ff50c0af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50bfff700 1 -- 172.21.15.179:0/1382305031 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c0ad5d0 con 0x7ff50c0c5620 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50affd700 1 --2- 172.21.15.179:0/1382305031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:14.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50bfff700 1 --2- 172.21.15.179:0/1382305031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c0c5620 0x7ff50c0ae0b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00bae0 tx=0x7ff4fc00bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1493a0037d8e6245 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50a7fc700 1 -- 172.21.15.179:0/1382305031 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00dc70 con 0x7ff50c0c5620 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50a7fc700 1 -- 172.21.15.179:0/1382305031 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00ddd0 con 0x7ff50c0c5620 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.181+0000 7ff50a7fc700 1 -- 172.21.15.179:0/1382305031 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc010670 con 0x7ff50c0c5620 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.182+0000 7ff511a76700 1 -- 172.21.15.179:0/1382305031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c0c5620 msgr2=0x7ff50c0ae0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.182+0000 7ff511a76700 1 --2- 172.21.15.179:0/1382305031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c0c5620 0x7ff50c0ae0b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00bae0 tx=0x7ff4fc00bdf0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.182+0000 7ff511a76700 1 -- 172.21.15.179:0/1382305031 shutdown_connections 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.182+0000 7ff511a76700 1 --2- 172.21.15.179:0/1382305031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c0c5620 0x7ff50c0ae0b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.182+0000 7ff511a76700 1 --2- 172.21.15.179:0/1382305031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.182+0000 7ff511a76700 1 -- 172.21.15.179:0/1382305031 >> 172.21.15.179:0/1382305031 conn(0x7ff50c0b3270 msgr2=0x7ff50c0b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.182+0000 7ff511a76700 1 -- 172.21.15.179:0/1382305031 shutdown_connections 2023-12-07T00:15:14.184 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.182+0000 7ff511a76700 1 -- 172.21.15.179:0/1382305031 wait complete. 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.183+0000 7ff511a76700 1 Processor -- start 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.183+0000 7ff511a76700 1 -- start start 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff511a76700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff511a76700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff50c0c5620 0x7ff50c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff511a76700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c15e1c0 0x7ff50c1f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff511a76700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c1f44f0 con 0x7ff50c0c5620 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff511a76700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c153350 con 0x7ff50c15e1c0 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff511a76700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c1f3970 con 0x7ff50c06e350 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff50affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff50c0c5620 0x7ff50c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff50affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff50c0c5620 0x7ff50c1504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40914/0 (socket says 172.21.15.179:40914) 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff50affd700 1 -- 172.21.15.179:0/1738086832 learned_addr learned my addr 172.21.15.179:0/1738086832 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff50b7fe700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.184+0000 7ff50bfff700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c15e1c0 0x7ff50c1f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.187 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff50affd700 1 -- 172.21.15.179:0/1738086832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 msgr2=0x7ff50c0b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff50affd700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff50affd700 1 -- 172.21.15.179:0/1738086832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c15e1c0 msgr2=0x7ff50c1f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff50affd700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c15e1c0 0x7ff50c1f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff50affd700 1 -- 172.21.15.179:0/1738086832 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504009b30 con 0x7ff50c0c5620 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff50affd700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff50c0c5620 0x7ff50c1504e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff50400efc0 tx=0x7ff50400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff503fff700 1 -- 172.21.15.179:0/1738086832 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400cb00 con 0x7ff50c0c5620 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc00b740 con 0x7ff50c0c5620 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff503fff700 1 -- 172.21.15.179:0/1738086832 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50400f040 con 0x7ff50c0c5620 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff503fff700 1 -- 172.21.15.179:0/1738086832 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50400cea0 con 0x7ff50c0c5620 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.185+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c15e720 con 0x7ff50c0c5620 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.186+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c0685f0 con 0x7ff50c0c5620 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.186+0000 7ff503fff700 1 -- 172.21.15.179:0/1738086832 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff504014480 con 0x7ff50c0c5620 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.187+0000 7ff503fff700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff4f006aed0 0x7ff4f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.187+0000 7ff503fff700 1 -- 172.21.15.179:0/1738086832 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff504089f40 con 0x7ff50c0c5620 2023-12-07T00:15:14.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.187+0000 7ff50b7fe700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff4f006aed0 0x7ff4f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.187+0000 7ff50b7fe700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff4f006aed0 0x7ff4f006d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff50c15a100 tx=0x7ff4f4000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.191+0000 7ff503fff700 1 -- 172.21.15.179:0/1738086832 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff504054c40 con 0x7ff50c0c5620 2023-12-07T00:15:14.381 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.381+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff50c0b1450 con 0x7ff50c0c5620 2023-12-07T00:15:14.382 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.381+0000 7ff503fff700 1 -- 172.21.15.179:0/1738086832 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff504075e60 con 0x7ff50c0c5620 2023-12-07T00:15:14.382 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff4f006aed0 msgr2=0x7ff4f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff4f006aed0 0x7ff4f006d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff50c15a100 tx=0x7ff4f4000bc0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff50c0c5620 msgr2=0x7ff50c1504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff50c0c5620 0x7ff50c1504e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff50400efc0 tx=0x7ff50400c3a0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 shutdown_connections 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7ff4f006aed0 0x7ff4f006d390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff50c15e1c0 0x7ff50c1f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff50c06e350 0x7ff50c0b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 --2- 172.21.15.179:0/1738086832 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff50c0c5620 0x7ff50c1504e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 >> 172.21.15.179:0/1738086832 conn(0x7ff50c0b3270 msgr2=0x7ff50c14fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:14.384 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 shutdown_connections 2023-12-07T00:15:14.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.383+0000 7ff511a76700 1 -- 172.21.15.179:0/1738086832 wait complete. 2023-12-07T00:15:14.396 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:15:14.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.515+0000 7f162a20f700 1 Processor -- start 2023-12-07T00:15:14.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.515+0000 7f162a20f700 1 -- start start 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f162a20f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f162415bde0 0x7f16240d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f162a20f700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162409ab50 con 0x7f16240cd020 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f162a20f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16240cf630 con 0x7f162409a310 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f162a20f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16240cf8f0 con 0x7f162415bde0 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f1622ffd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f16240cd020 0x7f1624099c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47822/0 (socket says 172.21.15.179:47822) 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f1622ffd700 1 -- 172.21.15.179:0/3612344973 learned_addr learned my addr 172.21.15.179:0/3612344973 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f16237fe700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f162415bde0 0x7f16240d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149881516 0 0) 0x7f162409ab50 con 0x7f16240cd020 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.516+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16100035b0 con 0x7f16240cd020 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2320729717 0 0) 0x7f16100035b0 con 0x7f16240cd020 2023-12-07T00:15:14.519 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f162415bde0 msgr2=0x7f16240d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f162415bde0 0x7f16240d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 >> v1:172.21.15.190:6789/0 conn(0x7f162409a310 legacy=0x7f16240b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240cfbd0 con 0x7f16240cd020 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f1614001670 con 0x7f16240cd020 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 >> v1:172.21.15.179:6789/0 conn(0x7f16240cd020 legacy=0x7f1624099c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f1610003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1610004850 0x7f1610004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f162415bde0 0x7f1610005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240cf8f0 con 0x7f1610003a30 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161000bac0 con 0x7f1610004850 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161000bc80 con 0x7f162415bde0 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16237fe700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f1610003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.520 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f1622ffd700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1610004850 0x7f1610004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f1623fff700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f162415bde0 0x7f1610005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16237fe700 1 -- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f162415bde0 msgr2=0x7f1610005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16237fe700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f162415bde0 0x7f1610005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16237fe700 1 -- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1610004850 msgr2=0x7f1610004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16237fe700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1610004850 0x7f1610004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16237fe700 1 -- 172.21.15.179:0/3612344973 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100035b0 con 0x7f1610003a30 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16237fe700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f1610003e50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f160c009b30 tx=0x7f1610005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d23dc20e6043cbc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00e6c0 con 0x7f1610003a30 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c00e820 con 0x7f1610003a30 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.517+0000 7f16227fc700 1 -- 172.21.15.179:0/3612344973 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00eb90 con 0x7f1610003a30 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.518+0000 7f162a20f700 1 -- 172.21.15.179:0/3612344973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 msgr2=0x7f1610003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.518+0000 7f162a20f700 1 --2- 172.21.15.179:0/3612344973 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f1610003e50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f160c009b30 tx=0x7f1610005880 comp rx=0 tx=0).stop 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.518+0000 7f1623fff700 1 -- 172.21.15.179:0/3612344973 reap_dead start 2023-12-07T00:15:14.521 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.518+0000 7f162a20f700 1 -- 172.21.15.179:0/3612344973 shutdown_connections 2023-12-07T00:15:14.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.518+0000 7f162a20f700 1 -- 172.21.15.179:0/3612344973 >> 172.21.15.179:0/3612344973 conn(0x7f16240b3550 msgr2=0x7f16240b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:14.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.518+0000 7f162a20f700 1 -- 172.21.15.179:0/3612344973 shutdown_connections 2023-12-07T00:15:14.522 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.518+0000 7f162a20f700 1 -- 172.21.15.179:0/3612344973 wait complete. 2023-12-07T00:15:14.526 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.519+0000 7f162a20f700 1 Processor -- start 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.520+0000 7f162a20f700 1 -- start start 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f162a20f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f162414f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f162a20f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1624150a50 0x7f16240c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f162a20f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16240af730 0x7f16240afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f162a20f700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1624153ca0 con 0x7f1610003a30 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f162a20f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240b00f0 con 0x7f1624150a50 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f162a20f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1624150ed0 con 0x7f16240af730 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f162414f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f162414f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40932/0 (socket says 172.21.15.179:40932) 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 -- 172.21.15.179:0/388377398 learned_addr learned my addr 172.21.15.179:0/388377398 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f1622ffd700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1624150a50 0x7f16240c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f1623fff700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16240af730 0x7f16240afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 -- 172.21.15.179:0/388377398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16240af730 msgr2=0x7f16240afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.527 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16240af730 0x7f16240afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 -- 172.21.15.179:0/388377398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1624150a50 msgr2=0x7f16240c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1624150a50 0x7f16240c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 -- 172.21.15.179:0/388377398 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240b4820 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f16237fe700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f162414f860 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f16100047b0 tx=0x7f160c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f161bfff700 1 -- 172.21.15.179:0/388377398 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c00e6c0 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f161bfff700 1 -- 172.21.15.179:0/388377398 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160c003ad0 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16240b4ac0 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f161bfff700 1 -- 172.21.15.179:0/388377398 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160c003e80 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.521+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16240b5080 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.522+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16240c8d60 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.523+0000 7f161bfff700 1 -- 172.21.15.179:0/388377398 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f160c013470 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.523+0000 7f161bfff700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406aed0 0x7f160406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.523+0000 7f1622ffd700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406aed0 0x7f160406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.523+0000 7f161bfff700 1 -- 172.21.15.179:0/388377398 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f160c08b170 con 0x7f1610003a30 2023-12-07T00:15:14.528 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.524+0000 7f1622ffd700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406aed0 0x7f160406d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16240b54c0 tx=0x7f1614001b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.528+0000 7f161bfff700 1 -- 172.21.15.179:0/388377398 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f160c055ef0 con 0x7f1610003a30 2023-12-07T00:15:14.767 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.767+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16240b5210 con 0x7f1610003a30 2023-12-07T00:15:14.768 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.768+0000 7f161bfff700 1 -- 172.21.15.179:0/388377398 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7f160c059510 con 0x7f1610003a30 2023-12-07T00:15:14.768 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:14.768 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:31.106814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T00:15:14.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406aed0 msgr2=0x7f160406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406aed0 0x7f160406d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16240b54c0 tx=0x7f1614001b20 comp rx=0 tx=0).stop 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 msgr2=0x7f162414f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f162414f860 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f16100047b0 tx=0x7f160c0047c0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 shutdown_connections 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f160406aed0 0x7f160406d390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16240af730 0x7f16240afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1610003a30 0x7f162414f860 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 --2- 172.21.15.179:0/388377398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1624150a50 0x7f16240c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 >> 172.21.15.179:0/388377398 conn(0x7f16240b3550 msgr2=0x7f16240b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 shutdown_connections 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.770+0000 7f162a20f700 1 -- 172.21.15.179:0/388377398 wait complete. 2023-12-07T00:15:14.771 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 9 2023-12-07T00:15:14.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:14.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.902+0000 7fd51e186700 1 Processor -- start 2023-12-07T00:15:14.903 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd51e186700 1 -- start start 2023-12-07T00:15:14.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd51e186700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 0x7fd518160250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.906 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd51e186700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd51815c090 0x7fd51815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd51e186700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51806f890 con 0x7fd518155ff0 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd51e186700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51815fdc0 con 0x7fd51815c090 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd51e186700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51815cd30 con 0x7fd5180ce460 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd517fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd51815c090 0x7fd51815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd517fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd51815c090 0x7fd51815c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40944/0 (socket says 172.21.15.179:40944) 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd517fff700 1 -- 172.21.15.179:0/3358824762 learned_addr learned my addr 172.21.15.179:0/3358824762 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.903+0000 7fd5177fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd518155ff0 0x7fd5180cdd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47842/0 (socket says 172.21.15.179:47842) 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd516ffd700 1 --2- 172.21.15.179:0/3358824762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 0x7fd518160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd517fff700 1 -- 172.21.15.179:0/3358824762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 msgr2=0x7fd518160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd5167fc700 1 -- 172.21.15.179:0/3358824762 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595637788 0 0) 0x7fd51806f890 con 0x7fd518155ff0 2023-12-07T00:15:14.907 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd517fff700 1 --2- 172.21.15.179:0/3358824762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 0x7fd518160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd517fff700 1 -- 172.21.15.179:0/3358824762 >> v1:172.21.15.179:6789/0 conn(0x7fd518155ff0 legacy=0x7fd5180cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd517fff700 1 -- 172.21.15.179:0/3358824762 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51815d010 con 0x7fd51815c090 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd517fff700 1 --2- 172.21.15.179:0/3358824762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd51815c4e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd510009e50 tx=0x7fd51000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbde952134bbbfe server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd5167fc700 1 -- 172.21.15.179:0/3358824762 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000e070 con 0x7fd51815c090 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd5167fc700 1 -- 172.21.15.179:0/3358824762 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51000b9c0 con 0x7fd51815c090 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.904+0000 7fd5167fc700 1 -- 172.21.15.179:0/3358824762 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51000bd70 con 0x7fd51815c090 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.905+0000 7fd51e186700 1 -- 172.21.15.179:0/3358824762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 msgr2=0x7fd51815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.905+0000 7fd51e186700 1 --2- 172.21.15.179:0/3358824762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd51815c4e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd510009e50 tx=0x7fd51000b330 comp rx=0 tx=0).stop 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.905+0000 7fd51e186700 1 -- 172.21.15.179:0/3358824762 shutdown_connections 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.905+0000 7fd51e186700 1 --2- 172.21.15.179:0/3358824762 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd51815c4e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.905+0000 7fd51e186700 1 --2- 172.21.15.179:0/3358824762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 0x7fd518160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.905+0000 7fd51e186700 1 -- 172.21.15.179:0/3358824762 >> 172.21.15.179:0/3358824762 conn(0x7fd518072970 msgr2=0x7fd518072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.905+0000 7fd51e186700 1 -- 172.21.15.179:0/3358824762 shutdown_connections 2023-12-07T00:15:14.908 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.905+0000 7fd51e186700 1 -- 172.21.15.179:0/3358824762 wait complete. 2023-12-07T00:15:14.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.906+0000 7fd51e186700 1 Processor -- start 2023-12-07T00:15:14.909 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.906+0000 7fd51e186700 1 -- start start 2023-12-07T00:15:14.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd51e186700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 0x7fd518158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.911 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd51e186700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd518155ff0 0x7fd5181eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd51e186700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd5180c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd51e186700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181f2720 con 0x7fd51815c090 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd51e186700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180c67b0 con 0x7fd518155ff0 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd51e186700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd518158760 con 0x7fd5180ce460 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd5180c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd5180c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40950/0 (socket says 172.21.15.179:40950) 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 -- 172.21.15.179:0/2525456347 learned_addr learned my addr 172.21.15.179:0/2525456347 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd5177fe700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 0x7fd518158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd516ffd700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd518155ff0 0x7fd5181eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 -- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 msgr2=0x7fd518158180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 0x7fd518158180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 -- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd518155ff0 msgr2=0x7fd5181eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd518155ff0 0x7fd5181eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:14.912 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 -- 172.21.15.179:0/2525456347 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510009b30 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd516ffd700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd518155ff0 0x7fd5181eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd517fff700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd5180c6270 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd51000b730 tx=0x7fd510004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.907+0000 7fd50ffff700 1 -- 172.21.15.179:0/2525456347 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510003ea0 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.908+0000 7fd50ffff700 1 -- 172.21.15.179:0/2525456347 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5100092e0 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.908+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd518158a40 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.908+0000 7fd50ffff700 1 -- 172.21.15.179:0/2525456347 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51001c660 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.908+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd518159000 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.908+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51804f290 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.909+0000 7fd50ffff700 1 -- 172.21.15.179:0/2525456347 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd51001c7c0 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.909+0000 7fd50ffff700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd4f806aed0 0x7fd4f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.909+0000 7fd50ffff700 1 -- 172.21.15.179:0/2525456347 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd51008b760 con 0x7fd51815c090 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.909+0000 7fd5177fe700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd4f806aed0 0x7fd4f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:14.913 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.910+0000 7fd5177fe700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd4f806aed0 0x7fd4f806d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd500000f60 tx=0x7fd500007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:14.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:14.914+0000 7fd50ffff700 1 -- 172.21.15.179:0/2525456347 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5100564e0 con 0x7fd51815c090 2023-12-07T00:15:15.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.109+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5181f2860 con 0x7fd51815c090 2023-12-07T00:15:15.110 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.110+0000 7fd50ffff700 1 -- 172.21.15.179:0/2525456347 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7fd510059b00 con 0x7fd51815c090 2023-12-07T00:15:15.111 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:15.111 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd4f806aed0 msgr2=0x7fd4f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd4f806aed0 0x7fd4f806d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd500000f60 tx=0x7fd500007c90 comp rx=0 tx=0).stop 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 msgr2=0x7fd5180c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd5180c6270 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd51000b730 tx=0x7fd510004ad0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 shutdown_connections 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd4f806aed0 0x7fd4f806d390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd51815c090 0x7fd5180c6270 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd5180ce460 0x7fd518158180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 --2- 172.21.15.179:0/2525456347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd518155ff0 0x7fd5181eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.112+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 >> 172.21.15.179:0/2525456347 conn(0x7fd518072970 msgr2=0x7fd51815d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:15.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.113+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 shutdown_connections 2023-12-07T00:15:15.114 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.113+0000 7fd51e186700 1 -- 172.21.15.179:0/2525456347 wait complete. 2023-12-07T00:15:15.125 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-07T00:15:15.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:15:15.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.245+0000 7fc416244700 1 Processor -- start 2023-12-07T00:15:15.246 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.245+0000 7fc416244700 1 -- start start 2023-12-07T00:15:15.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.246+0000 7fc416244700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015de40 0x7fc4100b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.246+0000 7fc416244700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc41015e220 0x7fc4100b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.247 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.246+0000 7fc416244700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41015f330 con 0x7fc4100b4c20 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.246+0000 7fc416244700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100d1820 con 0x7fc41015e220 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.246+0000 7fc416244700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41015e720 con 0x7fc41015de40 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40f7fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015de40 0x7fc4100b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40effd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc41015e220 0x7fc4100b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40f7fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015de40 0x7fc4100b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41368/0 (socket says 172.21.15.179:41368) 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40f7fe700 1 -- 172.21.15.179:0/933282034 learned_addr learned my addr 172.21.15.179:0/933282034 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40f7fe700 1 -- 172.21.15.179:0/933282034 >> v2:172.21.15.190:3300/0 conn(0x7fc41015e220 msgr2=0x7fc4100b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40f7fe700 1 --2- 172.21.15.179:0/933282034 >> v2:172.21.15.190:3300/0 conn(0x7fc41015e220 0x7fc4100b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40f7fe700 1 -- 172.21.15.179:0/933282034 >> v1:172.21.15.190:6789/0 conn(0x7fc4100b4c20 legacy=0x7fc41006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40e7fc700 1 -- 172.21.15.179:0/933282034 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684970570 0 0) 0x7fc41015f330 con 0x7fc4100b4c20 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40f7fe700 1 -- 172.21.15.179:0/933282034 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41015ea00 con 0x7fc41015de40 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40f7fe700 1 --2- 172.21.15.179:0/933282034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015de40 0x7fc4100b46e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc4000098f0 tx=0x7fc400009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3970e6f360d21b1b server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40e7fc700 1 -- 172.21.15.179:0/933282034 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400011830 con 0x7fc41015de40 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40e7fc700 1 -- 172.21.15.179:0/933282034 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc400011990 con 0x7fc41015de40 2023-12-07T00:15:15.248 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.247+0000 7fc40e7fc700 1 -- 172.21.15.179:0/933282034 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400011d20 con 0x7fc41015de40 2023-12-07T00:15:15.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.248+0000 7fc416244700 1 -- 172.21.15.179:0/933282034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015de40 msgr2=0x7fc4100b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.249 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.248+0000 7fc416244700 1 --2- 172.21.15.179:0/933282034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015de40 0x7fc4100b46e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc4000098f0 tx=0x7fc400009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:15.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.248+0000 7fc416244700 1 -- 172.21.15.179:0/933282034 shutdown_connections 2023-12-07T00:15:15.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.248+0000 7fc416244700 1 --2- 172.21.15.179:0/933282034 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015de40 0x7fc4100b46e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.248+0000 7fc416244700 1 --2- 172.21.15.179:0/933282034 >> v2:172.21.15.190:3300/0 conn(0x7fc41015e220 0x7fc4100b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.248+0000 7fc416244700 1 -- 172.21.15.179:0/933282034 >> 172.21.15.179:0/933282034 conn(0x7fc410072970 msgr2=0x7fc410072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:15.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.248+0000 7fc416244700 1 -- 172.21.15.179:0/933282034 shutdown_connections 2023-12-07T00:15:15.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.248+0000 7fc416244700 1 -- 172.21.15.179:0/933282034 wait complete. 2023-12-07T00:15:15.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.249+0000 7fc416244700 1 Processor -- start 2023-12-07T00:15:15.250 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.249+0000 7fc416244700 1 -- start start 2023-12-07T00:15:15.252 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc416244700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4100b4c20 0x7fc410156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.253 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc416244700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc41015de40 0x7fc4101431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.253 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc416244700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015e220 0x7fc4101e7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.253 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc416244700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4101e7320 con 0x7fc4100b4c20 2023-12-07T00:15:15.253 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc416244700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4101570d0 con 0x7fc41015de40 2023-12-07T00:15:15.253 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc416244700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100ce590 con 0x7fc41015e220 2023-12-07T00:15:15.253 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4100b4c20 0x7fc410156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.253 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40f7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4100b4c20 0x7fc410156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40960/0 (socket says 172.21.15.179:40960) 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40f7fe700 1 -- 172.21.15.179:0/4112550831 learned_addr learned my addr 172.21.15.179:0/4112550831 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40ffff700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015e220 0x7fc4101e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40effd700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc41015de40 0x7fc4101431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40f7fe700 1 -- 172.21.15.179:0/4112550831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015e220 msgr2=0x7fc4101e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40f7fe700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015e220 0x7fc4101e7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40f7fe700 1 -- 172.21.15.179:0/4112550831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc41015de40 msgr2=0x7fc4101431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40f7fe700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc41015de40 0x7fc4101431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.250+0000 7fc40f7fe700 1 -- 172.21.15.179:0/4112550831 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400009550 con 0x7fc4100b4c20 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.251+0000 7fc40f7fe700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4100b4c20 0x7fc410156b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc400009c40 tx=0x7fc400004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.251+0000 7fc3f7fff700 1 -- 172.21.15.179:0/4112550831 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400004300 con 0x7fc4100b4c20 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.251+0000 7fc3f7fff700 1 -- 172.21.15.179:0/4112550831 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40001f070 con 0x7fc4100b4c20 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.251+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4100ce870 con 0x7fc4100b4c20 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.251+0000 7fc3f7fff700 1 -- 172.21.15.179:0/4112550831 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4000036a0 con 0x7fc4100b4c20 2023-12-07T00:15:15.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.251+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4100cee30 con 0x7fc4100b4c20 2023-12-07T00:15:15.255 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.252+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41004f290 con 0x7fc4100b4c20 2023-12-07T00:15:15.255 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.252+0000 7fc3f7fff700 1 -- 172.21.15.179:0/4112550831 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc400021030 con 0x7fc4100b4c20 2023-12-07T00:15:15.255 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.253+0000 7fc3f7fff700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc3fc06aed0 0x7fc3fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.255 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.253+0000 7fc3f7fff700 1 -- 172.21.15.179:0/4112550831 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc40008adc0 con 0x7fc4100b4c20 2023-12-07T00:15:15.255 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.253+0000 7fc40effd700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc3fc06aed0 0x7fc3fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.255 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.253+0000 7fc40effd700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc3fc06aed0 0x7fc3fc06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc4101527c0 tx=0x7fc4040091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:15.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.258+0000 7fc3f7fff700 1 -- 172.21.15.179:0/4112550831 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc400055ac0 con 0x7fc4100b4c20 2023-12-07T00:15:15.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.490+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4100cefc0 con 0x7fc4100b4c20 2023-12-07T00:15:15.491 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.491+0000 7fc3f7fff700 1 -- 172.21.15.179:0/4112550831 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fc4000590e0 con 0x7fc4100b4c20 2023-12-07T00:15:15.491 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:15.491 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:31.106814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T00:15:15.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc3fc06aed0 msgr2=0x7fc3fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc3fc06aed0 0x7fc3fc06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc4101527c0 tx=0x7fc4040091c0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4100b4c20 msgr2=0x7fc410156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4100b4c20 0x7fc410156b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc400009c40 tx=0x7fc400004750 comp rx=0 tx=0).stop 2023-12-07T00:15:15.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 shutdown_connections 2023-12-07T00:15:15.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc3fc06aed0 0x7fc3fc06d390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.494 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc41015e220 0x7fc4101e7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc4100b4c20 0x7fc410156b90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 --2- 172.21.15.179:0/4112550831 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc41015de40 0x7fc4101431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 >> 172.21.15.179:0/4112550831 conn(0x7fc410072970 msgr2=0x7fc4100c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:15.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 shutdown_connections 2023-12-07T00:15:15.495 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.493+0000 7fc416244700 1 -- 172.21.15.179:0/4112550831 wait complete. 2023-12-07T00:15:15.495 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 9 2023-12-07T00:15:15.505 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:15:15.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.626+0000 7fec1617a700 1 Processor -- start 2023-12-07T00:15:15.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.626+0000 7fec1617a700 1 -- start start 2023-12-07T00:15:15.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.626+0000 7fec1617a700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec1015de40 0x7fec100b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.626+0000 7fec1617a700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1015f330 con 0x7fec100b2c70 2023-12-07T00:15:15.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.626+0000 7fec1617a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1015e720 con 0x7fec1015e220 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.626+0000 7fec1617a700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100d1820 con 0x7fec1015de40 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0f7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec1015de40 0x7fec100b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0ffff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fec100b2c70 0x7fec1015f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47874/0 (socket says 172.21.15.179:47874) 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0f7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fec1015de40 0x7fec100b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40968/0 (socket says 172.21.15.179:40968) 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0ffff700 1 -- 172.21.15.179:0/3323303335 learned_addr learned my addr 172.21.15.179:0/3323303335 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0f7fe700 1 -- 172.21.15.179:0/3323303335 >> v1:172.21.15.190:6789/0 conn(0x7fec1015e220 legacy=0x7fec100b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0f7fe700 1 -- 172.21.15.179:0/3323303335 >> v1:172.21.15.179:6789/0 conn(0x7fec100b2c70 legacy=0x7fec1015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0f7fe700 1 -- 172.21.15.179:0/3323303335 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1015ea00 con 0x7fec1015de40 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0e7fc700 1 -- 172.21.15.179:0/3323303335 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542231226 0 0) 0x7fec1015f330 con 0x7fec100b2c70 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0f7fe700 1 --2- 172.21.15.179:0/3323303335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015de40 0x7fec100b46e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fec00009840 tx=0x7fec00009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25374b938da8fc9c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0e7fc700 1 -- 172.21.15.179:0/3323303335 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011830 con 0x7fec1015de40 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0e7fc700 1 -- 172.21.15.179:0/3323303335 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec00011990 con 0x7fec1015de40 2023-12-07T00:15:15.629 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.627+0000 7fec0e7fc700 1 -- 172.21.15.179:0/3323303335 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec00011d20 con 0x7fec1015de40 2023-12-07T00:15:15.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.628+0000 7fec1617a700 1 -- 172.21.15.179:0/3323303335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015de40 msgr2=0x7fec100b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.628+0000 7fec1617a700 1 --2- 172.21.15.179:0/3323303335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015de40 0x7fec100b46e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fec00009840 tx=0x7fec00009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:15.630 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.628+0000 7fec1617a700 1 -- 172.21.15.179:0/3323303335 shutdown_connections 2023-12-07T00:15:15.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.628+0000 7fec1617a700 1 --2- 172.21.15.179:0/3323303335 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015de40 0x7fec100b46e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.628+0000 7fec1617a700 1 -- 172.21.15.179:0/3323303335 >> 172.21.15.179:0/3323303335 conn(0x7fec10072970 msgr2=0x7fec10072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.628+0000 7fec1617a700 1 -- 172.21.15.179:0/3323303335 shutdown_connections 2023-12-07T00:15:15.632 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.628+0000 7fec1617a700 1 -- 172.21.15.179:0/3323303335 wait complete. 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.629+0000 7fec1617a700 1 Processor -- start 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.629+0000 7fec1617a700 1 -- start start 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec1617a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec100b2c70 0x7fec100af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec1617a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec1015de40 0x7fec100cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec1617a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015e220 0x7fec100cc510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec1617a700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec10159380 con 0x7fec1015e220 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec1617a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1015a390 con 0x7fec1015de40 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec1617a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec101595d0 con 0x7fec100b2c70 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015e220 0x7fec100cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015e220 0x7fec100cc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40978/0 (socket says 172.21.15.179:40978) 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 -- 172.21.15.179:0/1322912068 learned_addr learned my addr 172.21.15.179:0/1322912068 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:15.635 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0f7fe700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec100b2c70 0x7fec100af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0effd700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec1015de40 0x7fec100cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 -- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec100b2c70 msgr2=0x7fec100af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec100b2c70 0x7fec100af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 -- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec1015de40 msgr2=0x7fec100cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec1015de40 0x7fec100cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 -- 172.21.15.179:0/1322912068 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000094a0 con 0x7fec1015e220 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0f7fe700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec100b2c70 0x7fec100af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec0ffff700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015e220 0x7fec100cc510 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fec0800cc10 tx=0x7fec0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec07fff700 1 -- 172.21.15.179:0/1322912068 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800abb0 con 0x7fec1015e220 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.630+0000 7fec07fff700 1 -- 172.21.15.179:0/1322912068 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800ad10 con 0x7fec1015e220 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.631+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec101598b0 con 0x7fec1015e220 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.631+0000 7fec07fff700 1 -- 172.21.15.179:0/1322912068 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08007310 con 0x7fec1015e220 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.631+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec10159e70 con 0x7fec1015e220 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.631+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1004f290 con 0x7fec1015e220 2023-12-07T00:15:15.636 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.632+0000 7fec07fff700 1 -- 172.21.15.179:0/1322912068 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fec08007470 con 0x7fec1015e220 2023-12-07T00:15:15.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.632+0000 7fec07fff700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febf006aed0 0x7febf006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:15.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.632+0000 7fec0f7fe700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febf006aed0 0x7febf006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:15.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.632+0000 7fec07fff700 1 -- 172.21.15.179:0/1322912068 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec08089800 con 0x7fec1015e220 2023-12-07T00:15:15.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.633+0000 7fec0f7fe700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febf006aed0 0x7febf006d390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec1015cbb0 tx=0x7fec00008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:15.637 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.637+0000 7fec07fff700 1 -- 172.21.15.179:0/1322912068 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fec080544f0 con 0x7fec1015e220 2023-12-07T00:15:15.871 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.871+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec1015a060 con 0x7fec1015e220 2023-12-07T00:15:15.871 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.871+0000 7fec07fff700 1 -- 172.21.15.179:0/1322912068 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4921 (secure 0 0 0) 0x7fec08018090 con 0x7fec1015e220 2023-12-07T00:15:15.871 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:15.872 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/2539054622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":2539054622},{"type":"v1","addr":"172.21.15.179:6835","nonce":2539054622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3928170004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3928170004},{"type":"v1","addr":"172.21.15.190:6834","nonce":3928170004}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/2959081747","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":2959081747},{"type":"v1","addr":"172.21.15.190:6835","nonce":2959081747}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:14:14.021089+0000","modified":"2023-12-07T00:14:31.106814+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/4041424409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":4041424409},{"type":"v1","addr":"172.21.15.179:6837","nonce":4041424409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febf006aed0 msgr2=0x7febf006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febf006aed0 0x7febf006d390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec1015cbb0 tx=0x7fec00008030 comp rx=0 tx=0).stop 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015e220 msgr2=0x7fec100cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015e220 0x7fec100cc510 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fec0800cc10 tx=0x7fec0800a060 comp rx=0 tx=0).stop 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 shutdown_connections 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7febf006aed0 0x7febf006d390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fec1015e220 0x7fec100cc510 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fec100b2c70 0x7fec100af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 --2- 172.21.15.179:0/1322912068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fec1015de40 0x7fec100cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:15.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.873+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 >> 172.21.15.179:0/1322912068 conn(0x7fec10072970 msgr2=0x7fec1015d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:15.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.874+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 shutdown_connections 2023-12-07T00:15:15.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:15.874+0000 7fec1617a700 1 -- 172.21.15.179:0/1322912068 wait complete. 2023-12-07T00:15:15.875 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 9 2023-12-07T00:15:15.886 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:16.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.006+0000 7fb3613cd700 1 Processor -- start 2023-12-07T00:15:16.007 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.006+0000 7fb3613cd700 1 -- start start 2023-12-07T00:15:16.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb3613cd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb35c06d9d0 0x7fb35c099c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb3613cd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb35c0cddb0 0x7fb35c09a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb3613cd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 0x7fb35c0d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb3613cd700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0cd920 con 0x7fb35c06d9d0 2023-12-07T00:15:16.009 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb3613cd700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35c0d0e20 con 0x7fb35c0cddb0 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb3613cd700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0ccd10 con 0x7fb35c0d0490 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb35affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb35c06d9d0 0x7fb35c099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb35affd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fb35c06d9d0 0x7fb35c099c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40982/0 (socket says 172.21.15.179:40982) 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.007+0000 7fb35affd700 1 -- 172.21.15.179:0/1882313781 learned_addr learned my addr 172.21.15.179:0/1882313781 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb35affd700 1 -- 172.21.15.179:0/1882313781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 msgr2=0x7fb35c0d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb35b7fe700 1 --2- 172.21.15.179:0/1882313781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 0x7fb35c0d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb35a7fc700 1 --2- 172.21.15.179:0/1882313781 >> v2:172.21.15.190:3300/0 conn(0x7fb35c0cddb0 0x7fb35c09a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb35affd700 1 --2- 172.21.15.179:0/1882313781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 0x7fb35c0d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb35affd700 1 -- 172.21.15.179:0/1882313781 >> v2:172.21.15.190:3300/0 conn(0x7fb35c0cddb0 msgr2=0x7fb35c09a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb35affd700 1 --2- 172.21.15.179:0/1882313781 >> v2:172.21.15.190:3300/0 conn(0x7fb35c0cddb0 0x7fb35c09a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb35affd700 1 -- 172.21.15.179:0/1882313781 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c0ccff0 con 0x7fb35c06d9d0 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb35affd700 1 --2- 172.21.15.179:0/1882313781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c06d9d0 0x7fb35c099c00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b4630 tx=0x7fb344009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741883361a3c4ef0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb359ffb700 1 -- 172.21.15.179:0/1882313781 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400b870 con 0x7fb35c06d9d0 2023-12-07T00:15:16.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb359ffb700 1 -- 172.21.15.179:0/1882313781 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34400b9d0 con 0x7fb35c06d9d0 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.008+0000 7fb359ffb700 1 -- 172.21.15.179:0/1882313781 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34400bd60 con 0x7fb35c06d9d0 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 -- 172.21.15.179:0/1882313781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c06d9d0 msgr2=0x7fb35c099c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 --2- 172.21.15.179:0/1882313781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c06d9d0 0x7fb35c099c00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b4630 tx=0x7fb344009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 -- 172.21.15.179:0/1882313781 shutdown_connections 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 --2- 172.21.15.179:0/1882313781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 0x7fb35c0d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 --2- 172.21.15.179:0/1882313781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c06d9d0 0x7fb35c099c00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 --2- 172.21.15.179:0/1882313781 >> v2:172.21.15.190:3300/0 conn(0x7fb35c0cddb0 0x7fb35c09a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 -- 172.21.15.179:0/1882313781 >> 172.21.15.179:0/1882313781 conn(0x7fb35c0b3550 msgr2=0x7fb35c0b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 -- 172.21.15.179:0/1882313781 shutdown_connections 2023-12-07T00:15:16.011 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.009+0000 7fb3613cd700 1 -- 172.21.15.179:0/1882313781 wait complete. 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.010+0000 7fb3613cd700 1 Processor -- start 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.010+0000 7fb3613cd700 1 -- start start 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3613cd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb35c06d9d0 0x7fb35c1f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3613cd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c0cddb0 0x7fb35c0c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3613cd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 0x7fb35c148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3613cd700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0c6680 con 0x7fb35c0cddb0 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3613cd700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0c6960 con 0x7fb35c06d9d0 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3613cd700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c0c6c40 con 0x7fb35c0d0490 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c0cddb0 0x7fb35c0c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c0cddb0 0x7fb35c0c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40990/0 (socket says 172.21.15.179:40990) 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 -- 172.21.15.179:0/3121250599 learned_addr learned my addr 172.21.15.179:0/3121250599 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:16.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 -- 172.21.15.179:0/3121250599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 msgr2=0x7fb35c148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 0x7fb35c148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 -- 172.21.15.179:0/3121250599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb35c06d9d0 msgr2=0x7fb35c1f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35affd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb35c06d9d0 0x7fb35c1f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb35c06d9d0 0x7fb35c1f76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 -- 172.21.15.179:0/3121250599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344009550 con 0x7fb35c0cddb0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb35a7fc700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c0cddb0 0x7fb35c0c7720 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00c7f0 tx=0x7fb34c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3537fe700 1 -- 172.21.15.179:0/3121250599 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011800 con 0x7fb35c0cddb0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3537fe700 1 -- 172.21.15.179:0/3121250599 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c011960 con 0x7fb35c0cddb0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c0c6f20 con 0x7fb35c0cddb0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3537fe700 1 -- 172.21.15.179:0/3121250599 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011d10 con 0x7fb35c0cddb0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.011+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c1f7c30 con 0x7fb35c0cddb0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.012+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c0685f0 con 0x7fb35c0cddb0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.013+0000 7fb3537fe700 1 -- 172.21.15.179:0/3121250599 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb34c018360 con 0x7fb35c0cddb0 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.013+0000 7fb3537fe700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb33c06aed0 0x7fb33c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.015 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.013+0000 7fb35affd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb33c06aed0 0x7fb33c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.013+0000 7fb3537fe700 1 -- 172.21.15.179:0/3121250599 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb34c089530 con 0x7fb35c0cddb0 2023-12-07T00:15:16.016 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.014+0000 7fb35affd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb33c06aed0 0x7fb33c06d390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b30b0 tx=0x7fb344008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.019+0000 7fb3537fe700 1 -- 172.21.15.179:0/3121250599 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb34c054220 con 0x7fb35c0cddb0 2023-12-07T00:15:16.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.207+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb35c0c7440 con 0x7fb35c0cddb0 2023-12-07T00:15:16.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.208+0000 7fb3537fe700 1 -- 172.21.15.179:0/3121250599 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18749 (secure 0 0 0) 0x7fb35c0c7440 con 0x7fb35c0cddb0 2023-12-07T00:15:16.209 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:16.209 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":29,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:14:55.616634+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:14:11.897021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-07T00:14:12.979971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-07T00:14:16.661445+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1b","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb33c06aed0 msgr2=0x7fb33c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb33c06aed0 0x7fb33c06d390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb35c0b30b0 tx=0x7fb344008030 comp rx=0 tx=0).stop 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c0cddb0 msgr2=0x7fb35c0c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c0cddb0 0x7fb35c0c7720 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00c7f0 tx=0x7fb34c00cbb0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 shutdown_connections 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb33c06aed0 0x7fb33c06d390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb35c0d0490 0x7fb35c148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb35c06d9d0 0x7fb35c1f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 --2- 172.21.15.179:0/3121250599 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb35c0cddb0 0x7fb35c0c7720 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 >> 172.21.15.179:0/3121250599 conn(0x7fb35c0b3550 msgr2=0x7fb35c0ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:16.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.210+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 shutdown_connections 2023-12-07T00:15:16.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.211+0000 7fb3613cd700 1 -- 172.21.15.179:0/3121250599 wait complete. 2023-12-07T00:15:16.223 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-07T00:15:16.343 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.344+0000 7f2a33cf2700 1 Processor -- start 2023-12-07T00:15:16.344 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.344+0000 7f2a33cf2700 1 -- start start 2023-12-07T00:15:16.346 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a33cf2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a2c15de40 0x7f2a2c0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.346 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a33cf2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c15e220 0x7f2a2c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.346 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a33cf2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2a2c0b4c20 0x7f2a2c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.346 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a33cf2700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0d1820 con 0x7f2a2c15de40 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a33cf2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c15f330 con 0x7f2a2c0b4c20 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a33cf2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c15e720 con 0x7f2a2c15e220 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a31a8e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a2c15de40 0x7f2a2c0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a31a8e700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a2c15de40 0x7f2a2c0b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:40996/0 (socket says 172.21.15.179:40996) 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a31a8e700 1 -- 172.21.15.179:0/2581314385 learned_addr learned my addr 172.21.15.179:0/2581314385 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a3228f700 1 --2- 172.21.15.179:0/2581314385 >> v2:172.21.15.190:3300/0 conn(0x7f2a2c0b4c20 0x7f2a2c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.345+0000 7f2a3128d700 1 --2- 172.21.15.179:0/2581314385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c15e220 0x7f2a2c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a31a8e700 1 -- 172.21.15.179:0/2581314385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c15e220 msgr2=0x7f2a2c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a31a8e700 1 --2- 172.21.15.179:0/2581314385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c15e220 0x7f2a2c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a31a8e700 1 -- 172.21.15.179:0/2581314385 >> v2:172.21.15.190:3300/0 conn(0x7f2a2c0b4c20 msgr2=0x7f2a2c0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a31a8e700 1 --2- 172.21.15.179:0/2581314385 >> v2:172.21.15.190:3300/0 conn(0x7f2a2c0b4c20 0x7f2a2c0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a31a8e700 1 -- 172.21.15.179:0/2581314385 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c15ea00 con 0x7f2a2c15de40 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a31a8e700 1 --2- 172.21.15.179:0/2581314385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15de40 0x7f2a2c0b46e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0cd7f0 tx=0x7f2a1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a9af902de4bca7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.347 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a30a8c700 1 -- 172.21.15.179:0/2581314385 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c011830 con 0x7f2a2c15de40 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a30a8c700 1 -- 172.21.15.179:0/2581314385 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c011990 con 0x7f2a2c15de40 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a30a8c700 1 -- 172.21.15.179:0/2581314385 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c011d20 con 0x7f2a2c15de40 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a33cf2700 1 -- 172.21.15.179:0/2581314385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15de40 msgr2=0x7f2a2c0b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/2581314385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15de40 0x7f2a2c0b46e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0cd7f0 tx=0x7f2a1c009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a33cf2700 1 -- 172.21.15.179:0/2581314385 shutdown_connections 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/2581314385 >> v2:172.21.15.190:3300/0 conn(0x7f2a2c0b4c20 0x7f2a2c0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/2581314385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15de40 0x7f2a2c0b46e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/2581314385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c15e220 0x7f2a2c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.346+0000 7f2a33cf2700 1 -- 172.21.15.179:0/2581314385 >> 172.21.15.179:0/2581314385 conn(0x7f2a2c072970 msgr2=0x7f2a2c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.347+0000 7f2a33cf2700 1 -- 172.21.15.179:0/2581314385 shutdown_connections 2023-12-07T00:15:16.348 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.347+0000 7f2a33cf2700 1 -- 172.21.15.179:0/2581314385 wait complete. 2023-12-07T00:15:16.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.348+0000 7f2a33cf2700 1 Processor -- start 2023-12-07T00:15:16.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.348+0000 7f2a33cf2700 1 -- start start 2023-12-07T00:15:16.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a33cf2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c0b4c20 0x7f2a2c159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a33cf2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a2c15de40 0x7f2a2c14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a33cf2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15e220 0x7f2a2c1f3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.351 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a33cf2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c159bd0 con 0x7f2a2c15e220 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a33cf2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c159eb0 con 0x7f2a2c15de40 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a33cf2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c15a190 con 0x7f2a2c0b4c20 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15e220 0x7f2a2c1f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15e220 0x7f2a2c1f3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41006/0 (socket says 172.21.15.179:41006) 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 -- 172.21.15.179:0/591334946 learned_addr learned my addr 172.21.15.179:0/591334946 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a31a8e700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c0b4c20 0x7f2a2c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3128d700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a2c15de40 0x7f2a2c14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 -- 172.21.15.179:0/591334946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c0b4c20 msgr2=0x7f2a2c159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c0b4c20 0x7f2a2c159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.352 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 -- 172.21.15.179:0/591334946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a2c15de40 msgr2=0x7f2a2c14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a2c15de40 0x7f2a2c14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 -- 172.21.15.179:0/591334946 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c009550 con 0x7f2a2c15e220 2023-12-07T00:15:16.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a3228f700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15e220 0x7f2a2c1f3900 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400eed0 tx=0x7f2a2400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a227fc700 1 -- 172.21.15.179:0/591334946 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24010040 con 0x7f2a2c15e220 2023-12-07T00:15:16.353 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a227fc700 1 -- 172.21.15.179:0/591334946 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2400bc80 con 0x7f2a2c15e220 2023-12-07T00:15:16.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a227fc700 1 -- 172.21.15.179:0/591334946 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24009e40 con 0x7f2a2c15e220 2023-12-07T00:15:16.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a2c15a470 con 0x7f2a2c15e220 2023-12-07T00:15:16.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.349+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c1598a0 con 0x7f2a2c15e220 2023-12-07T00:15:16.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.350+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c04f290 con 0x7f2a2c15e220 2023-12-07T00:15:16.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.351+0000 7f2a227fc700 1 -- 172.21.15.179:0/591334946 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a24014400 con 0x7f2a2c15e220 2023-12-07T00:15:16.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.351+0000 7f2a227fc700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a1006aed0 0x7f2a1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.351+0000 7f2a227fc700 1 -- 172.21.15.179:0/591334946 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a24089d60 con 0x7f2a2c15e220 2023-12-07T00:15:16.354 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.351+0000 7f2a31a8e700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a1006aed0 0x7f2a1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.355 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.352+0000 7f2a31a8e700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a1006aed0 0x7f2a1006d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009c10 tx=0x7f2a1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.355 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.356+0000 7f2a227fc700 1 -- 172.21.15.179:0/591334946 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a24054a50 con 0x7f2a2c15e220 2023-12-07T00:15:16.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.586+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2a2c15a990 con 0x7f2a2c15e220 2023-12-07T00:15:16.585 INFO:tasks.ceph.mon.a.smithi179.stderr:2023-12-07T00:15:16.587+0000 7f2610adb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T00:15:16.587 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.588+0000 7f2a227fc700 1 -- 172.21.15.179:0/591334946 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2a2c15a990 con 0x7f2a2c15e220 2023-12-07T00:15:16.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a1006aed0 msgr2=0x7f2a1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a1006aed0 0x7f2a1006d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009c10 tx=0x7f2a1c008030 comp rx=0 tx=0).stop 2023-12-07T00:15:16.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15e220 msgr2=0x7f2a2c1f3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15e220 0x7f2a2c1f3900 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400eed0 tx=0x7f2a2400b390 comp rx=0 tx=0).stop 2023-12-07T00:15:16.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 shutdown_connections 2023-12-07T00:15:16.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f2a1006aed0 0x7f2a1006d390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a2c15e220 0x7f2a2c1f3900 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a2c0b4c20 0x7f2a2c159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 --2- 172.21.15.179:0/591334946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a2c15de40 0x7f2a2c14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 >> 172.21.15.179:0/591334946 conn(0x7f2a2c072970 msgr2=0x7f2a2c0b0540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:16.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 shutdown_connections 2023-12-07T00:15:16.591 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.591+0000 7f2a33cf2700 1 -- 172.21.15.179:0/591334946 wait complete. 2023-12-07T00:15:16.592 INFO:teuthology.orchestra.run.smithi179.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-07T00:15:16.593 INFO:tasks.ceph.mds.a.smithi179.stderr: -5900> 2023-12-07T00:14:17.163+0000 7f509ce07700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T00:15:16.604 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-07T00:15:16.624 INFO:tasks.ceph.mds.a.smithi179.stdout:starting mds.a at 2023-12-07T00:15:16.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.731+0000 7fc68356c700 1 Processor -- start 2023-12-07T00:15:16.731 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.731+0000 7fc68356c700 1 -- start start 2023-12-07T00:15:16.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc68356c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c15de50 0x7fc67c0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc68356c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc67c06b680 0x7fc67c0cfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc68356c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc67c0cc550 con 0x7fc67c0ccc90 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc68356c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67c0cd1c0 con 0x7fc67c06b680 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc68356c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0cd4a0 con 0x7fc67c15de50 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc681308700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c15de50 0x7fc67c0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc681b09700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc67c06b680 0x7fc67c0cfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc681308700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c15de50 0x7fc67c0cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41434/0 (socket says 172.21.15.179:41434) 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc681308700 1 -- 172.21.15.179:0/482826807 learned_addr learned my addr 172.21.15.179:0/482826807 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.732+0000 7fc680b07700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc67c0ccc90 0x7fc67c06af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:54600/0 (socket says 172.21.15.179:54600) 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc681308700 1 -- 172.21.15.179:0/482826807 >> v2:172.21.15.190:3300/0 conn(0x7fc67c06b680 msgr2=0x7fc67c0cfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc681308700 1 --2- 172.21.15.179:0/482826807 >> v2:172.21.15.190:3300/0 conn(0x7fc67c06b680 0x7fc67c0cfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc681308700 1 -- 172.21.15.179:0/482826807 >> v1:172.21.15.190:6789/0 conn(0x7fc67c0ccc90 legacy=0x7fc67c06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc681308700 1 -- 172.21.15.179:0/482826807 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c0cd780 con 0x7fc67c15de50 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc681b09700 1 --2- 172.21.15.179:0/482826807 >> v2:172.21.15.190:3300/0 conn(0x7fc67c06b680 0x7fc67c0cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc681308700 1 --2- 172.21.15.179:0/482826807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c15de50 0x7fc67c0cc010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0098f0 tx=0x7fc66c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=112869002369ad40 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc673fff700 1 -- 172.21.15.179:0/482826807 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c011830 con 0x7fc67c15de50 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc673fff700 1 -- 172.21.15.179:0/482826807 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c011990 con 0x7fc67c15de50 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.733+0000 7fc673fff700 1 -- 172.21.15.179:0/482826807 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c011d20 con 0x7fc67c15de50 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.734+0000 7fc68356c700 1 -- 172.21.15.179:0/482826807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c15de50 msgr2=0x7fc67c0cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.734+0000 7fc68356c700 1 --2- 172.21.15.179:0/482826807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c15de50 0x7fc67c0cc010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0098f0 tx=0x7fc66c009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.734+0000 7fc68356c700 1 -- 172.21.15.179:0/482826807 shutdown_connections 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.734+0000 7fc68356c700 1 --2- 172.21.15.179:0/482826807 >> v2:172.21.15.190:3300/0 conn(0x7fc67c06b680 0x7fc67c0cfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.734+0000 7fc68356c700 1 --2- 172.21.15.179:0/482826807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c15de50 0x7fc67c0cc010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.734+0000 7fc68356c700 1 -- 172.21.15.179:0/482826807 >> 172.21.15.179:0/482826807 conn(0x7fc67c099a40 msgr2=0x7fc67c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:16.735 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.734+0000 7fc68356c700 1 -- 172.21.15.179:0/482826807 shutdown_connections 2023-12-07T00:15:16.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.734+0000 7fc68356c700 1 -- 172.21.15.179:0/482826807 wait complete. 2023-12-07T00:15:16.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.735+0000 7fc68356c700 1 Processor -- start 2023-12-07T00:15:16.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.735+0000 7fc68356c700 1 -- start start 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc68356c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc67c06b680 0x7fc67c0b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc68356c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c0ccc90 0x7fc67c0b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc68356c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c15de50 0x7fc67c0c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc68356c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0c8b10 con 0x7fc67c15de50 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc68356c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0b4b10 con 0x7fc67c06b680 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc68356c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67c0b4df0 con 0x7fc67c0ccc90 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c15de50 0x7fc67c0c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c15de50 0x7fc67c0c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41028/0 (socket says 172.21.15.179:41028) 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 -- 172.21.15.179:0/2721261705 learned_addr learned my addr 172.21.15.179:0/2721261705 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681308700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc67c06b680 0x7fc67c0b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc680b07700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c0ccc90 0x7fc67c0b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 -- 172.21.15.179:0/2721261705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c0ccc90 msgr2=0x7fc67c0b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c0ccc90 0x7fc67c0b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 -- 172.21.15.179:0/2721261705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc67c06b680 msgr2=0x7fc67c0b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc67c06b680 0x7fc67c0b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 -- 172.21.15.179:0/2721261705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674009a70 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc681b09700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c15de50 0x7fc67c0c85d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc67400efc0 tx=0x7fc67400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc671ffb700 1 -- 172.21.15.179:0/2721261705 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400ca90 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc671ffb700 1 -- 172.21.15.179:0/2721261705 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67400f040 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c009550 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.736+0000 7fc671ffb700 1 -- 172.21.15.179:0/2721261705 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67400ce30 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.737+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67c0b53b0 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.738+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67c0685f0 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.738+0000 7fc671ffb700 1 -- 172.21.15.179:0/2721261705 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc674014480 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.738+0000 7fc671ffb700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc66006aed0 0x7fc66006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.739+0000 7fc671ffb700 1 -- 172.21.15.179:0/2721261705 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc67408a000 con 0x7fc67c15de50 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.739+0000 7fc681308700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc66006aed0 0x7fc66006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:16.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.739+0000 7fc681308700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc66006aed0 0x7fc66006d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009c40 tx=0x7fc66c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:16.742 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.743+0000 7fc671ffb700 1 -- 172.21.15.179:0/2721261705 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc674054ca0 con 0x7fc67c15de50 2023-12-07T00:15:16.977 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:16.978+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc67c0afbe0 con 0x7fc67c15de50 2023-12-07T00:15:17.589 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.589+0000 7fc671ffb700 1 -- 172.21.15.179:0/2721261705 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc674009cd0 con 0x7fc67c15de50 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.593+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc66006aed0 msgr2=0x7fc66006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.593+0000 7fc68356c700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc66006aed0 0x7fc66006d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009c40 tx=0x7fc66c008030 comp rx=0 tx=0).stop 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.593+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c15de50 msgr2=0x7fc67c0c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.593+0000 7fc68356c700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c15de50 0x7fc67c0c85d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc67400efc0 tx=0x7fc67400c3a0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.594+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 shutdown_connections 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.594+0000 7fc68356c700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc66006aed0 0x7fc66006d390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.594+0000 7fc68356c700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc67c15de50 0x7fc67c0c85d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.594+0000 7fc68356c700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc67c06b680 0x7fc67c0b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.593 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.594+0000 7fc68356c700 1 --2- 172.21.15.179:0/2721261705 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc67c0ccc90 0x7fc67c0b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.594+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 >> 172.21.15.179:0/2721261705 conn(0x7fc67c099a40 msgr2=0x7fc67c070380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:17.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.594+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 shutdown_connections 2023-12-07T00:15:17.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.594+0000 7fc68356c700 1 -- 172.21.15.179:0/2721261705 wait complete. 2023-12-07T00:15:17.608 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-07T00:15:17.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.780+0000 7fd2fd197700 1 Processor -- start 2023-12-07T00:15:17.780 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.780+0000 7fd2fd197700 1 -- start start 2023-12-07T00:15:17.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.781+0000 7fd2fd197700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2f815aae0 0x7fd2f80d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:17.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.781+0000 7fd2fd197700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 0x7fd2f80d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:17.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.781+0000 7fd2fd197700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f80b0c90 con 0x7fd2f815aec0 2023-12-07T00:15:17.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.781+0000 7fd2fd197700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f80cb340 con 0x7fd2f815aae0 2023-12-07T00:15:17.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.781+0000 7fd2fd197700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f815bb00 con 0x7fd2f815f350 2023-12-07T00:15:17.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.781+0000 7fd2f6d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd2f815aae0 0x7fd2f80d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:17.782 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.781+0000 7fd2f759e700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd2f815aec0 0x7fd2f815b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47940/0 (socket says 172.21.15.179:47940) 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.781+0000 7fd2f759e700 1 -- 172.21.15.179:0/402057759 learned_addr learned my addr 172.21.15.179:0/402057759 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f659c700 1 --2- 172.21.15.179:0/402057759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 0x7fd2f80d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f6d9d700 1 -- 172.21.15.179:0/402057759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 msgr2=0x7fd2f80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f6d9d700 1 --2- 172.21.15.179:0/402057759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 0x7fd2f80d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f6d9d700 1 -- 172.21.15.179:0/402057759 >> v1:172.21.15.179:6789/0 conn(0x7fd2f815aec0 legacy=0x7fd2f815b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f6d9d700 1 -- 172.21.15.179:0/402057759 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f815bde0 con 0x7fd2f815aae0 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f5d9b700 1 -- 172.21.15.179:0/402057759 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509854079 0 0) 0x7fd2f80b0c90 con 0x7fd2f815aec0 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f6d9d700 1 --2- 172.21.15.179:0/402057759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f80d08f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009840 tx=0x7fd2e8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e7168513533eb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f5d9b700 1 -- 172.21.15.179:0/402057759 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8011830 con 0x7fd2f815aae0 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f5d9b700 1 -- 172.21.15.179:0/402057759 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8011990 con 0x7fd2f815aae0 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2f5d9b700 1 -- 172.21.15.179:0/402057759 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8011d20 con 0x7fd2f815aae0 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2fd197700 1 -- 172.21.15.179:0/402057759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 msgr2=0x7fd2f80d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2fd197700 1 --2- 172.21.15.179:0/402057759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f80d08f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009840 tx=0x7fd2e8009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2fd197700 1 -- 172.21.15.179:0/402057759 shutdown_connections 2023-12-07T00:15:17.783 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2fd197700 1 --2- 172.21.15.179:0/402057759 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f80d08f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2fd197700 1 --2- 172.21.15.179:0/402057759 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 0x7fd2f80d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.782+0000 7fd2fd197700 1 -- 172.21.15.179:0/402057759 >> 172.21.15.179:0/402057759 conn(0x7fd2f8099a40 msgr2=0x7fd2f8099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:17.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.783+0000 7fd2fd197700 1 -- 172.21.15.179:0/402057759 shutdown_connections 2023-12-07T00:15:17.784 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.783+0000 7fd2fd197700 1 -- 172.21.15.179:0/402057759 wait complete. 2023-12-07T00:15:17.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.784+0000 7fd2fd197700 1 Processor -- start 2023-12-07T00:15:17.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.784+0000 7fd2fd197700 1 -- start start 2023-12-07T00:15:17.786 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2fd197700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f8152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2fd197700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f815aec0 0x7fd2f815c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2fd197700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 0x7fd2f814e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2fd197700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f8150060 con 0x7fd2f815aae0 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2fd197700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f8146810 con 0x7fd2f815aec0 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2fd197700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f815c4c0 con 0x7fd2f815f350 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f8152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f8152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41040/0 (socket says 172.21.15.179:41040) 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 -- 172.21.15.179:0/3714631588 learned_addr learned my addr 172.21.15.179:0/3714631588 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f759e700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 0x7fd2f814e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f659c700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f815aec0 0x7fd2f815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 -- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 msgr2=0x7fd2f814e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 0x7fd2f814e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 -- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f815aec0 msgr2=0x7fd2f815c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f815aec0 0x7fd2f815c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:17.787 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 -- 172.21.15.179:0/3714631588 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80094a0 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f659c700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f815aec0 0x7fd2f815c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.785+0000 7fd2f6d9d700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f8152b10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009b90 tx=0x7fd2e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.786+0000 7fd2df7fe700 1 -- 172.21.15.179:0/3714631588 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80045d0 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.786+0000 7fd2df7fe700 1 -- 172.21.15.179:0/3714631588 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e801f070 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.786+0000 7fd2df7fe700 1 -- 172.21.15.179:0/3714631588 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e80038a0 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.786+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f81465a0 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.786+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f81502b0 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.787+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f80cfbc0 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.787+0000 7fd2df7fe700 1 -- 172.21.15.179:0/3714631588 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2e8003a00 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.787+0000 7fd2df7fe700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd2e406aed0 0x7fd2e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.787+0000 7fd2df7fe700 1 -- 172.21.15.179:0/3714631588 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fd2e8021070 con 0x7fd2f815aae0 2023-12-07T00:15:17.788 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.787+0000 7fd2f659c700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd2e406aed0 0x7fd2e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:17.789 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.788+0000 7fd2f659c700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd2e406aed0 0x7fd2e406d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80b6790 tx=0x7fd2ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:17.791 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.792+0000 7fd2df7fe700 1 -- 172.21.15.179:0/3714631588 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2e8055fe0 con 0x7fd2f815aae0 2023-12-07T00:15:17.986 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:17.987+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd2f80685f0 con 0x7fd2f815aae0 2023-12-07T00:15:18.719 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.720+0000 7fd2df7fe700 1 -- 172.21.15.179:0/3714631588 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd2e8003cb0 con 0x7fd2f815aae0 2023-12-07T00:15:18.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.723+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd2e406aed0 msgr2=0x7fd2e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:18.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.723+0000 7fd2fd197700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd2e406aed0 0x7fd2e406d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd2f80b6790 tx=0x7fd2ec008040 comp rx=0 tx=0).stop 2023-12-07T00:15:18.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.723+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 msgr2=0x7fd2f8152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:18.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.723+0000 7fd2fd197700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f8152b10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009b90 tx=0x7fd2e8004750 comp rx=0 tx=0).stop 2023-12-07T00:15:18.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.724+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 shutdown_connections 2023-12-07T00:15:18.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.724+0000 7fd2fd197700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd2e406aed0 0x7fd2e406d390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.724+0000 7fd2fd197700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f815f350 0x7fd2f814e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.724+0000 7fd2fd197700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd2f815aae0 0x7fd2f8152b10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.724+0000 7fd2fd197700 1 --2- 172.21.15.179:0/3714631588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f815aec0 0x7fd2f815c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.723 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.724+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 >> 172.21.15.179:0/3714631588 conn(0x7fd2f8099a40 msgr2=0x7fd2f80d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:18.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.725+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 shutdown_connections 2023-12-07T00:15:18.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.726+0000 7fd2fd197700 1 -- 172.21.15.179:0/3714631588 wait complete. 2023-12-07T00:15:18.726 INFO:teuthology.orchestra.run.smithi179.stderr:pool 'cephfs_metadata' removed 2023-12-07T00:15:18.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-07T00:15:18.874 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.875+0000 7f36bbd21700 1 Processor -- start 2023-12-07T00:15:18.875 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.875+0000 7f36bbd21700 1 -- start start 2023-12-07T00:15:18.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36bbd21700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415aae0 0x7f36b40d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:18.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36bbd21700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f36b415b5d0 0x7f36b40d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:18.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36bbd21700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b40b0c90 con 0x7f36b415f350 2023-12-07T00:15:18.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36bbd21700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b40cb340 con 0x7f36b415b5d0 2023-12-07T00:15:18.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36bbd21700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b415bb00 con 0x7f36b415aae0 2023-12-07T00:15:18.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36ba2be700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f36b415b5d0 0x7f36b40d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:18.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36ba2be700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f36b415b5d0 0x7f36b40d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41052/0 (socket says 172.21.15.179:41052) 2023-12-07T00:15:18.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36ba2be700 1 -- 172.21.15.179:0/1658542281 learned_addr learned my addr 172.21.15.179:0/1658542281 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:18.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36b9abd700 1 --2- 172.21.15.179:0/1658542281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415aae0 0x7f36b40d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:18.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36ba2be700 1 -- 172.21.15.179:0/1658542281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415aae0 msgr2=0x7f36b40d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:18.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36ba2be700 1 --2- 172.21.15.179:0/1658542281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415aae0 0x7f36b40d08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36ba2be700 1 -- 172.21.15.179:0/1658542281 >> v1:172.21.15.190:6789/0 conn(0x7f36b415f350 legacy=0x7f36b415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:18.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.876+0000 7f36ba2be700 1 -- 172.21.15.179:0/1658542281 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b415bde0 con 0x7f36b415b5d0 2023-12-07T00:15:18.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36ba2be700 1 --2- 172.21.15.179:0/1658542281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415b5d0 0x7f36b40d0e30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00d150 tx=0x7f36ac00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5ce28e06cb871c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:18.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36b8abb700 1 -- 172.21.15.179:0/1658542281 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac010070 con 0x7f36b415b5d0 2023-12-07T00:15:18.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36b8abb700 1 -- 172.21.15.179:0/1658542281 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac00dd80 con 0x7f36b415b5d0 2023-12-07T00:15:18.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36b8abb700 1 -- 172.21.15.179:0/1658542281 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac00b310 con 0x7f36b415b5d0 2023-12-07T00:15:18.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36bbd21700 1 -- 172.21.15.179:0/1658542281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415b5d0 msgr2=0x7f36b40d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:18.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1658542281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415b5d0 0x7f36b40d0e30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f36ac00d150 tx=0x7f36ac00d460 comp rx=0 tx=0).stop 2023-12-07T00:15:18.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36bbd21700 1 -- 172.21.15.179:0/1658542281 shutdown_connections 2023-12-07T00:15:18.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1658542281 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415b5d0 0x7f36b40d0e30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1658542281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415aae0 0x7f36b40d08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36bbd21700 1 -- 172.21.15.179:0/1658542281 >> 172.21.15.179:0/1658542281 conn(0x7f36b4099a40 msgr2=0x7f36b4099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:18.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36bbd21700 1 -- 172.21.15.179:0/1658542281 shutdown_connections 2023-12-07T00:15:18.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.877+0000 7f36bbd21700 1 -- 172.21.15.179:0/1658542281 wait complete. 2023-12-07T00:15:18.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.879+0000 7f36bbd21700 1 Processor -- start 2023-12-07T00:15:18.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.879+0000 7f36bbd21700 1 -- start start 2023-12-07T00:15:18.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36bbd21700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b415aae0 0x7f36b40c2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:18.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36bbd21700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415b5d0 0x7f36b41483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:18.889 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36bbd21700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415f350 0x7f36b4157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:18.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36bbd21700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c9a00 con 0x7f36b415f350 2023-12-07T00:15:18.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36bbd21700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b40c9130 con 0x7f36b415aae0 2023-12-07T00:15:18.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36bbd21700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b4145940 con 0x7f36b415b5d0 2023-12-07T00:15:18.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415f350 0x7f36b4157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:18.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415f350 0x7f36b4157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41058/0 (socket says 172.21.15.179:41058) 2023-12-07T00:15:18.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 -- 172.21.15.179:0/1219024734 learned_addr learned my addr 172.21.15.179:0/1219024734 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:18.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36b92bc700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415b5d0 0x7f36b41483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:18.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36b9abd700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b415aae0 0x7f36b40c2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:18.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 -- 172.21.15.179:0/1219024734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415b5d0 msgr2=0x7f36b41483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:18.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415b5d0 0x7f36b41483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 -- 172.21.15.179:0/1219024734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b415aae0 msgr2=0x7f36b40c2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:18.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b415aae0 0x7f36b40c2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:18.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 -- 172.21.15.179:0/1219024734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac00bd40 con 0x7f36b415f350 2023-12-07T00:15:18.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36ba2be700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415f350 0x7f36b4157820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f36ac017040 tx=0x7f36ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:18.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.880+0000 7f36aa7fc700 1 -- 172.21.15.179:0/1219024734 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac009a10 con 0x7f36b415f350 2023-12-07T00:15:18.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.881+0000 7f36aa7fc700 1 -- 172.21.15.179:0/1219024734 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac009b70 con 0x7f36b415f350 2023-12-07T00:15:18.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.881+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b40c7840 con 0x7f36b415f350 2023-12-07T00:15:18.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.881+0000 7f36aa7fc700 1 -- 172.21.15.179:0/1219024734 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac004030 con 0x7f36b415f350 2023-12-07T00:15:18.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.881+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b40c7560 con 0x7f36b415f350 2023-12-07T00:15:18.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.881+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b40685f0 con 0x7f36b415f350 2023-12-07T00:15:18.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.882+0000 7f36aa7fc700 1 -- 172.21.15.179:0/1219024734 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36ac004190 con 0x7f36b415f350 2023-12-07T00:15:18.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.882+0000 7f36aa7fc700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f369806aed0 0x7f369806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:18.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.882+0000 7f36aa7fc700 1 -- 172.21.15.179:0/1219024734 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f36ac08cee0 con 0x7f36b415f350 2023-12-07T00:15:18.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.882+0000 7f36b9abd700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f369806aed0 0x7f369806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:18.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.883+0000 7f36b9abd700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f369806aed0 0x7f369806d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009930 tx=0x7f36a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:18.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:18.887+0000 7f36aa7fc700 1 -- 172.21.15.179:0/1219024734 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36ac057dc0 con 0x7f36b415f350 2023-12-07T00:15:19.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.079+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f36b4073580 con 0x7f36b415f350 2023-12-07T00:15:19.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.729+0000 7f36aa7fc700 1 -- 172.21.15.179:0/1219024734 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f36ac05b3e0 con 0x7f36b415f350 2023-12-07T00:15:19.731 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f369806aed0 msgr2=0x7f369806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f369806aed0 0x7f369806d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f36a4009930 tx=0x7f36a4008040 comp rx=0 tx=0).stop 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415f350 msgr2=0x7f36b4157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415f350 0x7f36b4157820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f36ac017040 tx=0x7f36ac004ad0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 shutdown_connections 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f369806aed0 0x7f369806d390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f36b415f350 0x7f36b4157820 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36b415aae0 0x7f36b40c2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 --2- 172.21.15.179:0/1219024734 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36b415b5d0 0x7f36b41483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 >> 172.21.15.179:0/1219024734 conn(0x7f36b4099a40 msgr2=0x7f36b40ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 shutdown_connections 2023-12-07T00:15:19.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.732+0000 7f36bbd21700 1 -- 172.21.15.179:0/1219024734 wait complete. 2023-12-07T00:15:19.737 INFO:teuthology.orchestra.run.smithi179.stderr:pool 'cephfs_data' removed 2023-12-07T00:15:19.751 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-07T00:15:19.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.882+0000 7f0371cb5700 1 Processor -- start 2023-12-07T00:15:19.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.882+0000 7f0371cb5700 1 -- start start 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.883+0000 7f0371cb5700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f036c099c00 0x7f036c09a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.883+0000 7f0371cb5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f036c0ccc20 0x7f036c0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.883+0000 7f0371cb5700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036c0d0070 con 0x7f036c15bf20 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.883+0000 7f0371cb5700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c09a5c0 con 0x7f036c099c00 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.883+0000 7f0371cb5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0d0350 con 0x7f036c0ccc20 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.883+0000 7f036b7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f036c15bf20 0x7f036c0cf5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:47964/0 (socket says 172.21.15.179:47964) 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.883+0000 7f036b7fe700 1 -- 172.21.15.179:0/1770584690 learned_addr learned my addr 172.21.15.179:0/1770584690 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036bfff700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f036c0ccc20 0x7f036c0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036affd700 1 --2- 172.21.15.179:0/1770584690 >> v2:172.21.15.190:3300/0 conn(0x7f036c099c00 0x7f036c09a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937734477 0 0) 0x7f036c0d0070 con 0x7f036c15bf20 2023-12-07T00:15:19.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03540035b0 con 0x7f036c15bf20 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4054709877 0 0) 0x7f03540035b0 con 0x7f036c15bf20 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f036c0ccc20 msgr2=0x7f036c0cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f036c0ccc20 0x7f036c0cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 >> v2:172.21.15.190:3300/0 conn(0x7f036c099c00 msgr2=0x7f036c09a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 --2- 172.21.15.179:0/1770584690 >> v2:172.21.15.190:3300/0 conn(0x7f036c099c00 0x7f036c09a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0d0630 con 0x7f036c15bf20 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f0360001670 con 0x7f036c15bf20 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 >> v1:172.21.15.179:6789/0 conn(0x7f036c15bf20 legacy=0x7f036c0cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f036c0ccc20 0x7f0354003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0354003f80 0x7f0354004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0354004d90 0x7f0354005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c09a5c0 con 0x7f0354003f80 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0d0350 con 0x7f0354004d90 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035400ba10 con 0x7f036c0ccc20 2023-12-07T00:15:19.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036affd700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0354003f80 0x7f0354004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036b7fe700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f036c0ccc20 0x7f0354003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036bfff700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0354004d90 0x7f0354005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036affd700 1 -- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f036c0ccc20 msgr2=0x7f0354003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036affd700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f036c0ccc20 0x7f0354003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036affd700 1 -- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0354004d90 msgr2=0x7f0354005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036affd700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0354004d90 0x7f0354005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.884+0000 7f036affd700 1 -- 172.21.15.179:0/1770584690 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540035b0 con 0x7f0354003f80 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f036affd700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0354003f80 0x7f0354004850 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f035c009b60 tx=0x7f0354005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5c27b1e6f544cc server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00e660 con 0x7f0354003f80 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c00e7c0 con 0x7f0354003f80 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f036a7fc700 1 -- 172.21.15.179:0/1770584690 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00eb30 con 0x7f0354003f80 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f0371cb5700 1 -- 172.21.15.179:0/1770584690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0354003f80 msgr2=0x7f0354004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f0371cb5700 1 --2- 172.21.15.179:0/1770584690 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0354003f80 0x7f0354004850 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f035c009b60 tx=0x7f0354005880 comp rx=0 tx=0).stop 2023-12-07T00:15:19.894 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f036bfff700 1 -- 172.21.15.179:0/1770584690 reap_dead start 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f0371cb5700 1 -- 172.21.15.179:0/1770584690 shutdown_connections 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f0371cb5700 1 -- 172.21.15.179:0/1770584690 >> 172.21.15.179:0/1770584690 conn(0x7f036c0b34d0 msgr2=0x7f036c0b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f0371cb5700 1 -- 172.21.15.179:0/1770584690 shutdown_connections 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.885+0000 7f0371cb5700 1 -- 172.21.15.179:0/1770584690 wait complete. 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.887+0000 7f0371cb5700 1 Processor -- start 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.887+0000 7f0371cb5700 1 -- start start 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.887+0000 7f0371cb5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0354003f80 0x7f036c1f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.887+0000 7f0371cb5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0c9570 0x7f036c0c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0371cb5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f036c0c7e30 0x7f036c0c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0371cb5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0c87e0 con 0x7f036c0c9570 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0371cb5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c0b5ad0 con 0x7f036c0c7e30 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0371cb5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c1f1ff0 con 0x7f0354003f80 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0c9570 0x7f036c0c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0c9570 0x7f036c0c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41076/0 (socket says 172.21.15.179:41076) 2023-12-07T00:15:19.895 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 -- 172.21.15.179:0/3494838712 learned_addr learned my addr 172.21.15.179:0/3494838712 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036b7fe700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0354003f80 0x7f036c1f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036bfff700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f036c0c7e30 0x7f036c0c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 -- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0354003f80 msgr2=0x7f036c1f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0354003f80 0x7f036c1f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 -- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f036c0c7e30 msgr2=0x7f036c0c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f036c0c7e30 0x7f036c0c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 -- 172.21.15.179:0/3494838712 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0cfe40 con 0x7f036c0c9570 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036bfff700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f036c0c7e30 0x7f036c0c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f036affd700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0c9570 0x7f036c0c9ab0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f035c0042f0 tx=0x7f035c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0353fff700 1 -- 172.21.15.179:0/3494838712 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00e660 con 0x7f036c0c9570 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0353fff700 1 -- 172.21.15.179:0/3494838712 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c003ab0 con 0x7f036c0c9570 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c0b5130 con 0x7f036c0c9570 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0353fff700 1 -- 172.21.15.179:0/3494838712 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c003e60 con 0x7f036c0c9570 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.888+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c0b56f0 con 0x7f036c0c9570 2023-12-07T00:15:19.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.889+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036c0685f0 con 0x7f036c0c9570 2023-12-07T00:15:19.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.890+0000 7f0353fff700 1 -- 172.21.15.179:0/3494838712 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f035c013470 con 0x7f036c0c9570 2023-12-07T00:15:19.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.890+0000 7f0353fff700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:19.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.890+0000 7f0353fff700 1 -- 172.21.15.179:0/3494838712 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f035c08b1e0 con 0x7f036c0c9570 2023-12-07T00:15:19.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.890+0000 7f036b7fe700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:19.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.890+0000 7f036b7fe700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0360000c00 tx=0x7f0360009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:19.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:19.895+0000 7f0353fff700 1 -- 172.21.15.179:0/3494838712 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f035c0563f0 con 0x7f036c0c9570 2023-12-07T00:15:20.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.084+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f036c15b110 con 0x7f036c0c9570 2023-12-07T00:15:20.734 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.735+0000 7f0353fff700 1 -- 172.21.15.179:0/3494838712 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f035c059a10 con 0x7f036c0c9570 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 msgr2=0x7f035806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0360000c00 tx=0x7f0360009040 comp rx=0 tx=0).stop 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0c9570 msgr2=0x7f036c0c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0c9570 0x7f036c0c9ab0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f035c0042f0 tx=0x7f035c0047c0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 shutdown_connections 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f035806aed0 0x7f035806d390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f036c0c7e30 0x7f036c0c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0354003f80 0x7f036c1f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 --2- 172.21.15.179:0/3494838712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f036c0c9570 0x7f036c0c9ab0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 >> 172.21.15.179:0/3494838712 conn(0x7f036c0b34d0 msgr2=0x7f036c15d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.739+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 shutdown_connections 2023-12-07T00:15:20.739 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.740+0000 7f0371cb5700 1 -- 172.21.15.179:0/3494838712 wait complete. 2023-12-07T00:15:20.744 INFO:teuthology.orchestra.run.smithi179.stderr:pool 'cephfs_data_ec' removed 2023-12-07T00:15:20.757 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-07T00:15:20.758 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-07T00:15:20.758 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-07T00:15:20.758 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T00:15:20.758 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-07T00:15:20.758 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-07T00:15:20.759 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-07T00:15:20.759 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T00:15:20.759 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-07T00:15:20.759 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-07T00:15:20.759 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-07T00:15:20.759 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T00:15:20.759 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-07T00:15:20.759 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-07T00:15:20.760 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-07T00:15:20.760 INFO:teuthology.orchestra.run:waiting for 300 2023-12-07T00:15:20.769 INFO:tasks.ceph.mds.a:Stopped 2023-12-07T00:15:20.770 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-07T00:15:20.770 INFO:tasks.ceph.mds.c:Stopped 2023-12-07T00:15:20.771 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-07T00:15:20.771 INFO:tasks.ceph.mds.b:Stopped 2023-12-07T00:15:20.772 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-07T00:15:20.772 INFO:tasks.ceph.mds.d:Stopped 2023-12-07T00:15:20.773 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-07T00:15:20.813 INFO:tasks.ceph.mds.a:Started 2023-12-07T00:15:20.814 DEBUG:teuthology.parallel:result is None 2023-12-07T00:15:20.814 INFO:tasks.ceph.mds.b:Started 2023-12-07T00:15:20.815 INFO:tasks.ceph.mds.c:Started 2023-12-07T00:15:20.815 INFO:tasks.ceph.mds.d:Started 2023-12-07T00:15:20.815 DEBUG:teuthology.parallel:result is None 2023-12-07T00:15:20.815 DEBUG:teuthology.parallel:result is None 2023-12-07T00:15:20.816 DEBUG:teuthology.parallel:result is None 2023-12-07T00:15:20.816 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-07T00:15:20.893 INFO:tasks.ceph.mds.c.smithi179.stdout:starting mds.c at 2023-12-07T00:15:20.893 INFO:tasks.ceph.mds.a.smithi179.stdout:starting mds.a at 2023-12-07T00:15:20.899 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-12-07T00:15:20.899 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-12-07T00:15:20.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.946+0000 7f41c0d68700 1 Processor -- start 2023-12-07T00:15:20.945 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.946+0000 7f41c0d68700 1 -- start start 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41c0d68700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc15bde0 0x7f41bc0d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41c0d68700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41bc0cd020 0x7f41bc0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41c0d68700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f41bc099c00 0x7f41bc09a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41c0d68700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41bc09a570 con 0x7f41bc0cd020 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41c0d68700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41bc09ab50 con 0x7f41bc099c00 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41c0d68700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0cf630 con 0x7f41bc15bde0 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41bc0cd020 0x7f41bc0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f41bc0cd020 0x7f41bc0cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41106/0 (socket says 172.21.15.179:41106) 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 -- 172.21.15.179:0/4116146662 learned_addr learned my addr 172.21.15.179:0/4116146662 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41ba59c700 1 --2- 172.21.15.179:0/4116146662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc15bde0 0x7f41bc0d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:20.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41bad9d700 1 --2- 172.21.15.179:0/4116146662 >> v2:172.21.15.190:3300/0 conn(0x7f41bc099c00 0x7f41bc09a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 -- 172.21.15.179:0/4116146662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc15bde0 msgr2=0x7f41bc0d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 --2- 172.21.15.179:0/4116146662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc15bde0 0x7f41bc0d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 -- 172.21.15.179:0/4116146662 >> v2:172.21.15.190:3300/0 conn(0x7f41bc099c00 msgr2=0x7f41bc09a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 --2- 172.21.15.179:0/4116146662 >> v2:172.21.15.190:3300/0 conn(0x7f41bc099c00 0x7f41bc09a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 -- 172.21.15.179:0/4116146662 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc0cf8f0 con 0x7f41bc0cd020 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41bad9d700 1 --2- 172.21.15.179:0/4116146662 >> v2:172.21.15.190:3300/0 conn(0x7f41bc099c00 0x7f41bc09a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41ba59c700 1 --2- 172.21.15.179:0/4116146662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc15bde0 0x7f41bc0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b9d9b700 1 --2- 172.21.15.179:0/4116146662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc0cd020 0x7f41bc0cd490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0c8a20 tx=0x7f41b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e279e2afd9dccf server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.947+0000 7f41b959a700 1 -- 172.21.15.179:0/4116146662 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000b870 con 0x7f41bc0cd020 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41b959a700 1 -- 172.21.15.179:0/4116146662 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b000b9d0 con 0x7f41bc0cd020 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41b959a700 1 -- 172.21.15.179:0/4116146662 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b000bd60 con 0x7f41bc0cd020 2023-12-07T00:15:20.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 -- 172.21.15.179:0/4116146662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc0cd020 msgr2=0x7f41bc0cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:20.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 --2- 172.21.15.179:0/4116146662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc0cd020 0x7f41bc0cd490 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0c8a20 tx=0x7f41b0009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 -- 172.21.15.179:0/4116146662 shutdown_connections 2023-12-07T00:15:20.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 --2- 172.21.15.179:0/4116146662 >> v2:172.21.15.190:3300/0 conn(0x7f41bc099c00 0x7f41bc09a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 --2- 172.21.15.179:0/4116146662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc15bde0 0x7f41bc0d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 --2- 172.21.15.179:0/4116146662 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc0cd020 0x7f41bc0cd490 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 -- 172.21.15.179:0/4116146662 >> 172.21.15.179:0/4116146662 conn(0x7f41bc0b3550 msgr2=0x7f41bc0b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:20.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 -- 172.21.15.179:0/4116146662 shutdown_connections 2023-12-07T00:15:20.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.948+0000 7f41c0d68700 1 -- 172.21.15.179:0/4116146662 wait complete. 2023-12-07T00:15:20.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.949+0000 7f41c0d68700 1 Processor -- start 2023-12-07T00:15:20.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41c0d68700 1 -- start start 2023-12-07T00:15:20.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41c0d68700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc099c00 0x7f41bc1f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:20.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41c0d68700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41bc0cd020 0x7f41bc0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:20.953 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41c0d68700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc15bde0 0x7f41bc0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41c0d68700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc15e2a0 con 0x7f41bc15bde0 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41c0d68700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc15e580 con 0x7f41bc0cd020 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41c0d68700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc15e860 con 0x7f41bc099c00 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41bad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc15bde0 0x7f41bc0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41bad9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc15bde0 0x7f41bc0b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41114/0 (socket says 172.21.15.179:41114) 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41bad9d700 1 -- 172.21.15.179:0/973418432 learned_addr learned my addr 172.21.15.179:0/973418432 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41b9d9b700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41bc0cd020 0x7f41bc0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.950+0000 7f41ba59c700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc099c00 0x7f41bc1f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41bad9d700 1 -- 172.21.15.179:0/973418432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc099c00 msgr2=0x7f41bc1f0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41bad9d700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc099c00 0x7f41bc1f0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41bad9d700 1 -- 172.21.15.179:0/973418432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41bc0cd020 msgr2=0x7f41bc0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41bad9d700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41bc0cd020 0x7f41bc0b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:20.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41bad9d700 1 -- 172.21.15.179:0/973418432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0009550 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41bad9d700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc15bde0 0x7f41bc0b4bc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f41b400cef0 tx=0x7f41b400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41aaffd700 1 -- 172.21.15.179:0/973418432 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b400ad00 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41aaffd700 1 -- 172.21.15.179:0/973418432 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b400ae60 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc15eb40 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41aaffd700 1 -- 172.21.15.179:0/973418432 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4015680 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.951+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc15d570 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.952+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc0685f0 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.953+0000 7f41aaffd700 1 -- 172.21.15.179:0/973418432 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41b400d430 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.953+0000 7f41aaffd700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f419c06aed0 0x7f419c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.953+0000 7f41aaffd700 1 -- 172.21.15.179:0/973418432 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f41b4089970 con 0x7f41bc15bde0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.953+0000 7f41ba59c700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f419c06aed0 0x7f419c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:20.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.953+0000 7f41ba59c700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f419c06aed0 0x7f419c06d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f41ac006fd0 tx=0x7f41ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:20.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:20.957+0000 7f41aaffd700 1 -- 172.21.15.179:0/973418432 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41b4054b50 con 0x7f41bc15bde0 2023-12-07T00:15:21.162 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.163+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f41bc0cbc60 con 0x7f41bc15bde0 2023-12-07T00:15:21.744 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.745+0000 7f41aaffd700 1 -- 172.21.15.179:0/973418432 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f41b4058170 con 0x7f41bc15bde0 2023-12-07T00:15:21.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f419c06aed0 msgr2=0x7f419c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:21.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f419c06aed0 0x7f419c06d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f41ac006fd0 tx=0x7f41ac008040 comp rx=0 tx=0).stop 2023-12-07T00:15:21.747 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc15bde0 msgr2=0x7f41bc0b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc15bde0 0x7f41bc0b4bc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f41b400cef0 tx=0x7f41b400cf20 comp rx=0 tx=0).stop 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 shutdown_connections 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f419c06aed0 0x7f419c06d390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f41bc15bde0 0x7f41bc0b4bc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41bc099c00 0x7f41bc1f0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 --2- 172.21.15.179:0/973418432 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f41bc0cd020 0x7f41bc0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 >> 172.21.15.179:0/973418432 conn(0x7f41bc0b3550 msgr2=0x7f41bc0b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 shutdown_connections 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.748+0000 7f41c0d68700 1 -- 172.21.15.179:0/973418432 wait complete. 2023-12-07T00:15:21.748 INFO:teuthology.orchestra.run.smithi179.stderr: removed all blocklist entries 2023-12-07T00:15:21.762 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-07T00:15:21.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.887+0000 7f8c9f451700 1 Processor -- start 2023-12-07T00:15:21.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.887+0000 7f8c9f451700 1 -- start start 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c9f451700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980b4470 0x7f8c980b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c9f451700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9815b8d0 con 0x7f8c98158560 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c9f451700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9815bbb0 con 0x7f8c980b2aa0 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c9f451700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980b2f30 con 0x7f8c980b4470 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c9d1ed700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f8c98158560 0x7f8c9815b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48022/0 (socket says 172.21.15.179:48022) 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c9d1ed700 1 -- 172.21.15.179:0/1208437500 learned_addr learned my addr 172.21.15.179:0/1208437500 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c9c9ec700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980b4470 0x7f8c980b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130756324 0 0) 0x7f8c9815b8d0 con 0x7f8c98158560 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.888+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c840035b0 con 0x7f8c98158560 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244999364 0 0) 0x7f8c9815bbb0 con 0x7f8c980b2aa0 2023-12-07T00:15:21.890 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c9815b8d0 con 0x7f8c980b2aa0 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 183585251 0 0) 0x7f8c840035b0 con 0x7f8c98158560 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980b4470 msgr2=0x7f8c980b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980b4470 0x7f8c980b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 >> v1:172.21.15.190:6789/0 conn(0x7f8c980b2aa0 legacy=0x7f8c980cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9815be90 con 0x7f8c98158560 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f8c94001670 con 0x7f8c98158560 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 >> v1:172.21.15.179:6789/0 conn(0x7f8c98158560 legacy=0x7f8c9815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c84003bc0 0x7f8c84003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980b4470 0x7f8c84004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:21.891 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c84004d90 0x7f8c84005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c980b2f30 con 0x7f8c84004d90 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8400dd60 con 0x7f8c84003bc0 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8400df20 con 0x7f8c980b4470 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9d9ee700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c84004d90 0x7f8c84005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9d1ed700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c84003bc0 0x7f8c84003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9c9ec700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980b4470 0x7f8c84004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9d9ee700 1 -- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980b4470 msgr2=0x7f8c84004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9d9ee700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980b4470 0x7f8c84004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9d9ee700 1 -- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c84003bc0 msgr2=0x7f8c84003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9d9ee700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c84003bc0 0x7f8c84003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9d9ee700 1 -- 172.21.15.179:0/1208437500 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c840035b0 con 0x7f8c84004d90 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c9d9ee700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c84004d90 0x7f8c84005210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000c2f0 tx=0x7f8c84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a34f433cc4dd4c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90001f30 con 0x7f8c84004d90 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9000ce90 con 0x7f8c84004d90 2023-12-07T00:15:21.892 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.889+0000 7f8c8ffff700 1 -- 172.21.15.179:0/1208437500 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c90003c40 con 0x7f8c84004d90 2023-12-07T00:15:21.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.890+0000 7f8c9f451700 1 -- 172.21.15.179:0/1208437500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c84004d90 msgr2=0x7f8c84005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:21.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.890+0000 7f8c9f451700 1 --2- 172.21.15.179:0/1208437500 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c84004d90 0x7f8c84005210 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000c2f0 tx=0x7f8c84005880 comp rx=0 tx=0).stop 2023-12-07T00:15:21.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.890+0000 7f8c9d9ee700 1 -- 172.21.15.179:0/1208437500 reap_dead start 2023-12-07T00:15:21.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.890+0000 7f8c9f451700 1 -- 172.21.15.179:0/1208437500 shutdown_connections 2023-12-07T00:15:21.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.890+0000 7f8c9f451700 1 -- 172.21.15.179:0/1208437500 >> 172.21.15.179:0/1208437500 conn(0x7f8c98072970 msgr2=0x7f8c98072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:21.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.890+0000 7f8c9f451700 1 -- 172.21.15.179:0/1208437500 shutdown_connections 2023-12-07T00:15:21.893 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.890+0000 7f8c9f451700 1 -- 172.21.15.179:0/1208437500 wait complete. 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.891+0000 7f8c9f451700 1 Processor -- start 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.891+0000 7f8c9f451700 1 -- start start 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9f451700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980cc1a0 0x7f8c9806b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9f451700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c980cc580 0x7f8c9806bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9f451700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c9814d130 0x7f8c9814d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9f451700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9814db20 con 0x7f8c980cc580 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9f451700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9814dd10 con 0x7f8c9814d130 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9f451700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9814fda0 con 0x7f8c980cc1a0 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9c9ec700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c980cc580 0x7f8c9806bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9c9ec700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c980cc580 0x7f8c9806bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41132/0 (socket says 172.21.15.179:41132) 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9c9ec700 1 -- 172.21.15.179:0/2113139479 learned_addr learned my addr 172.21.15.179:0/2113139479 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:21.896 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9d9ee700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c9814d130 0x7f8c9814d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9d1ed700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980cc1a0 0x7f8c9806b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9c9ec700 1 -- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980cc1a0 msgr2=0x7f8c9806b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9c9ec700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980cc1a0 0x7f8c9806b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9c9ec700 1 -- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c9814d130 msgr2=0x7f8c9814d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9c9ec700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c9814d130 0x7f8c9814d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.892+0000 7f8c9c9ec700 1 -- 172.21.15.179:0/2113139479 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98146bc0 con 0x7f8c980cc580 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.893+0000 7f8c9d1ed700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980cc1a0 0x7f8c9806b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.893+0000 7f8c9c9ec700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c980cc580 0x7f8c9806bec0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006d70 tx=0x7f8c88011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.893+0000 7f8c8dffb700 1 -- 172.21.15.179:0/2113139479 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c88009610 con 0x7f8c980cc580 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.893+0000 7f8c8dffb700 1 -- 172.21.15.179:0/2113139479 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8800f940 con 0x7f8c980cc580 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.893+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9814f470 con 0x7f8c980cc580 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.893+0000 7f8c8dffb700 1 -- 172.21.15.179:0/2113139479 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8800fcb0 con 0x7f8c980cc580 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.893+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9814fa30 con 0x7f8c980cc580 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.894+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9804f290 con 0x7f8c980cc580 2023-12-07T00:15:21.897 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.894+0000 7f8c8dffb700 1 -- 172.21.15.179:0/2113139479 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c88014440 con 0x7f8c980cc580 2023-12-07T00:15:21.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.895+0000 7f8c8dffb700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8c7c06aed0 0x7f8c7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:21.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.895+0000 7f8c8dffb700 1 -- 172.21.15.179:0/2113139479 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8c88089bd0 con 0x7f8c980cc580 2023-12-07T00:15:21.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.895+0000 7f8c9d1ed700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8c7c06aed0 0x7f8c7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:21.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.895+0000 7f8c9d1ed700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8c7c06aed0 0x7f8c7c06d390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8c940048d0 tx=0x7f8c94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:21.898 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:21.899+0000 7f8c8dffb700 1 -- 172.21.15.179:0/2113139479 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c88054f40 con 0x7f8c980cc580 2023-12-07T00:15:22.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.165+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8c9814fee0 con 0x7f8c980cc580 2023-12-07T00:15:22.164 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.165+0000 7f8c8dffb700 1 -- 172.21.15.179:0/2113139479 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f8c9814fee0 con 0x7f8c980cc580 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: "auth_dump": [ 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "mds.a", 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFld5XjAxAAlqLX0uQYwvZBYpYMTo3EHw==", 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow", 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow *", 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow *", 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.165 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "mds.b", 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFlFKKpEBAAkl0JSeCy+Z7iLNUte/Vvjw==", 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow", 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow *", 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow *", 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "mds.c", 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFlTjcvCxAAtTRPaO2uvSyimXKlQMUDkg==", 2023-12-07T00:15:22.166 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow", 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow *", 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow *", 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "mds.d", 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFlb1wtGBAAKubUS6ssVi5kfB8jgXmsIQ==", 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow", 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow *", 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow *", 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.167 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "osd.0", 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAeDnFlFOKQMxAAVDLsjaf7U2k1i1q/kPhjeQ==", 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow profile osd", 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile osd", 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "osd.1", 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAhDnFldWtfMxAAFOwl5PnLLTK54+f6HeU34A==", 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow profile osd", 2023-12-07T00:15:22.168 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile osd", 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "osd.2", 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAkDnFlNkpfMxAAIhNThQ08aTk4tgO8P41F4g==", 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow profile osd", 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile osd", 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "osd.3", 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAnDnFlWvq1MhAA/3JzOja4gfgLDwy+nL7ZAg==", 2023-12-07T00:15:22.169 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow profile osd", 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile osd", 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "osd.4", 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAtDnFleu69NxAAamp+tmZPubJThrYgLkfUsw==", 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow profile osd", 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile osd", 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "osd.5", 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAwDnFl5InnNhAAK8YoIMLt8RBrCwwqpNTaow==", 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow profile osd", 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile osd", 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.171 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "osd.6", 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAzDnFlBTq9NRAA9vh72E53jrag9B3dSqh5bQ==", 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow profile osd", 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile osd", 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "osd.7", 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQA2DnFlfOZkNRAABid8AKmAAc/EZzAKkxGizA==", 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.172 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow profile osd", 2023-12-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile osd", 2023-12-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.173 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.0", 2023-12-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFlnRJ6HBAAOpJ30jTvFKlEPFblPq5rqw==", 2023-12-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow", 2023-12-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow r", 2023-12-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow rw", 2023-12-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow rwx" 2023-12-07T00:15:22.174 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.1", 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFlY9WVJRAA870McClSUyFaixZlLOrU1g==", 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow", 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow r", 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow rw", 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow rwx" 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.175 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.2", 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFlDlMzIhAAbU5WOXOCAdz/7d0g3Bleqg==", 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow", 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow r", 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow rw", 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow rwx" 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.3", 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFl+orcKBAAhLwNbSVBe06hzrBTz8Uibw==", 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow", 2023-12-07T00:15:22.176 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow r", 2023-12-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow rw", 2023-12-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow rwx" 2023-12-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.admin", 2023-12-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA==", 2023-12-07T00:15:22.177 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow *", 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "mgr": "allow *", 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow *", 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.bootstrap-mds", 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQA8DnFlvlFVMhAAR60QrywWIy0D0sORGn8GPw==", 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile bootstrap-mds" 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.178 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.bootstrap-mgr", 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQA8DnFlcFpVMhAAUmY09oGn7RDBXqozzfcE4g==", 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.bootstrap-osd", 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQA8DnFlkGFVMhAAW8iUl9Gi2YAR9Lgce6yiiw==", 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile bootstrap-osd" 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.179 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.bootstrap-rbd", 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQA8DnFl0mlVMhAAmVNsjpl6gCZy5tLxS4apRw==", 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQA8DnFlxrRVMhAACTQy2+Pxyuxv6KED3y6Paw==", 2023-12-07T00:15:22.180 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "client.bootstrap-rgw", 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQA8DnFl5rxVMhAAqDyn2zUEYRly7g27bjhB2Q==", 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "mgr.x", 2023-12-07T00:15:22.181 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAbDnFloxCIABAAc0WOAHsl0kdfalbJVSbfbQ==", 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow *", 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile mgr", 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: }, 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "entity": "mgr.y", 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "key": "AQAaDnFlb5e4LxAA8WhAU9WVKoKrw5QAkIK2og==", 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "caps": { 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "mds": "allow *", 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "mon": "allow profile mgr", 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: "osd": "allow *" 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.182 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:22.183 INFO:teuthology.orchestra.run.smithi179.stdout: ] 2023-12-07T00:15:22.183 INFO:teuthology.orchestra.run.smithi179.stdout:} 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8c7c06aed0 msgr2=0x7f8c7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8c7c06aed0 0x7f8c7c06d390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8c940048d0 tx=0x7f8c94009040 comp rx=0 tx=0).stop 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c980cc580 msgr2=0x7f8c9806bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c980cc580 0x7f8c9806bec0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8c88006d70 tx=0x7f8c88011d50 comp rx=0 tx=0).stop 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 shutdown_connections 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f8c7c06aed0 0x7f8c7c06d390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8c9814d130 0x7f8c9814d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8c980cc1a0 0x7f8c9806b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 --2- 172.21.15.179:0/2113139479 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8c980cc580 0x7f8c9806bec0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.188 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 >> 172.21.15.179:0/2113139479 conn(0x7f8c98072970 msgr2=0x7f8c980cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:22.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 shutdown_connections 2023-12-07T00:15:22.189 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.168+0000 7f8c9f451700 1 -- 172.21.15.179:0/2113139479 wait complete. 2023-12-07T00:15:22.189 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-07T00:15:22.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.312+0000 7fcb77c07700 1 Processor -- start 2023-12-07T00:15:22.311 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.312+0000 7fcb77c07700 1 -- start start 2023-12-07T00:15:22.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb77c07700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015e220 0x7fcb700b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.312 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb77c07700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb700b2aa0 0x7fcb7015f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb77c07700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7015f330 con 0x7fcb7015de40 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb77c07700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb700d1820 con 0x7fcb700b2aa0 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb77c07700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb700b2f10 con 0x7fcb7015e220 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb761a4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb700b2aa0 0x7fcb7015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb761a4700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb700b2aa0 0x7fcb7015f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41144/0 (socket says 172.21.15.179:41144) 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb761a4700 1 -- 172.21.15.179:0/2198186569 learned_addr learned my addr 172.21.15.179:0/2198186569 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb761a4700 1 -- 172.21.15.179:0/2198186569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015e220 msgr2=0x7fcb700b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb761a4700 1 --2- 172.21.15.179:0/2198186569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015e220 0x7fcb700b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb761a4700 1 -- 172.21.15.179:0/2198186569 >> v1:172.21.15.190:6789/0 conn(0x7fcb7015de40 legacy=0x7fcb700b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb761a4700 1 -- 172.21.15.179:0/2198186569 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7015e720 con 0x7fcb700b2aa0 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb761a4700 1 --2- 172.21.15.179:0/2198186569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb700b2aa0 0x7fcb7015f870 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009e80 tx=0x7fcb6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133c76017fdd3651 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb749a1700 1 -- 172.21.15.179:0/2198186569 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800e070 con 0x7fcb700b2aa0 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb749a1700 1 -- 172.21.15.179:0/2198186569 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb68003a20 con 0x7fcb700b2aa0 2023-12-07T00:15:22.313 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.313+0000 7fcb749a1700 1 -- 172.21.15.179:0/2198186569 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68003dd0 con 0x7fcb700b2aa0 2023-12-07T00:15:22.314 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.314+0000 7fcb77c07700 1 -- 172.21.15.179:0/2198186569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb700b2aa0 msgr2=0x7fcb7015f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.314+0000 7fcb77c07700 1 --2- 172.21.15.179:0/2198186569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb700b2aa0 0x7fcb7015f870 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcb68009e80 tx=0x7fcb6800b330 comp rx=0 tx=0).stop 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.314+0000 7fcb77c07700 1 -- 172.21.15.179:0/2198186569 shutdown_connections 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.314+0000 7fcb77c07700 1 --2- 172.21.15.179:0/2198186569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb700b2aa0 0x7fcb7015f870 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.314+0000 7fcb77c07700 1 --2- 172.21.15.179:0/2198186569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015e220 0x7fcb700b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.314+0000 7fcb77c07700 1 -- 172.21.15.179:0/2198186569 >> 172.21.15.179:0/2198186569 conn(0x7fcb70072970 msgr2=0x7fcb70072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.314+0000 7fcb77c07700 1 -- 172.21.15.179:0/2198186569 shutdown_connections 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.314+0000 7fcb77c07700 1 -- 172.21.15.179:0/2198186569 wait complete. 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.316+0000 7fcb77c07700 1 Processor -- start 2023-12-07T00:15:22.315 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.316+0000 7fcb77c07700 1 -- start start 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.316+0000 7fcb77c07700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb700b2aa0 0x7fcb7015a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb77c07700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015de40 0x7fcb70153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb77c07700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7015e220 0x7fcb70155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb77c07700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7015a740 con 0x7fcb7015e220 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb77c07700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb70154a90 con 0x7fcb700b2aa0 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb77c07700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb70154d70 con 0x7fcb7015de40 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7015e220 0x7fcb70155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7015e220 0x7fcb70155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41150/0 (socket says 172.21.15.179:41150) 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 -- 172.21.15.179:0/864106833 learned_addr learned my addr 172.21.15.179:0/864106833 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb759a3700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb700b2aa0 0x7fcb7015a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb751a2700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015de40 0x7fcb70153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.319 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 -- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015de40 msgr2=0x7fcb70153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015de40 0x7fcb70153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 -- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb700b2aa0 msgr2=0x7fcb7015a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb700b2aa0 0x7fcb7015a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 -- 172.21.15.179:0/864106833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68009b30 con 0x7fcb7015e220 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb759a3700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb700b2aa0 0x7fcb7015a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb761a4700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7015e220 0x7fcb70155b30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcb70072210 tx=0x7fcb68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb667fc700 1 -- 172.21.15.179:0/864106833 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68004240 con 0x7fcb7015e220 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb667fc700 1 -- 172.21.15.179:0/864106833 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb680043c0 con 0x7fcb7015e220 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb667fc700 1 -- 172.21.15.179:0/864106833 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb68004770 con 0x7fcb7015e220 2023-12-07T00:15:22.320 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb70155050 con 0x7fcb7015e220 2023-12-07T00:15:22.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.317+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb70155610 con 0x7fcb7015e220 2023-12-07T00:15:22.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.318+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7004f290 con 0x7fcb7015e220 2023-12-07T00:15:22.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.319+0000 7fcb667fc700 1 -- 172.21.15.179:0/864106833 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb68019070 con 0x7fcb7015e220 2023-12-07T00:15:22.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.319+0000 7fcb667fc700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcb5406aed0 0x7fcb5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.319+0000 7fcb667fc700 1 -- 172.21.15.179:0/864106833 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcb6808a3c0 con 0x7fcb7015e220 2023-12-07T00:15:22.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.319+0000 7fcb759a3700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcb5406aed0 0x7fcb5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.321 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.320+0000 7fcb759a3700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcb5406aed0 0x7fcb5406d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c003f40 tx=0x7fcb6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:22.323 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.324+0000 7fcb667fc700 1 -- 172.21.15.179:0/864106833 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb68055710 con 0x7fcb7015e220 2023-12-07T00:15:22.590 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.591+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fcb700685f0 con 0x7fcb7015e220 2023-12-07T00:15:22.592 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.593+0000 7fcb667fc700 1 -- 172.21.15.179:0/864106833 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcb68058d30 con 0x7fcb7015e220 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcb5406aed0 msgr2=0x7fcb5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcb5406aed0 0x7fcb5406d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c003f40 tx=0x7fcb6c009040 comp rx=0 tx=0).stop 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7015e220 msgr2=0x7fcb70155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7015e220 0x7fcb70155b30 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcb70072210 tx=0x7fcb68004ad0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 shutdown_connections 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcb5406aed0 0x7fcb5406d390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb7015e220 0x7fcb70155b30 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcb700b2aa0 0x7fcb7015a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 --2- 172.21.15.179:0/864106833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcb7015de40 0x7fcb70153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 >> 172.21.15.179:0/864106833 conn(0x7fcb70072970 msgr2=0x7fcb7006c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 shutdown_connections 2023-12-07T00:15:22.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.595+0000 7fcb77c07700 1 -- 172.21.15.179:0/864106833 wait complete. 2023-12-07T00:15:22.607 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-07T00:15:22.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.729+0000 7fcbfcdc2700 1 Processor -- start 2023-12-07T00:15:22.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.729+0000 7fcbfcdc2700 1 -- start start 2023-12-07T00:15:22.731 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbfcdc2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcbf80d06b0 0x7fcbf8099c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.731 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbfcdc2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcbf809a140 0x7fcbf80b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.731 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbfcdc2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf809a550 con 0x7fcbf815bde0 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbfcdc2700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf809ab50 con 0x7fcbf809a140 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbfcdc2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf80cf630 con 0x7fcbf80d06b0 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf6d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcbf809a140 0x7fcbf80b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf6d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcbf809a140 0x7fcbf80b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41158/0 (socket says 172.21.15.179:41158) 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf6d9d700 1 -- 172.21.15.179:0/3043095837 learned_addr learned my addr 172.21.15.179:0/3043095837 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf5d9b700 1 --2- 172.21.15.179:0/3043095837 >> v2:172.21.15.190:3300/0 conn(0x7fcbf80d06b0 0x7fcbf8099c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf6d9d700 1 -- 172.21.15.179:0/3043095837 >> v2:172.21.15.190:3300/0 conn(0x7fcbf80d06b0 msgr2=0x7fcbf8099c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf6d9d700 1 --2- 172.21.15.179:0/3043095837 >> v2:172.21.15.190:3300/0 conn(0x7fcbf80d06b0 0x7fcbf8099c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf6d9d700 1 -- 172.21.15.179:0/3043095837 >> v1:172.21.15.190:6789/0 conn(0x7fcbf815bde0 legacy=0x7fcbf80cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf6d9d700 1 -- 172.21.15.179:0/3043095837 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf80cf8f0 con 0x7fcbf809a140 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf6d9d700 1 --2- 172.21.15.179:0/3043095837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf809a140 0x7fcbf80b1230 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80b4100 tx=0x7fcbf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d5b62a01ffd5d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf559a700 1 -- 172.21.15.179:0/3043095837 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000e070 con 0x7fcbf809a140 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf559a700 1 -- 172.21.15.179:0/3043095837 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf000b910 con 0x7fcbf809a140 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.731+0000 7fcbf559a700 1 -- 172.21.15.179:0/3043095837 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000bcc0 con 0x7fcbf809a140 2023-12-07T00:15:22.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.732+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3043095837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf809a140 msgr2=0x7fcbf80b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.732+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3043095837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf809a140 0x7fcbf80b1230 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80b4100 tx=0x7fcbf000b330 comp rx=0 tx=0).stop 2023-12-07T00:15:22.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.732+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3043095837 shutdown_connections 2023-12-07T00:15:22.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.732+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3043095837 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf809a140 0x7fcbf80b1230 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.732+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3043095837 >> v2:172.21.15.190:3300/0 conn(0x7fcbf80d06b0 0x7fcbf8099c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.732+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3043095837 >> 172.21.15.179:0/3043095837 conn(0x7fcbf80b3550 msgr2=0x7fcbf80b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:22.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.732+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3043095837 shutdown_connections 2023-12-07T00:15:22.733 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.732+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3043095837 wait complete. 2023-12-07T00:15:22.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.733+0000 7fcbfcdc2700 1 Processor -- start 2023-12-07T00:15:22.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.733+0000 7fcbfcdc2700 1 -- start start 2023-12-07T00:15:22.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbfcdc2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf809a140 0x7fcbf80b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbfcdc2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf80d06b0 0x7fcbf81554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbfcdc2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf815bde0 0x7fcbf806da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.736 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbfcdc2700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf8156630 con 0x7fcbf815bde0 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbfcdc2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf815d5e0 con 0x7fcbf80d06b0 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbfcdc2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf80b6a20 con 0x7fcbf809a140 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbf6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf815bde0 0x7fcbf806da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbf6d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf815bde0 0x7fcbf806da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41164/0 (socket says 172.21.15.179:41164) 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbf6d9d700 1 -- 172.21.15.179:0/3979539290 learned_addr learned my addr 172.21.15.179:0/3979539290 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbf659c700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf809a140 0x7fcbf80b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.734+0000 7fcbf5d9b700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf80d06b0 0x7fcbf81554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbf6d9d700 1 -- 172.21.15.179:0/3979539290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf809a140 msgr2=0x7fcbf80b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbf6d9d700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf809a140 0x7fcbf80b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbf6d9d700 1 -- 172.21.15.179:0/3979539290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf80d06b0 msgr2=0x7fcbf81554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbf6d9d700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf80d06b0 0x7fcbf81554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbf6d9d700 1 -- 172.21.15.179:0/3979539290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0009b30 con 0x7fcbf815bde0 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbf6d9d700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf815bde0 0x7fcbf806da40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80732c0 tx=0x7fcbf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:22.737 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbe6ffd700 1 -- 172.21.15.179:0/3979539290 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0004880 con 0x7fcbf815bde0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbe6ffd700 1 -- 172.21.15.179:0/3979539290 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf00099b0 con 0x7fcbf815bde0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf80b6d00 con 0x7fcbf815bde0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbe6ffd700 1 -- 172.21.15.179:0/3979539290 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf001b670 con 0x7fcbf815bde0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.735+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf8155a30 con 0x7fcbf815bde0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.736+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf815d3b0 con 0x7fcbf815bde0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.736+0000 7fcbe6ffd700 1 -- 172.21.15.179:0/3979539290 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbf001b7d0 con 0x7fcbf815bde0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.736+0000 7fcbe6ffd700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcbd806aed0 0x7fcbd806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.737+0000 7fcbe6ffd700 1 -- 172.21.15.179:0/3979539290 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcbf008ab50 con 0x7fcbf815bde0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.737+0000 7fcbf659c700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcbd806aed0 0x7fcbd806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:22.738 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.737+0000 7fcbf659c700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcbd806aed0 0x7fcbd806d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcbec007fd0 tx=0x7fcbec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:22.740 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:22.741+0000 7fcbe6ffd700 1 -- 172.21.15.179:0/3979539290 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbf815d3b0 con 0x7fcbf815bde0 2023-12-07T00:15:23.010 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.011+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fcbf815d750 con 0x7fcbf815bde0 2023-12-07T00:15:23.014 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.015+0000 7fcbe6ffd700 1 -- 172.21.15.179:0/3979539290 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcbf815d750 con 0x7fcbf815bde0 2023-12-07T00:15:23.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.017+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcbd806aed0 msgr2=0x7fcbd806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.017+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcbd806aed0 0x7fcbd806d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fcbec007fd0 tx=0x7fcbec009040 comp rx=0 tx=0).stop 2023-12-07T00:15:23.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.017+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf815bde0 msgr2=0x7fcbf806da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.017+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf815bde0 0x7fcbf806da40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80732c0 tx=0x7fcbf0004ad0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.018+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 shutdown_connections 2023-12-07T00:15:23.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.018+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcbd806aed0 0x7fcbd806d390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.018+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcbf815bde0 0x7fcbf806da40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.017 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.018+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbf809a140 0x7fcbf80b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.018+0000 7fcbfcdc2700 1 --2- 172.21.15.179:0/3979539290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbf80d06b0 0x7fcbf81554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.018+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 >> 172.21.15.179:0/3979539290 conn(0x7fcbf80b3550 msgr2=0x7fcbf80ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:23.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.018+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 shutdown_connections 2023-12-07T00:15:23.018 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.018+0000 7fcbfcdc2700 1 -- 172.21.15.179:0/3979539290 wait complete. 2023-12-07T00:15:23.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-07T00:15:23.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.151+0000 7fd005a88700 1 Processor -- start 2023-12-07T00:15:23.150 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.151+0000 7fd005a88700 1 -- start start 2023-12-07T00:15:23.154 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fd005a88700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd00015e220 0x7fd0000b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.154 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fd005a88700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd00015f330 con 0x7fd00015de40 2023-12-07T00:15:23.154 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fd005a88700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0000b2ed0 con 0x7fd0000b2aa0 2023-12-07T00:15:23.154 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fd005a88700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0000d1820 con 0x7fd00015e220 2023-12-07T00:15:23.154 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcfff7fe700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fd00015de40 0x7fd0000b46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48072/0 (socket says 172.21.15.179:48072) 2023-12-07T00:15:23.154 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcfff7fe700 1 -- 172.21.15.179:0/1965979928 learned_addr learned my addr 172.21.15.179:0/1965979928 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:23.154 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139266336 0 0) 0x7fd00015f330 con 0x7fd00015de40 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe80035b0 con 0x7fd00015de40 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffeffd700 1 --2- 172.21.15.179:0/1965979928 >> v2:172.21.15.190:3300/0 conn(0x7fd00015e220 0x7fd0000b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1918271425 0 0) 0x7fcfe80035b0 con 0x7fd00015de40 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 >> v2:172.21.15.190:3300/0 conn(0x7fd00015e220 msgr2=0x7fd0000b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 --2- 172.21.15.179:0/1965979928 >> v2:172.21.15.190:3300/0 conn(0x7fd00015e220 0x7fd0000b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 >> v1:172.21.15.190:6789/0 conn(0x7fd0000b2aa0 legacy=0x7fd00015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00015e720 con 0x7fd00015de40 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fcff4001670 con 0x7fd00015de40 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 >> v1:172.21.15.179:6789/0 conn(0x7fd00015de40 legacy=0x7fd0000b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8003a00 0x7fcfe8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe8004850 0x7fcfe8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfe8005210 0x7fcfe800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe800c080 con 0x7fcfe8004850 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe800c1f0 con 0x7fcfe8003a00 2023-12-07T00:15:23.155 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.152+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe800c3b0 con 0x7fcfe8005210 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffeffd700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe8004850 0x7fcfe8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcfff7fe700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8003a00 0x7fcfe8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffffff700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfe8005210 0x7fcfe800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffeffd700 1 -- 172.21.15.179:0/1965979928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfe8005210 msgr2=0x7fcfe800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffeffd700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfe8005210 0x7fcfe800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffeffd700 1 -- 172.21.15.179:0/1965979928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8003a00 msgr2=0x7fcfe8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffeffd700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8003a00 0x7fcfe8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffffff700 1 -- 172.21.15.179:0/1965979928 reap_dead start 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffeffd700 1 -- 172.21.15.179:0/1965979928 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80035b0 con 0x7fcfe8004850 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffeffd700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe8004850 0x7fcfe8004cd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009b10 tx=0x7fcfe8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0f36bad968d9b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff0005a20 con 0x7fcfe8004850 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff0005b80 con 0x7fcfe8004850 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.153+0000 7fcffe7fc700 1 -- 172.21.15.179:0/1965979928 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff000e6c0 con 0x7fcfe8004850 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.154+0000 7fd005a88700 1 -- 172.21.15.179:0/1965979928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe8004850 msgr2=0x7fcfe8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.156 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.154+0000 7fd005a88700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe8004850 0x7fcfe8004cd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcff0009b10 tx=0x7fcfe8005880 comp rx=0 tx=0).stop 2023-12-07T00:15:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.154+0000 7fd005a88700 1 -- 172.21.15.179:0/1965979928 shutdown_connections 2023-12-07T00:15:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.154+0000 7fd005a88700 1 --2- 172.21.15.179:0/1965979928 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcfe8004850 0x7fcfe8004cd0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.154+0000 7fd005a88700 1 -- 172.21.15.179:0/1965979928 >> 172.21.15.179:0/1965979928 conn(0x7fd000072970 msgr2=0x7fd000072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.154+0000 7fd005a88700 1 -- 172.21.15.179:0/1965979928 shutdown_connections 2023-12-07T00:15:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.154+0000 7fd005a88700 1 -- 172.21.15.179:0/1965979928 wait complete. 2023-12-07T00:15:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.155+0000 7fd005a88700 1 Processor -- start 2023-12-07T00:15:23.157 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.155+0000 7fd005a88700 1 -- start start 2023-12-07T00:15:23.159 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fd005a88700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8004850 0x7fd0001f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fd005a88700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd00014ee20 0x7fd0000adf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fd005a88700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0000ae480 0x7fd000150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fd005a88700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0000ae900 con 0x7fd0000ae480 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fd005a88700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd000151e10 con 0x7fcfe8004850 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fd005a88700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd000151b30 con 0x7fd00014ee20 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0000ae480 0x7fd000150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0000ae480 0x7fd000150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41186/0 (socket says 172.21.15.179:41186) 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 -- 172.21.15.179:0/3417351716 learned_addr learned my addr 172.21.15.179:0/3417351716 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffeffd700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd00014ee20 0x7fd0000adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcfff7fe700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8004850 0x7fd0001f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 -- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd00014ee20 msgr2=0x7fd0000adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd00014ee20 0x7fd0000adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 -- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8004850 msgr2=0x7fd0001f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8004850 0x7fd0001f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.160 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 -- 172.21.15.179:0/3417351716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0000a8a30 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffeffd700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd00014ee20 0x7fd0000adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcfff7fe700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8004850 0x7fd0001f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcffffff700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0000ae480 0x7fd000150eb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd0000b53c0 tx=0x7fcff800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcfe7fff700 1 -- 172.21.15.179:0/3417351716 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8003c10 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcfe7fff700 1 -- 172.21.15.179:0/3417351716 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff8003d70 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fcfe7fff700 1 -- 172.21.15.179:0/3417351716 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8005310 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.156+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0000a8d10 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.157+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0001f10b0 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.157+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd00004f290 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.158+0000 7fcfe7fff700 1 -- 172.21.15.179:0/3417351716 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcff8005470 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.158+0000 7fcfe7fff700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcfec06aed0 0x7fcfec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.158+0000 7fcfe7fff700 1 -- 172.21.15.179:0/3417351716 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcff80892f0 con 0x7fd0000ae480 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.158+0000 7fcfff7fe700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcfec06aed0 0x7fcfec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.161 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.159+0000 7fcfff7fe700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcfec06aed0 0x7fcfec06d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd000064cc0 tx=0x7fcff4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:23.162 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.163+0000 7fcfe7fff700 1 -- 172.21.15.179:0/3417351716 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcff8054640 con 0x7fd0000ae480 2023-12-07T00:15:23.429 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.430+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fd0000685f0 con 0x7fd0000ae480 2023-12-07T00:15:23.433 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.434+0000 7fcfe7fff700 1 -- 172.21.15.179:0/3417351716 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcff801a310 con 0x7fd0000ae480 2023-12-07T00:15:23.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcfec06aed0 msgr2=0x7fcfec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.435 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcfec06aed0 0x7fcfec06d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd000064cc0 tx=0x7fcff4009040 comp rx=0 tx=0).stop 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0000ae480 msgr2=0x7fd000150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0000ae480 0x7fd000150eb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fd0000b53c0 tx=0x7fcff800ee80 comp rx=0 tx=0).stop 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 shutdown_connections 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fcfec06aed0 0x7fcfec06d390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd0000ae480 0x7fd000150eb0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfe8004850 0x7fd0001f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 --2- 172.21.15.179:0/3417351716 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd00014ee20 0x7fd0000adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 >> 172.21.15.179:0/3417351716 conn(0x7fd000072970 msgr2=0x7fd00006c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 shutdown_connections 2023-12-07T00:15:23.436 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.436+0000 7fd005a88700 1 -- 172.21.15.179:0/3417351716 wait complete. 2023-12-07T00:15:23.448 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-07T00:15:23.568 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.569+0000 7f5783f57700 1 Processor -- start 2023-12-07T00:15:23.569 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.569+0000 7f5783f57700 1 -- start start 2023-12-07T00:15:23.571 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f5783f57700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f577c155ff0 0x7f577c160250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f5783f57700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f577c0cdd50 0x7f577c0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f5783f57700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 0x7f577c15c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f5783f57700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c0ce720 con 0x7f577c0cdd50 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f5783f57700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577c06f890 con 0x7f577c155ff0 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f5783f57700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c15fdc0 con 0x7f577c15c090 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f57814f2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f577c0cdd50 0x7f577c0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f57814f2700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f577c0cdd50 0x7f577c0ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41190/0 (socket says 172.21.15.179:41190) 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.570+0000 7f57814f2700 1 -- 172.21.15.179:0/1928246997 learned_addr learned my addr 172.21.15.179:0/1928246997 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f5781cf3700 1 --2- 172.21.15.179:0/1928246997 >> v2:172.21.15.190:3300/0 conn(0x7f577c155ff0 0x7f577c160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f57824f4700 1 --2- 172.21.15.179:0/1928246997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 0x7f577c15c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f57814f2700 1 -- 172.21.15.179:0/1928246997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 msgr2=0x7f577c15c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:23.572 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f57814f2700 1 --2- 172.21.15.179:0/1928246997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 0x7f577c15c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f57814f2700 1 -- 172.21.15.179:0/1928246997 >> v2:172.21.15.190:3300/0 conn(0x7f577c155ff0 msgr2=0x7f577c160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f57814f2700 1 --2- 172.21.15.179:0/1928246997 >> v2:172.21.15.190:3300/0 conn(0x7f577c155ff0 0x7f577c160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f57814f2700 1 -- 172.21.15.179:0/1928246997 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c15cd30 con 0x7f577c0cdd50 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f5781cf3700 1 --2- 172.21.15.179:0/1928246997 >> v2:172.21.15.190:3300/0 conn(0x7f577c155ff0 0x7f577c160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f57814f2700 1 --2- 172.21.15.179:0/1928246997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c0ce1e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f577c06bfd0 tx=0x7f5778009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af92f356f3029d6f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f5780cf1700 1 -- 172.21.15.179:0/1928246997 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778005e30 con 0x7f577c0cdd50 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f5780cf1700 1 -- 172.21.15.179:0/1928246997 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5778004030 con 0x7f577c0cdd50 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f5780cf1700 1 -- 172.21.15.179:0/1928246997 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57780043e0 con 0x7f577c0cdd50 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f5783f57700 1 -- 172.21.15.179:0/1928246997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 msgr2=0x7f577c0ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.571+0000 7f5783f57700 1 --2- 172.21.15.179:0/1928246997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c0ce1e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f577c06bfd0 tx=0x7f5778009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.572+0000 7f5783f57700 1 -- 172.21.15.179:0/1928246997 shutdown_connections 2023-12-07T00:15:23.573 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.572+0000 7f5783f57700 1 --2- 172.21.15.179:0/1928246997 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 0x7f577c15c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.572+0000 7f5783f57700 1 --2- 172.21.15.179:0/1928246997 >> v2:172.21.15.190:3300/0 conn(0x7f577c155ff0 0x7f577c160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.572+0000 7f5783f57700 1 --2- 172.21.15.179:0/1928246997 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c0ce1e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.572+0000 7f5783f57700 1 -- 172.21.15.179:0/1928246997 >> 172.21.15.179:0/1928246997 conn(0x7f577c072970 msgr2=0x7f577c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:23.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.572+0000 7f5783f57700 1 -- 172.21.15.179:0/1928246997 shutdown_connections 2023-12-07T00:15:23.574 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.572+0000 7f5783f57700 1 -- 172.21.15.179:0/1928246997 wait complete. 2023-12-07T00:15:23.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.573+0000 7f5783f57700 1 Processor -- start 2023-12-07T00:15:23.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.573+0000 7f5783f57700 1 -- start start 2023-12-07T00:15:23.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5783f57700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.577 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5783f57700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577c155ff0 0x7f577c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5783f57700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 0x7f577c158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5783f57700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c1493e0 con 0x7f577c0cdd50 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5783f57700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577c146ca0 con 0x7f577c155ff0 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5783f57700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577c147be0 con 0x7f577c15c090 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c146760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41196/0 (socket says 172.21.15.179:41196) 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 -- 172.21.15.179:0/1849661507 learned_addr learned my addr 172.21.15.179:0/1849661507 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f57824f4700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 0x7f577c158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f57814f2700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577c155ff0 0x7f577c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 -- 172.21.15.179:0/1849661507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 msgr2=0x7f577c158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 0x7f577c158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.578 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 -- 172.21.15.179:0/1849661507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577c155ff0 msgr2=0x7f577c1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577c155ff0 0x7f577c1585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 -- 172.21.15.179:0/1849661507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5778009500 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.574+0000 7f5781cf3700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c146760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c7f0 tx=0x7f576c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.575+0000 7f57727fc700 1 -- 172.21.15.179:0/1849661507 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c011800 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.575+0000 7f57727fc700 1 -- 172.21.15.179:0/1849661507 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c011960 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.575+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577c147ec0 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.575+0000 7f57727fc700 1 -- 172.21.15.179:0/1849661507 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c011d10 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.575+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577c148480 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.575+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c04f290 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.576+0000 7f57727fc700 1 -- 172.21.15.179:0/1849661507 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f576c018360 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.576+0000 7f57727fc700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f576006aed0 0x7f576006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.576+0000 7f57727fc700 1 -- 172.21.15.179:0/1849661507 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f576c0893b0 con 0x7f577c0cdd50 2023-12-07T00:15:23.579 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.576+0000 7f57814f2700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f576006aed0 0x7f576006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.577+0000 7f57814f2700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f576006aed0 0x7f576006d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f577c06bfd0 tx=0x7f5778008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:23.580 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.581+0000 7f57727fc700 1 -- 172.21.15.179:0/1849661507 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f576c0545e0 con 0x7f577c0cdd50 2023-12-07T00:15:23.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.851+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f577c0685f0 con 0x7f577c0cdd50 2023-12-07T00:15:23.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.855+0000 7f57727fc700 1 -- 172.21.15.179:0/1849661507 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f576c057c00 con 0x7f577c0cdd50 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f576006aed0 msgr2=0x7f576006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f576006aed0 0x7f576006d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f577c06bfd0 tx=0x7f5778008070 comp rx=0 tx=0).stop 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 msgr2=0x7f577c146760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c146760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f576c00c7f0 tx=0x7f576c00cbb0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 shutdown_connections 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f576006aed0 0x7f576006d390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f577c15c090 0x7f577c158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f577c0cdd50 0x7f577c146760 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 --2- 172.21.15.179:0/1849661507 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f577c155ff0 0x7f577c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 >> 172.21.15.179:0/1849661507 conn(0x7f577c072970 msgr2=0x7f577c0cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:23.857 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.857+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 shutdown_connections 2023-12-07T00:15:23.858 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.858+0000 7f5783f57700 1 -- 172.21.15.179:0/1849661507 wait complete. 2023-12-07T00:15:23.869 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-07T00:15:23.990 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.991+0000 7f9dd19bc700 1 Processor -- start 2023-12-07T00:15:23.990 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.991+0000 7f9dd19bc700 1 -- start start 2023-12-07T00:15:23.996 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dd19bc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 0x7f9dcc168d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dd19bc700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc162920 con 0x7f9dcc0b98b0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dd19bc700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc162360 con 0x7f9dcc15dee0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dd19bc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0d21d0 con 0x7f9dcc0cf0d0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dc3fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9dcc0b98b0 0x7f9dcc0ce9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48106/0 (socket says 172.21.15.179:48106) 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dc3fff700 1 -- 172.21.15.179:0/2051566279 learned_addr learned my addr 172.21.15.179:0/2051566279 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dcb7fe700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 0x7f9dcc168d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571684922 0 0) 0x7f9dcc162920 con 0x7f9dcc0b98b0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db80035b0 con 0x7f9dcc0b98b0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.992+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491146433 0 0) 0x7f9dcc162360 con 0x7f9dcc15dee0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dcc162920 con 0x7f9dcc15dee0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3129094280 0 0) 0x7f9db80035b0 con 0x7f9dcc0b98b0 2023-12-07T00:15:23.997 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 msgr2=0x7f9dcc168d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 0x7f9dcc168d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 >> v1:172.21.15.190:6789/0 conn(0x7f9dcc15dee0 legacy=0x7f9dcc161a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc162640 con 0x7f9dcc0b98b0 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f9db4001670 con 0x7f9dcc0b98b0 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 >> v1:172.21.15.179:6789/0 conn(0x7f9dcc0b98b0 legacy=0x7f9dcc0ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 0x7f9db8003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9db8004170 0x7f9db8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9db8004d90 0x7f9db8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0d21d0 con 0x7f9db8004170 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db800bbd0 con 0x7f9db8004d90 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db800bd90 con 0x7f9dcc0cf0d0 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dc3fff700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9db8004170 0x7f9db8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.998 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dcaffd700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 0x7f9db8003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dcb7fe700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9db8004d90 0x7f9db8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dc3fff700 1 -- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 msgr2=0x7f9db8003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dc3fff700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 0x7f9db8003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dc3fff700 1 -- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9db8004d90 msgr2=0x7f9db8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dc3fff700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9db8004d90 0x7f9db8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dc3fff700 1 -- 172.21.15.179:0/2051566279 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80035b0 con 0x7f9db8004170 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dcb7fe700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9db8004d90 0x7f9db8005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dcaffd700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9dcc0cf0d0 0x7f9db8003bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dc3fff700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9db8004170 0x7f9db8004850 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9db400c160 tx=0x7f9db8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5906e8e047f854 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400cca0 con 0x7f9db8004170 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db400ce20 con 0x7f9db8004170 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.993+0000 7f9dca7fc700 1 -- 172.21.15.179:0/2051566279 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4005ba0 con 0x7f9db8004170 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.994+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2051566279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9db8004170 msgr2=0x7f9db8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:23.999 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.994+0000 7f9dd19bc700 1 --2- 172.21.15.179:0/2051566279 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9db8004170 0x7f9db8004850 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9db400c160 tx=0x7f9db8005880 comp rx=0 tx=0).stop 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.994+0000 7f9dcb7fe700 1 -- 172.21.15.179:0/2051566279 reap_dead start 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.994+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2051566279 shutdown_connections 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.994+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2051566279 >> 172.21.15.179:0/2051566279 conn(0x7f9dcc06c9e0 msgr2=0x7f9dcc06cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.994+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2051566279 shutdown_connections 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.994+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2051566279 wait complete. 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.995+0000 7f9dd19bc700 1 Processor -- start 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.995+0000 7f9dd19bc700 1 -- start start 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dd19bc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9db8004170 0x7f9dcc15b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dd19bc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dcc0b6d50 0x7f9dcc0b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dd19bc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc0cbf40 0x7f9dcc0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dd19bc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0b7710 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dd19bc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0acb90 con 0x7f9dcc0b6d50 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dd19bc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0ccca0 con 0x7f9db8004170 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc0cbf40 0x7f9dcc0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc0cbf40 0x7f9dcc0cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41220/0 (socket says 172.21.15.179:41220) 2023-12-07T00:15:24.000 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 -- 172.21.15.179:0/2059486591 learned_addr learned my addr 172.21.15.179:0/2059486591 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dc3fff700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dcc0b6d50 0x7f9dcc0b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 -- 172.21.15.179:0/2059486591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9db8004170 msgr2=0x7f9dcc15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9db8004170 0x7f9dcc15b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 -- 172.21.15.179:0/2059486591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dcc0b6d50 msgr2=0x7f9dcc0b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dcc0b6d50 0x7f9dcc0b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 -- 172.21.15.179:0/2059486591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc0ccf80 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dc3fff700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dcc0b6d50 0x7f9dcc0b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dcb7fe700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc0cbf40 0x7f9dcc0cc3d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc06c170 tx=0x7f9dc400f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dc8ff9700 1 -- 172.21.15.179:0/2059486591 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc400fdc0 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dc8ff9700 1 -- 172.21.15.179:0/2059486591 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc4011040 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.996+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc0cd260 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.997+0000 7f9dc8ff9700 1 -- 172.21.15.179:0/2059486591 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4017620 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.997+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc0cc910 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.001 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.997+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc162360 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.998+0000 7f9dc8ff9700 1 -- 172.21.15.179:0/2059486591 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9dc40203b0 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.998+0000 7f9dc8ff9700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9dac06aed0 0x7f9dac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.002 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.998+0000 7f9dc8ff9700 1 -- 172.21.15.179:0/2059486591 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f9dc4089410 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.998+0000 7f9dcaffd700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9dac06aed0 0x7f9dac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:23.999+0000 7f9dcaffd700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9dac06aed0 0x7f9dac06d390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0011e0 tx=0x7f9dbc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:24.003 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.003+0000 7f9dc8ff9700 1 -- 172.21.15.179:0/2059486591 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9dc4054760 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.268 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.269+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f9dcc0acd40 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.272 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.273+0000 7f9dc8ff9700 1 -- 172.21.15.179:0/2059486591 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9dcc0acd40 con 0x7f9dcc0cbf40 2023-12-07T00:15:24.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9dac06aed0 msgr2=0x7f9dac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9dac06aed0 0x7f9dac06d390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0011e0 tx=0x7f9dbc009040 comp rx=0 tx=0).stop 2023-12-07T00:15:24.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc0cbf40 msgr2=0x7f9dcc0cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.275 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc0cbf40 0x7f9dcc0cc3d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc06c170 tx=0x7f9dc400f3b0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 shutdown_connections 2023-12-07T00:15:24.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9dac06aed0 0x7f9dac06d390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dcc0cbf40 0x7f9dcc0cc3d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9db8004170 0x7f9dcc15b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 --2- 172.21.15.179:0/2059486591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9dcc0b6d50 0x7f9dcc0b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 >> 172.21.15.179:0/2059486591 conn(0x7f9dcc06c9e0 msgr2=0x7f9dcc15c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:24.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 shutdown_connections 2023-12-07T00:15:24.276 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.276+0000 7f9dd19bc700 1 -- 172.21.15.179:0/2059486591 wait complete. 2023-12-07T00:15:24.287 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-07T00:15:24.407 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.408+0000 7fd830227700 1 Processor -- start 2023-12-07T00:15:24.408 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.409+0000 7fd830227700 1 -- start start 2023-12-07T00:15:24.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.409+0000 7fd830227700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd8280d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.409+0000 7fd830227700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8280cd020 0x7fd8280cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.409+0000 7fd830227700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82809ab50 con 0x7fd828099c00 2023-12-07T00:15:24.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.409+0000 7fd830227700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8280cf630 con 0x7fd8280cd020 2023-12-07T00:15:24.410 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.409+0000 7fd830227700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280cf8f0 con 0x7fd82815bde0 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82d7c2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8280cd020 0x7fd8280cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82dfc3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd8280d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82e7c4700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fd828099c00 0x7fd82815f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:54808/0 (socket says 172.21.15.179:54808) 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82d7c2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd8280cd020 0x7fd8280cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:43478/0 (socket says 172.21.15.179:43478) 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82dfc3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd8280d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41638/0 (socket says 172.21.15.179:41638) 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82e7c4700 1 -- 172.21.15.179:0/4123903056 learned_addr learned my addr 172.21.15.179:0/4123903056 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82d7c2700 1 -- 172.21.15.179:0/4123903056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 msgr2=0x7fd8280d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82d7c2700 1 --2- 172.21.15.179:0/4123903056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd8280d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82d7c2700 1 -- 172.21.15.179:0/4123903056 >> v1:172.21.15.190:6789/0 conn(0x7fd828099c00 legacy=0x7fd82815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82d7c2700 1 -- 172.21.15.179:0/4123903056 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280cfbd0 con 0x7fd8280cd020 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82d7c2700 1 --2- 172.21.15.179:0/4123903056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cd020 0x7fd8280cd490 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd824009840 tx=0x7fd824009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a85476d3e15c623 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82cfc1700 1 -- 172.21.15.179:0/4123903056 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824011830 con 0x7fd8280cd020 2023-12-07T00:15:24.411 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82cfc1700 1 -- 172.21.15.179:0/4123903056 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd824011990 con 0x7fd8280cd020 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.410+0000 7fd82cfc1700 1 -- 172.21.15.179:0/4123903056 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824011d20 con 0x7fd8280cd020 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.411+0000 7fd830227700 1 -- 172.21.15.179:0/4123903056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cd020 msgr2=0x7fd8280cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.411+0000 7fd830227700 1 --2- 172.21.15.179:0/4123903056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cd020 0x7fd8280cd490 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd824009840 tx=0x7fd824009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.411+0000 7fd830227700 1 -- 172.21.15.179:0/4123903056 shutdown_connections 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.411+0000 7fd830227700 1 --2- 172.21.15.179:0/4123903056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd8280d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.411+0000 7fd830227700 1 --2- 172.21.15.179:0/4123903056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd8280cd020 0x7fd8280cd490 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.411+0000 7fd830227700 1 -- 172.21.15.179:0/4123903056 >> 172.21.15.179:0/4123903056 conn(0x7fd8280b3550 msgr2=0x7fd8280b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.411+0000 7fd830227700 1 -- 172.21.15.179:0/4123903056 shutdown_connections 2023-12-07T00:15:24.412 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.411+0000 7fd830227700 1 -- 172.21.15.179:0/4123903056 wait complete. 2023-12-07T00:15:24.415 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.412+0000 7fd830227700 1 Processor -- start 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.412+0000 7fd830227700 1 -- start start 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd830227700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd828099c00 0x7fd82815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd830227700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8280cd020 0x7fd8280ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd830227700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd82815db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd830227700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82815c2f0 con 0x7fd8280cd020 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd830227700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82815e5f0 con 0x7fd828099c00 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd830227700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82815c590 con 0x7fd82815bde0 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82d7c2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8280cd020 0x7fd8280ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82d7c2700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8280cd020 0x7fd8280ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41232/0 (socket says 172.21.15.179:41232) 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82d7c2700 1 -- 172.21.15.179:0/87456058 learned_addr learned my addr 172.21.15.179:0/87456058 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82e7c4700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd82815db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82dfc3700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd828099c00 0x7fd82815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82d7c2700 1 -- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 msgr2=0x7fd82815db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.416 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82d7c2700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd82815db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82d7c2700 1 -- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd828099c00 msgr2=0x7fd82815cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82d7c2700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd828099c00 0x7fd82815cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.413+0000 7fd82d7c2700 1 -- 172.21.15.179:0/87456058 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8240094a0 con 0x7fd8280cd020 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.414+0000 7fd82dfc3700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd828099c00 0x7fd82815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.414+0000 7fd82d7c2700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8280cd020 0x7fd8280ce750 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd824009fd0 tx=0x7fd824004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.414+0000 7fd81e7fc700 1 -- 172.21.15.179:0/87456058 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240036a0 con 0x7fd8280cd020 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.414+0000 7fd81e7fc700 1 -- 172.21.15.179:0/87456058 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82401f070 con 0x7fd8280cd020 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.414+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82815c870 con 0x7fd8280cd020 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.414+0000 7fd81e7fc700 1 -- 172.21.15.179:0/87456058 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824003a60 con 0x7fd8280cd020 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.414+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82815d2d0 con 0x7fd8280cd020 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.415+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82815ca00 con 0x7fd8280cd020 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.415+0000 7fd81e7fc700 1 -- 172.21.15.179:0/87456058 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd824003bc0 con 0x7fd8280cd020 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.415+0000 7fd81e7fc700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd80c06aed0 0x7fd80c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.417 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.416+0000 7fd81e7fc700 1 -- 172.21.15.179:0/87456058 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd824021070 con 0x7fd8280cd020 2023-12-07T00:15:24.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.416+0000 7fd82dfc3700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd80c06aed0 0x7fd80c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.418 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.416+0000 7fd82dfc3700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd80c06aed0 0x7fd80c06d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8280cf510 tx=0x7fd818008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:24.419 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.420+0000 7fd81e7fc700 1 -- 172.21.15.179:0/87456058 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd824055ea0 con 0x7fd8280cd020 2023-12-07T00:15:24.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.692+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd8280685f0 con 0x7fd8280cd020 2023-12-07T00:15:24.695 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.696+0000 7fd81e7fc700 1 -- 172.21.15.179:0/87456058 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd824015020 con 0x7fd8280cd020 2023-12-07T00:15:24.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd80c06aed0 msgr2=0x7fd80c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd80c06aed0 0x7fd80c06d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd8280cf510 tx=0x7fd818008040 comp rx=0 tx=0).stop 2023-12-07T00:15:24.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8280cd020 msgr2=0x7fd8280ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8280cd020 0x7fd8280ce750 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd824009fd0 tx=0x7fd824004750 comp rx=0 tx=0).stop 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 shutdown_connections 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd80c06aed0 0x7fd80c06d390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd82815bde0 0x7fd82815db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd828099c00 0x7fd82815cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 --2- 172.21.15.179:0/87456058 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd8280cd020 0x7fd8280ce750 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 >> 172.21.15.179:0/87456058 conn(0x7fd8280b3550 msgr2=0x7fd8280b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 shutdown_connections 2023-12-07T00:15:24.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.698+0000 7fd830227700 1 -- 172.21.15.179:0/87456058 wait complete. 2023-12-07T00:15:24.710 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:24.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.831+0000 7f92b1bae700 1 Processor -- start 2023-12-07T00:15:24.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.831+0000 7f92b1bae700 1 -- start start 2023-12-07T00:15:24.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92b1bae700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac15de40 0x7f92ac0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92b1bae700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92ac15e220 0x7f92ac0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92b1bae700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f92ac0b4c20 0x7f92ac0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92b1bae700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac0d1820 con 0x7f92ac15e220 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92b1bae700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac15f330 con 0x7f92ac0b4c20 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92b1bae700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac15e720 con 0x7f92ac15de40 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92ac15e220 0x7f92ac0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f92ac15e220 0x7f92ac0b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41240/0 (socket says 172.21.15.179:41240) 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 -- 172.21.15.179:0/726619549 learned_addr learned my addr 172.21.15.179:0/726619549 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92abfff700 1 --2- 172.21.15.179:0/726619549 >> v2:172.21.15.190:3300/0 conn(0x7f92ac0b4c20 0x7f92ac0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92ab7fe700 1 --2- 172.21.15.179:0/726619549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac15de40 0x7f92ac0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 -- 172.21.15.179:0/726619549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac15de40 msgr2=0x7f92ac0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 --2- 172.21.15.179:0/726619549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac15de40 0x7f92ac0b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 -- 172.21.15.179:0/726619549 >> v2:172.21.15.190:3300/0 conn(0x7f92ac0b4c20 msgr2=0x7f92ac0b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:24.833 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 --2- 172.21.15.179:0/726619549 >> v2:172.21.15.190:3300/0 conn(0x7f92ac0b4c20 0x7f92ac0b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 -- 172.21.15.179:0/726619549 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac15ea00 con 0x7f92ac15e220 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.832+0000 7f92aaffd700 1 --2- 172.21.15.179:0/726619549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15e220 0x7f92ac0b2560 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0cd7f0 tx=0x7f929c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f35c53d89b248a server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92aa7fc700 1 -- 172.21.15.179:0/726619549 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c005e30 con 0x7f92ac15e220 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92aa7fc700 1 -- 172.21.15.179:0/726619549 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c004030 con 0x7f92ac15e220 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92aa7fc700 1 -- 172.21.15.179:0/726619549 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c0043e0 con 0x7f92ac15e220 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 -- 172.21.15.179:0/726619549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15e220 msgr2=0x7f92ac0b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 --2- 172.21.15.179:0/726619549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15e220 0x7f92ac0b2560 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0cd7f0 tx=0x7f929c009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 -- 172.21.15.179:0/726619549 shutdown_connections 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 --2- 172.21.15.179:0/726619549 >> v2:172.21.15.190:3300/0 conn(0x7f92ac0b4c20 0x7f92ac0b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 --2- 172.21.15.179:0/726619549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac15de40 0x7f92ac0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 --2- 172.21.15.179:0/726619549 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15e220 0x7f92ac0b2560 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 -- 172.21.15.179:0/726619549 >> 172.21.15.179:0/726619549 conn(0x7f92ac072970 msgr2=0x7f92ac072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:24.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 -- 172.21.15.179:0/726619549 shutdown_connections 2023-12-07T00:15:24.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.833+0000 7f92b1bae700 1 -- 172.21.15.179:0/726619549 wait complete. 2023-12-07T00:15:24.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.834+0000 7f92b1bae700 1 Processor -- start 2023-12-07T00:15:24.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92b1bae700 1 -- start start 2023-12-07T00:15:24.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92b1bae700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac0b4c20 0x7f92ac0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.839 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92b1bae700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15de40 0x7f92ac0d0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92b1bae700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ac15e220 0x7f92ac158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92b1bae700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0cc4f0 con 0x7f92ac15de40 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92b1bae700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0cb8e0 con 0x7f92ac15e220 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92b1bae700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0cbbc0 con 0x7f92ac0b4c20 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92aaffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15de40 0x7f92ac0d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92aaffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15de40 0x7f92ac0d0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41244/0 (socket says 172.21.15.179:41244) 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92aaffd700 1 -- 172.21.15.179:0/3559085053 learned_addr learned my addr 172.21.15.179:0/3559085053 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92abfff700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ac15e220 0x7f92ac158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.835+0000 7f92ab7fe700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac0b4c20 0x7f92ac0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f92aaffd700 1 -- 172.21.15.179:0/3559085053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac0b4c20 msgr2=0x7f92ac0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f92aaffd700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac0b4c20 0x7f92ac0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f92aaffd700 1 -- 172.21.15.179:0/3559085053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ac15e220 msgr2=0x7f92ac158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f92aaffd700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ac15e220 0x7f92ac158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:24.840 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f92aaffd700 1 -- 172.21.15.179:0/3559085053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c009500 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f92aaffd700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15de40 0x7f92ac0d0970 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f929c009130 tx=0x7f929c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f9293fff700 1 -- 172.21.15.179:0/3559085053 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c003ab0 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f9293fff700 1 -- 172.21.15.179:0/3559085053 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c003c30 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac0cbea0 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f9293fff700 1 -- 172.21.15.179:0/3559085053 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c006030 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.836+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac1594c0 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.837+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac04f290 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.837+0000 7f9293fff700 1 -- 172.21.15.179:0/3559085053 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f929c006190 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.838+0000 7f9293fff700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f929806aed0 0x7f929806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.838+0000 7f9293fff700 1 -- 172.21.15.179:0/3559085053 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f929c08a6a0 con 0x7f92ac15de40 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.838+0000 7f92ab7fe700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f929806aed0 0x7f929806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:24.841 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.838+0000 7f92ab7fe700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f929806aed0 0x7f929806d390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0ca9c0 tx=0x7f92a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:24.842 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:24.842+0000 7f9293fff700 1 -- 172.21.15.179:0/3559085053 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f929c0558d0 con 0x7f92ac15de40 2023-12-07T00:15:25.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.033+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92ac0685f0 con 0x7f92ac15de40 2023-12-07T00:15:25.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.034+0000 7f9293fff700 1 -- 172.21.15.179:0/3559085053 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13074 (secure 0 0 0) 0x7f929c058ef0 con 0x7f92ac15de40 2023-12-07T00:15:25.033 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:25.033 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":37,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:15:21.752319+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:25.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f929806aed0 msgr2=0x7f929806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f929806aed0 0x7f929806d390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0ca9c0 tx=0x7f92a0008040 comp rx=0 tx=0).stop 2023-12-07T00:15:25.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15de40 msgr2=0x7f92ac0d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15de40 0x7f92ac0d0970 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f929c009130 tx=0x7f929c004750 comp rx=0 tx=0).stop 2023-12-07T00:15:25.035 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 shutdown_connections 2023-12-07T00:15:25.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f929806aed0 0x7f929806d390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92ac15e220 0x7f92ac158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f92ac0b4c20 0x7f92ac0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 --2- 172.21.15.179:0/3559085053 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f92ac15de40 0x7f92ac0d0970 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 >> 172.21.15.179:0/3559085053 conn(0x7f92ac072970 msgr2=0x7f92ac15f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:25.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 shutdown_connections 2023-12-07T00:15:25.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.036+0000 7f92b1bae700 1 -- 172.21.15.179:0/3559085053 wait complete. 2023-12-07T00:15:25.047 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T00:15:25.048 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T00:15:25.170 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.171+0000 7fbd732a8700 1 Processor -- start 2023-12-07T00:15:25.171 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.171+0000 7fbd732a8700 1 -- start start 2023-12-07T00:15:25.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd732a8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbd6c162100 0x7fbd6c1624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.173 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd732a8700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0cfcc0 0x7fbd6c099b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd732a8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 0x7fbd6c09a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd732a8700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c162a20 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd732a8700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d06a0 con 0x7fbd6c162100 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd732a8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0d0980 con 0x7fbd6c0d0150 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd70843700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0cfcc0 0x7fbd6c099b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd70843700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbd6c0cfcc0 0x7fbd6c099b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41252/0 (socket says 172.21.15.179:41252) 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.172+0000 7fbd70843700 1 -- 172.21.15.179:0/2863827719 learned_addr learned my addr 172.21.15.179:0/2863827719 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd71044700 1 --2- 172.21.15.179:0/2863827719 >> v2:172.21.15.190:3300/0 conn(0x7fbd6c162100 0x7fbd6c1624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd71845700 1 --2- 172.21.15.179:0/2863827719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 0x7fbd6c09a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd70843700 1 -- 172.21.15.179:0/2863827719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 msgr2=0x7fbd6c09a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:25.174 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd70843700 1 --2- 172.21.15.179:0/2863827719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 0x7fbd6c09a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd70843700 1 -- 172.21.15.179:0/2863827719 >> v2:172.21.15.190:3300/0 conn(0x7fbd6c162100 msgr2=0x7fbd6c1624e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:25.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd70843700 1 --2- 172.21.15.179:0/2863827719 >> v2:172.21.15.190:3300/0 conn(0x7fbd6c162100 0x7fbd6c1624e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd70843700 1 -- 172.21.15.179:0/2863827719 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0d0c60 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd70843700 1 --2- 172.21.15.179:0/2863827719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c099b90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd680098f0 tx=0x7fbd68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8a284c3292a0cb server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd63fff700 1 -- 172.21.15.179:0/2863827719 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68011830 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd63fff700 1 -- 172.21.15.179:0/2863827719 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd68011990 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.173+0000 7fbd63fff700 1 -- 172.21.15.179:0/2863827719 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68011d20 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.175 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 -- 172.21.15.179:0/2863827719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 msgr2=0x7fbd6c099b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2863827719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c099b90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbd680098f0 tx=0x7fbd68009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:25.176 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 -- 172.21.15.179:0/2863827719 shutdown_connections 2023-12-07T00:15:25.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2863827719 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 0x7fbd6c09a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2863827719 >> v2:172.21.15.190:3300/0 conn(0x7fbd6c162100 0x7fbd6c1624e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2863827719 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c099b90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 -- 172.21.15.179:0/2863827719 >> 172.21.15.179:0/2863827719 conn(0x7fbd6c0b34e0 msgr2=0x7fbd6c0b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:25.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 -- 172.21.15.179:0/2863827719 shutdown_connections 2023-12-07T00:15:25.177 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.174+0000 7fbd732a8700 1 -- 172.21.15.179:0/2863827719 wait complete. 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.175+0000 7fbd732a8700 1 Processor -- start 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.175+0000 7fbd732a8700 1 -- start start 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd732a8700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c0b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd732a8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 0x7fbd6c0c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd732a8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd6c162100 0x7fbd6c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd732a8700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0b56e0 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd732a8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0b4a60 con 0x7fbd6c162100 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd732a8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c0b4d40 con 0x7fbd6c0d0150 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c0b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.180 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c0b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41256/0 (socket says 172.21.15.179:41256) 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 -- 172.21.15.179:0/2799547296 learned_addr learned my addr 172.21.15.179:0/2799547296 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd70843700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 0x7fbd6c0c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71845700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd6c162100 0x7fbd6c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 -- 172.21.15.179:0/2799547296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 msgr2=0x7fbd6c0c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 0x7fbd6c0c6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 -- 172.21.15.179:0/2799547296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd6c162100 msgr2=0x7fbd6c15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd6c162100 0x7fbd6c15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 -- 172.21.15.179:0/2799547296 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd68009550 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd71044700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c0b5b00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e870 tx=0x7fbd5c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd61ffb700 1 -- 172.21.15.179:0/2799547296 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c009590 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd61ffb700 1 -- 172.21.15.179:0/2799547296 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c00ee70 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c0b5020 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.182 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.176+0000 7fbd61ffb700 1 -- 172.21.15.179:0/2799547296 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00ca50 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.177+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c15d160 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.177+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c0b5950 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.178+0000 7fbd61ffb700 1 -- 172.21.15.179:0/2799547296 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd5c00cbb0 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.178+0000 7fbd61ffb700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbd5006aed0 0x7fbd5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.178+0000 7fbd61ffb700 1 -- 172.21.15.179:0/2799547296 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbd5c089350 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.178+0000 7fbd70843700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbd5006aed0 0x7fbd5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.179+0000 7fbd70843700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbd5006aed0 0x7fbd5006d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd68000c00 tx=0x7fbd68008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.183 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.183+0000 7fbd61ffb700 1 -- 172.21.15.179:0/2799547296 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd5c054600 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.371 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.372+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbd6c0685f0 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.371 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.372+0000 7fbd61ffb700 1 -- 172.21.15.179:0/2799547296 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbd5c00ce60 con 0x7fbd6c0cfcc0 2023-12-07T00:15:25.371 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T00:15:25.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbd5006aed0 msgr2=0x7fbd5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.373 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbd5006aed0 0x7fbd5006d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbd68000c00 tx=0x7fbd68008030 comp rx=0 tx=0).stop 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 msgr2=0x7fbd6c0b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c0b5b00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e870 tx=0x7fbd5c00ec30 comp rx=0 tx=0).stop 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 shutdown_connections 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbd5006aed0 0x7fbd5006d390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd6c162100 0x7fbd6c15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbd6c0cfcc0 0x7fbd6c0b5b00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 --2- 172.21.15.179:0/2799547296 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd6c0d0150 0x7fbd6c0c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 >> 172.21.15.179:0/2799547296 conn(0x7fbd6c0b34e0 msgr2=0x7fbd6c06fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 shutdown_connections 2023-12-07T00:15:25.374 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.374+0000 7fbd732a8700 1 -- 172.21.15.179:0/2799547296 wait complete. 2023-12-07T00:15:25.385 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-07T00:15:25.505 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.506+0000 7f29c458e700 1 Processor -- start 2023-12-07T00:15:25.506 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.506+0000 7f29c458e700 1 -- start start 2023-12-07T00:15:25.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.507+0000 7f29c458e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc158560 0x7f29bc0b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c458e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc15b8d0 con 0x7f29bc0b2c70 2023-12-07T00:15:25.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c458e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc15bbb0 con 0x7f29bc15b010 2023-12-07T00:15:25.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c458e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc15be90 con 0x7f29bc158560 2023-12-07T00:15:25.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c2b2b700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f29bc0b2c70 0x7f29bc0cf3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48170/0 (socket says 172.21.15.179:48170) 2023-12-07T00:15:25.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c2b2b700 1 -- 172.21.15.179:0/3408028497 learned_addr learned my addr 172.21.15.179:0/3408028497 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:25.509 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c232a700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc158560 0x7f29bc0b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475551876 0 0) 0x7f29bc15b8d0 con 0x7f29bc0b2c70 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a80035b0 con 0x7f29bc0b2c70 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4268157967 0 0) 0x7f29a80035b0 con 0x7f29bc0b2c70 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc158560 msgr2=0x7f29bc0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc158560 0x7f29bc0b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 >> v1:172.21.15.190:6789/0 conn(0x7f29bc15b010 legacy=0x7f29bc0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0ceec0 con 0x7f29bc0b2c70 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f29b40019f0 con 0x7f29bc0b2c70 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 >> v1:172.21.15.179:6789/0 conn(0x7f29bc0b2c70 legacy=0x7f29bc0cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29a80043e0 0x7f29a80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc158560 0x7f29a8005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc15be90 con 0x7f29a8003a30 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a800ba10 con 0x7f29a80043e0 2023-12-07T00:15:25.510 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a800bbd0 con 0x7f29bc158560 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c232a700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c2b2b700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc158560 0x7f29a8005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.508+0000 7f29c1b29700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29a80043e0 0x7f29a80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c232a700 1 -- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc158560 msgr2=0x7f29a8005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c232a700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc158560 0x7f29a8005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c232a700 1 -- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29a80043e0 msgr2=0x7f29a80048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c232a700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29a80043e0 0x7f29a80048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c232a700 1 -- 172.21.15.179:0/3408028497 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a80035b0 con 0x7f29a8003a30 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c232a700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29a8003e10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009b60 tx=0x7f29a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f773c776c68d5d5c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00e6c0 con 0x7f29a8003a30 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00e820 con 0x7f29a8003a30 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c1328700 1 -- 172.21.15.179:0/3408028497 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00eb90 con 0x7f29a8003a30 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c458e700 1 -- 172.21.15.179:0/3408028497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 msgr2=0x7f29a8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.511 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c458e700 1 --2- 172.21.15.179:0/3408028497 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29a8003e10 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009b60 tx=0x7f29a8005880 comp rx=0 tx=0).stop 2023-12-07T00:15:25.512 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c2b2b700 1 -- 172.21.15.179:0/3408028497 reap_dead start 2023-12-07T00:15:25.512 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c458e700 1 -- 172.21.15.179:0/3408028497 shutdown_connections 2023-12-07T00:15:25.512 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c458e700 1 -- 172.21.15.179:0/3408028497 >> 172.21.15.179:0/3408028497 conn(0x7f29bc072970 msgr2=0x7f29bc072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:25.512 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.509+0000 7f29c458e700 1 -- 172.21.15.179:0/3408028497 shutdown_connections 2023-12-07T00:15:25.512 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.510+0000 7f29c458e700 1 -- 172.21.15.179:0/3408028497 wait complete. 2023-12-07T00:15:25.514 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.511+0000 7f29c458e700 1 Processor -- start 2023-12-07T00:15:25.514 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.511+0000 7f29c458e700 1 -- start start 2023-12-07T00:15:25.514 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c458e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29bc0a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.514 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c458e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29bc14c8e0 0x7f29bc148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c458e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc148ff0 0x7f29bc14bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c458e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0c9f80 con 0x7f29a8003a30 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c458e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc149880 con 0x7f29bc14c8e0 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c458e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0cc440 con 0x7f29bc148ff0 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c232a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29bc0a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c232a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29bc0a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41276/0 (socket says 172.21.15.179:41276) 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c232a700 1 -- 172.21.15.179:0/2081956639 learned_addr learned my addr 172.21.15.179:0/2081956639 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c2b2b700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc148ff0 0x7f29bc14bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c1b29700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29bc14c8e0 0x7f29bc148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c232a700 1 -- 172.21.15.179:0/2081956639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc148ff0 msgr2=0x7f29bc14bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c232a700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc148ff0 0x7f29bc14bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c232a700 1 -- 172.21.15.179:0/2081956639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29bc14c8e0 msgr2=0x7f29bc148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c232a700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29bc14c8e0 0x7f29bc148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.512+0000 7f29c232a700 1 -- 172.21.15.179:0/2081956639 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc1495a0 con 0x7f29a8003a30 2023-12-07T00:15:25.515 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.513+0000 7f29c232a700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29bc0a84a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0042f0 tx=0x7f29ac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.513+0000 7f29b2ffd700 1 -- 172.21.15.179:0/2081956639 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00e6c0 con 0x7f29a8003a30 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.513+0000 7f29b2ffd700 1 -- 172.21.15.179:0/2081956639 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac003ad0 con 0x7f29a8003a30 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.513+0000 7f29b2ffd700 1 -- 172.21.15.179:0/2081956639 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac003e80 con 0x7f29a8003a30 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.513+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc0cc6e0 con 0x7f29a8003a30 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.513+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc14c290 con 0x7f29a8003a30 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.514+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc04f290 con 0x7f29a8003a30 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.514+0000 7f29b2ffd700 1 -- 172.21.15.179:0/2081956639 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29ac013470 con 0x7f29a8003a30 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.514+0000 7f29b2ffd700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f29a006aed0 0x7f29a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.514+0000 7f29b2ffd700 1 -- 172.21.15.179:0/2081956639 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f29ac08ac90 con 0x7f29a8003a30 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.514+0000 7f29c1b29700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f29a006aed0 0x7f29a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.516 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.515+0000 7f29c1b29700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f29a006aed0 0x7f29a006d390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f29bc14cf50 tx=0x7f29b8007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.518 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.519+0000 7f29b2ffd700 1 -- 172.21.15.179:0/2081956639 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f29ac056060 con 0x7f29a8003a30 2023-12-07T00:15:25.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.712+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f29bc0cc270 con 0x7f29a8003a30 2023-12-07T00:15:25.711 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.712+0000 7f29b2ffd700 1 -- 172.21.15.179:0/2081956639 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+65 (secure 0 0 0) 0x7f29ac059680 con 0x7f29a8003a30 2023-12-07T00:15:25.712 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:25.712 INFO:teuthology.orchestra.run.smithi179.stdout:[ 2023-12-07T00:15:25.712 INFO:teuthology.orchestra.run.smithi179.stdout: { 2023-12-07T00:15:25.712 INFO:teuthology.orchestra.run.smithi179.stdout: "poolnum": 1, 2023-12-07T00:15:25.712 INFO:teuthology.orchestra.run.smithi179.stdout: "poolname": ".mgr" 2023-12-07T00:15:25.712 INFO:teuthology.orchestra.run.smithi179.stdout: } 2023-12-07T00:15:25.712 INFO:teuthology.orchestra.run.smithi179.stdout:] 2023-12-07T00:15:25.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.714+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f29a006aed0 msgr2=0x7f29a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.714 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.714+0000 7f29c458e700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f29a006aed0 0x7f29a006d390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f29bc14cf50 tx=0x7f29b8007d30 comp rx=0 tx=0).stop 2023-12-07T00:15:25.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.714+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 msgr2=0x7f29bc0a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.714+0000 7f29c458e700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29bc0a84a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0042f0 tx=0x7f29ac0047c0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.715+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 shutdown_connections 2023-12-07T00:15:25.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.715+0000 7f29c458e700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f29a006aed0 0x7f29a006d390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.715+0000 7f29c458e700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29bc148ff0 0x7f29bc14bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.715+0000 7f29c458e700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29a8003a30 0x7f29bc0a84a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.715 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.715+0000 7f29c458e700 1 --2- 172.21.15.179:0/2081956639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29bc14c8e0 0x7f29bc148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.715+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 >> 172.21.15.179:0/2081956639 conn(0x7f29bc072970 msgr2=0x7f29bc0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:25.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.715+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 shutdown_connections 2023-12-07T00:15:25.716 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.715+0000 7f29c458e700 1 -- 172.21.15.179:0/2081956639 wait complete. 2023-12-07T00:15:25.726 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-07T00:15:25.726 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-07T00:15:25.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.851+0000 7fbde39f5700 1 Processor -- start 2023-12-07T00:15:25.850 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.851+0000 7fbde39f5700 1 -- start start 2023-12-07T00:15:25.853 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbde39f5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbddc0d1000 0x7fbddc15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbde39f5700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc0b0c90 con 0x7fbddc15aae0 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbde39f5700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbddc0cb340 con 0x7fbddc15f350 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbde39f5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc15bb00 con 0x7fbddc0d1000 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbde1791700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fbddc15aae0 0x7fbddc0d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48186/0 (socket says 172.21.15.179:48186) 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbde1791700 1 -- 172.21.15.179:0/3974840165 learned_addr learned my addr 172.21.15.179:0/3974840165 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbde0f90700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbddc0d1000 0x7fbddc15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727467264 0 0) 0x7fbddc0b0c90 con 0x7fbddc15aae0 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.852+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc80035b0 con 0x7fbddc15aae0 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261814789 0 0) 0x7fbdc80035b0 con 0x7fbddc15aae0 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbddc0d1000 msgr2=0x7fbddc15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbddc0d1000 0x7fbddc15aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 >> v1:172.21.15.190:6789/0 conn(0x7fbddc15f350 legacy=0x7fbddc0af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc15bde0 con 0x7fbddc15aae0 2023-12-07T00:15:25.854 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fbdcc001670 con 0x7fbddc15aae0 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 >> v1:172.21.15.179:6789/0 conn(0x7fbddc15aae0 legacy=0x7fbddc0d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbddc0d1000 0x7fbdc8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc8003f70 0x7fbdc8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdc8004d90 0x7fbdc8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc15bb00 con 0x7fbdc8003f70 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc800bb20 con 0x7fbdc8004d90 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc800bce0 con 0x7fbddc0d1000 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde0f90700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc8003f70 0x7fbdc8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde1791700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbddc0d1000 0x7fbdc8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde1f92700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdc8004d90 0x7fbdc8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde0f90700 1 -- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbddc0d1000 msgr2=0x7fbdc8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde0f90700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbddc0d1000 0x7fbdc8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde0f90700 1 -- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdc8004d90 msgr2=0x7fbdc8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:25.855 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde0f90700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbdc8004d90 0x7fbdc8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde0f90700 1 -- 172.21.15.179:0/3974840165 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80035b0 con 0x7fbdc8003f70 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbde0f90700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc8003f70 0x7fbdc8004850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009b30 tx=0x7fbdc8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69d90da4aae251c server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd800e6c0 con 0x7fbdc8003f70 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd800e820 con 0x7fbdc8003f70 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.853+0000 7fbdd3fff700 1 -- 172.21.15.179:0/3974840165 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd800eb90 con 0x7fbdc8003f70 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.854+0000 7fbde39f5700 1 -- 172.21.15.179:0/3974840165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc8003f70 msgr2=0x7fbdc8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.854+0000 7fbde39f5700 1 --2- 172.21.15.179:0/3974840165 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdc8003f70 0x7fbdc8004850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009b30 tx=0x7fbdc8005880 comp rx=0 tx=0).stop 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.854+0000 7fbde1f92700 1 -- 172.21.15.179:0/3974840165 reap_dead start 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.854+0000 7fbde39f5700 1 -- 172.21.15.179:0/3974840165 shutdown_connections 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.854+0000 7fbde39f5700 1 -- 172.21.15.179:0/3974840165 >> 172.21.15.179:0/3974840165 conn(0x7fbddc099a40 msgr2=0x7fbddc099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.854+0000 7fbde39f5700 1 -- 172.21.15.179:0/3974840165 shutdown_connections 2023-12-07T00:15:25.856 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.854+0000 7fbde39f5700 1 -- 172.21.15.179:0/3974840165 wait complete. 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.855+0000 7fbde39f5700 1 Processor -- start 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.855+0000 7fbde39f5700 1 -- start start 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde39f5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdc8003f70 0x7fbddc153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde39f5700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbddc15e150 0x7fbddc14fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde39f5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbddc0cc530 0x7fbddc0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde39f5700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc1552d0 con 0x7fbddc15e150 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde39f5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc15e9b0 con 0x7fbddc0cc530 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde39f5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbddc154420 con 0x7fbdc8003f70 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde0f90700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbddc15e150 0x7fbddc14fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.859 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde0f90700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbddc15e150 0x7fbddc14fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41294/0 (socket says 172.21.15.179:41294) 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde0f90700 1 -- 172.21.15.179:0/985477855 learned_addr learned my addr 172.21.15.179:0/985477855 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde1791700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdc8003f70 0x7fbddc153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.856+0000 7fbde1f92700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbddc0cc530 0x7fbddc0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbde0f90700 1 -- 172.21.15.179:0/985477855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdc8003f70 msgr2=0x7fbddc153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbde0f90700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdc8003f70 0x7fbddc153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbde0f90700 1 -- 172.21.15.179:0/985477855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbddc0cc530 msgr2=0x7fbddc0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbde0f90700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbddc0cc530 0x7fbddc0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbde0f90700 1 -- 172.21.15.179:0/985477855 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbddc0ccf20 con 0x7fbddc15e150 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbde0f90700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbddc15e150 0x7fbddc14fe60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800e4b0 tx=0x7fbdd80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbdd1ffb700 1 -- 172.21.15.179:0/985477855 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8021070 con 0x7fbddc15e150 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbdd1ffb700 1 -- 172.21.15.179:0/985477855 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8004460 con 0x7fbddc15e150 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbddc154650 con 0x7fbddc15e150 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbdd1ffb700 1 -- 172.21.15.179:0/985477855 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd800e6c0 con 0x7fbddc15e150 2023-12-07T00:15:25.860 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.857+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbddc154c10 con 0x7fbddc15e150 2023-12-07T00:15:25.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.858+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbddc155260 con 0x7fbddc15e150 2023-12-07T00:15:25.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.859+0000 7fbdd1ffb700 1 -- 172.21.15.179:0/985477855 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbdd8025070 con 0x7fbddc15e150 2023-12-07T00:15:25.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.859+0000 7fbdd1ffb700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbdc006aed0 0x7fbdc006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:25.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.859+0000 7fbdd1ffb700 1 -- 172.21.15.179:0/985477855 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbdd808a430 con 0x7fbddc15e150 2023-12-07T00:15:25.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.859+0000 7fbde1791700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbdc006aed0 0x7fbdc006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:25.861 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.859+0000 7fbde1791700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbdc006aed0 0x7fbdc006d390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc001eb0 tx=0x7fbdcc000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:25.862 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:25.863+0000 7fbdd1ffb700 1 -- 172.21.15.179:0/985477855 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbdd80558a0 con 0x7fbddc15e150 2023-12-07T00:15:26.050 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.051+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbddc0685f0 con 0x7fbddc15e150 2023-12-07T00:15:26.761 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.762+0000 7fbdd1ffb700 1 -- 172.21.15.179:0/985477855 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbdd8058ec0 con 0x7fbddc15e150 2023-12-07T00:15:26.764 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbdc006aed0 msgr2=0x7fbdc006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbdc006aed0 0x7fbdc006d390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc001eb0 tx=0x7fbdcc000f80 comp rx=0 tx=0).stop 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbddc15e150 msgr2=0x7fbddc14fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbddc15e150 0x7fbddc14fe60 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800e4b0 tx=0x7fbdd80047c0 comp rx=0 tx=0).stop 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 shutdown_connections 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fbdc006aed0 0x7fbdc006d390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbddc0cc530 0x7fbddc0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbdc8003f70 0x7fbddc153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 --2- 172.21.15.179:0/985477855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbddc15e150 0x7fbddc14fe60 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 >> 172.21.15.179:0/985477855 conn(0x7fbddc099a40 msgr2=0x7fbddc0cb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.765+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 shutdown_connections 2023-12-07T00:15:26.765 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.766+0000 7fbde39f5700 1 -- 172.21.15.179:0/985477855 wait complete. 2023-12-07T00:15:26.766 INFO:teuthology.orchestra.run.smithi179.stderr:pool 'cephfs_metadata' created 2023-12-07T00:15:26.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-07T00:15:26.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.916+0000 7f2134fee700 1 Processor -- start 2023-12-07T00:15:26.915 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.916+0000 7f2134fee700 1 -- start start 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.917+0000 7f2134fee700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f213006fa30 0x7f213009a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.917+0000 7f2134fee700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f213006fee0 con 0x7f2130070440 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.917+0000 7f2134fee700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2130070110 con 0x7f213015bd00 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.917+0000 7f2134fee700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f213009aae0 con 0x7f213006fa30 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.917+0000 7f212dd9b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f213006fa30 0x7f213009a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.917+0000 7f212ed9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2130070440 0x7f21300cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48204/0 (socket says 172.21.15.179:48204) 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.917+0000 7f212ed9d700 1 -- 172.21.15.179:0/3871851149 learned_addr learned my addr 172.21.15.179:0/3871851149 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f212dd9b700 1 -- 172.21.15.179:0/3871851149 >> v1:172.21.15.190:6789/0 conn(0x7f213015bd00 legacy=0x7f21300cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f212dd9b700 1 -- 172.21.15.179:0/3871851149 >> v1:172.21.15.179:6789/0 conn(0x7f2130070440 legacy=0x7f21300cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:26.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f212dd9b700 1 -- 172.21.15.179:0/3871851149 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300cc950 con 0x7f213006fa30 2023-12-07T00:15:26.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f212d59a700 1 -- 172.21.15.179:0/3871851149 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571390932 0 0) 0x7f213006fee0 con 0x7f2130070440 2023-12-07T00:15:26.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f212dd9b700 1 --2- 172.21.15.179:0/3871851149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f213009a5a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2120009840 tx=0x7f2120009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb77391c32b2e539 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:26.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f212d59a700 1 -- 172.21.15.179:0/3871851149 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120011830 con 0x7f213006fa30 2023-12-07T00:15:26.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f212d59a700 1 -- 172.21.15.179:0/3871851149 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120011990 con 0x7f213006fa30 2023-12-07T00:15:26.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f212d59a700 1 -- 172.21.15.179:0/3871851149 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120011d20 con 0x7f213006fa30 2023-12-07T00:15:26.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f2134fee700 1 -- 172.21.15.179:0/3871851149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 msgr2=0x7f213009a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:26.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.918+0000 7f2134fee700 1 --2- 172.21.15.179:0/3871851149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f213009a5a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2120009840 tx=0x7f2120009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:26.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.919+0000 7f2134fee700 1 -- 172.21.15.179:0/3871851149 shutdown_connections 2023-12-07T00:15:26.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.919+0000 7f2134fee700 1 --2- 172.21.15.179:0/3871851149 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f213009a5a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:26.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.919+0000 7f2134fee700 1 -- 172.21.15.179:0/3871851149 >> 172.21.15.179:0/3871851149 conn(0x7f21300b3450 msgr2=0x7f21300b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:26.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.919+0000 7f2134fee700 1 -- 172.21.15.179:0/3871851149 shutdown_connections 2023-12-07T00:15:26.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.919+0000 7f2134fee700 1 -- 172.21.15.179:0/3871851149 wait complete. 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.920+0000 7f2134fee700 1 Processor -- start 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.920+0000 7f2134fee700 1 -- start start 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f2134fee700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f2130150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f2134fee700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2130070440 0x7f213015e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f2134fee700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f213015bd00 0x7f213006c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f2134fee700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21300b4740 con 0x7f213006fa30 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f2134fee700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130151bf0 con 0x7f2130070440 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f2134fee700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2130151ed0 con 0x7f213015bd00 2023-12-07T00:15:26.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f2130150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f2130150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41306/0 (socket says 172.21.15.179:41306) 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 -- 172.21.15.179:0/3526420166 learned_addr learned my addr 172.21.15.179:0/3526420166 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212dd9b700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2130070440 0x7f213015e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212ed9d700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f213015bd00 0x7f213006c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 -- 172.21.15.179:0/3526420166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f213015bd00 msgr2=0x7f213006c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f213015bd00 0x7f213006c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 -- 172.21.15.179:0/3526420166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2130070440 msgr2=0x7f213015e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2130070440 0x7f213015e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 -- 172.21.15.179:0/3526420166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200094a0 con 0x7f213006fa30 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f212e59c700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f2130150ef0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f212400c4e0 tx=0x7f212400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f211effd700 1 -- 172.21.15.179:0/3526420166 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240052d0 con 0x7f213006fa30 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f211effd700 1 -- 172.21.15.179:0/3526420166 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124005430 con 0x7f213006fa30 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21301521b0 con 0x7f213006fa30 2023-12-07T00:15:26.928 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f211effd700 1 -- 172.21.15.179:0/3526420166 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240038c0 con 0x7f213006fa30 2023-12-07T00:15:26.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.921+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213015eaa0 con 0x7f213006fa30 2023-12-07T00:15:26.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.922+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21301523a0 con 0x7f213006fa30 2023-12-07T00:15:26.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.923+0000 7f211effd700 1 -- 172.21.15.179:0/3526420166 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2124003a20 con 0x7f213006fa30 2023-12-07T00:15:26.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.923+0000 7f211effd700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f211006aed0 0x7f211006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:26.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.923+0000 7f211effd700 1 -- 172.21.15.179:0/3526420166 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f2124088a20 con 0x7f213006fa30 2023-12-07T00:15:26.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.923+0000 7f212dd9b700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f211006aed0 0x7f211006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:26.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.924+0000 7f212dd9b700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f211006aed0 0x7f211006d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21200090b0 tx=0x7f212001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:26.929 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:26.928+0000 7f211effd700 1 -- 172.21.15.179:0/3526420166 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2124053ae0 con 0x7f213006fa30 2023-12-07T00:15:27.116 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.117+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f21300685f0 con 0x7f213006fa30 2023-12-07T00:15:27.766 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.767+0000 7f211effd700 1 -- 172.21.15.179:0/3526420166 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2124017020 con 0x7f213006fa30 2023-12-07T00:15:27.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f211006aed0 msgr2=0x7f211006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:27.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f211006aed0 0x7f211006d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f21200090b0 tx=0x7f212001c040 comp rx=0 tx=0).stop 2023-12-07T00:15:27.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 msgr2=0x7f2130150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:27.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f2130150ef0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f212400c4e0 tx=0x7f212400c7f0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 shutdown_connections 2023-12-07T00:15:27.770 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f211006aed0 0x7f211006d390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f213015bd00 0x7f213006c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f213006fa30 0x7f2130150ef0 secure :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f212400c4e0 tx=0x7f212400c7f0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 --2- 172.21.15.179:0/3526420166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2130070440 0x7f213015e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.771 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.771+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 >> 172.21.15.179:0/3526420166 conn(0x7f21300b3450 msgr2=0x7f21301590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:27.772 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.774+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 shutdown_connections 2023-12-07T00:15:27.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.774+0000 7f2134fee700 1 -- 172.21.15.179:0/3526420166 wait complete. 2023-12-07T00:15:27.777 INFO:teuthology.orchestra.run.smithi179.stderr:pool 'cephfs_data' created 2023-12-07T00:15:27.796 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-07T00:15:27.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.923+0000 7f0659e81700 1 Processor -- start 2023-12-07T00:15:27.922 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.923+0000 7f0659e81700 1 -- start start 2023-12-07T00:15:27.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f0659e81700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0654161360 0x7f06540cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:27.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f0659e81700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0654162380 0x7f065406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:27.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f0659e81700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06540cb0f0 con 0x7f065406af70 2023-12-07T00:15:27.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f0659e81700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065406b930 con 0x7f0654161360 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f0659e81700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06541627b0 con 0x7f0654162380 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f06537fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0654161360 0x7f06540cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f06537fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f0654161360 0x7f06540cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41314/0 (socket says 172.21.15.179:41314) 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f06537fe700 1 -- 172.21.15.179:0/3249689458 learned_addr learned my addr 172.21.15.179:0/3249689458 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f0653fff700 1 --2- 172.21.15.179:0/3249689458 >> v2:172.21.15.190:3300/0 conn(0x7f0654162380 0x7f065406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f06537fe700 1 -- 172.21.15.179:0/3249689458 >> v2:172.21.15.190:3300/0 conn(0x7f0654162380 msgr2=0x7f065406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f06537fe700 1 --2- 172.21.15.179:0/3249689458 >> v2:172.21.15.190:3300/0 conn(0x7f0654162380 0x7f065406b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f06537fe700 1 -- 172.21.15.179:0/3249689458 >> v1:172.21.15.190:6789/0 conn(0x7f065406af70 legacy=0x7f0654161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f06537fe700 1 -- 172.21.15.179:0/3249689458 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654161740 con 0x7f0654161360 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.924+0000 7f06537fe700 1 --2- 172.21.15.179:0/3249689458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654161360 0x7f06540cc100 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f06540aff20 tx=0x7f063c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8600875c016d8997 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:27.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f06527fc700 1 -- 172.21.15.179:0/3249689458 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00b870 con 0x7f0654161360 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f06527fc700 1 -- 172.21.15.179:0/3249689458 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c00b9d0 con 0x7f0654161360 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f06527fc700 1 -- 172.21.15.179:0/3249689458 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00bd60 con 0x7f0654161360 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f0659e81700 1 -- 172.21.15.179:0/3249689458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654161360 msgr2=0x7f06540cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f0659e81700 1 --2- 172.21.15.179:0/3249689458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654161360 0x7f06540cc100 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f06540aff20 tx=0x7f063c009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f0659e81700 1 -- 172.21.15.179:0/3249689458 shutdown_connections 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f0659e81700 1 --2- 172.21.15.179:0/3249689458 >> v2:172.21.15.190:3300/0 conn(0x7f0654162380 0x7f065406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f0659e81700 1 --2- 172.21.15.179:0/3249689458 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654161360 0x7f06540cc100 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f0659e81700 1 -- 172.21.15.179:0/3249689458 >> 172.21.15.179:0/3249689458 conn(0x7f0654099a40 msgr2=0x7f0654099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f0659e81700 1 -- 172.21.15.179:0/3249689458 shutdown_connections 2023-12-07T00:15:27.927 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.925+0000 7f0659e81700 1 -- 172.21.15.179:0/3249689458 wait complete. 2023-12-07T00:15:27.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.926+0000 7f0659e81700 1 Processor -- start 2023-12-07T00:15:27.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0659e81700 1 -- start start 2023-12-07T00:15:27.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0659e81700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f065406af70 0x7f0654148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:27.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0659e81700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0654161360 0x7f06541f71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:27.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0659e81700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654162380 0x7f0654147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:27.930 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0659e81700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06540ad8b0 con 0x7f0654162380 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0659e81700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06540ae430 con 0x7f065406af70 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0659e81700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06540adb00 con 0x7f0654161360 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0653fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654162380 0x7f0654147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0653fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654162380 0x7f0654147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41324/0 (socket says 172.21.15.179:41324) 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0653fff700 1 -- 172.21.15.179:0/4082474483 learned_addr learned my addr 172.21.15.179:0/4082474483 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f06537fe700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f065406af70 0x7f0654148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.927+0000 7f0652ffd700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0654161360 0x7f06541f71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f0653fff700 1 -- 172.21.15.179:0/4082474483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0654161360 msgr2=0x7f06541f71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f0653fff700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0654161360 0x7f06541f71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f0653fff700 1 -- 172.21.15.179:0/4082474483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f065406af70 msgr2=0x7f0654148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f0653fff700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f065406af70 0x7f0654148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f0653fff700 1 -- 172.21.15.179:0/4082474483 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009550 con 0x7f0654162380 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f0653fff700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654162380 0x7f0654147dd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f064c007e60 tx=0x7f064c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:27.931 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f064bfff700 1 -- 172.21.15.179:0/4082474483 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c00ed30 con 0x7f0654162380 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f064bfff700 1 -- 172.21.15.179:0/4082474483 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c014420 con 0x7f0654162380 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f064bfff700 1 -- 172.21.15.179:0/4082474483 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c0147d0 con 0x7f0654162380 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06540adde0 con 0x7f0654162380 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.928+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06541f7700 con 0x7f0654162380 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.929+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06541f78c0 con 0x7f0654162380 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.930+0000 7f064bfff700 1 -- 172.21.15.179:0/4082474483 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f064c014930 con 0x7f0654162380 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.930+0000 7f064bfff700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f063406aed0 0x7f063406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.930+0000 7f06537fe700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f063406aed0 0x7f063406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.930+0000 7f064bfff700 1 -- 172.21.15.179:0/4082474483 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f064c089cb0 con 0x7f0654162380 2023-12-07T00:15:27.932 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.930+0000 7f06537fe700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f063406aed0 0x7f063406d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f063c014040 tx=0x7f063c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:27.934 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:27.935+0000 7f064bfff700 1 -- 172.21.15.179:0/4082474483 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f064c054cb0 con 0x7f0654162380 2023-12-07T00:15:28.169 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.170+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f06540ae5a0 con 0x7f0654162380 2023-12-07T00:15:28.773 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.774+0000 7f064bfff700 1 -- 172.21.15.179:0/4082474483 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f064c0582d0 con 0x7f0654162380 2023-12-07T00:15:28.775 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.776+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f063406aed0 msgr2=0x7f063406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:28.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.776+0000 7f0659e81700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f063406aed0 0x7f063406d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f063c014040 tx=0x7f063c008030 comp rx=0 tx=0).stop 2023-12-07T00:15:28.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.776+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654162380 msgr2=0x7f0654147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:28.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.776+0000 7f0659e81700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654162380 0x7f0654147dd0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f064c007e60 tx=0x7f064c00e3c0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.776 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.777+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 shutdown_connections 2023-12-07T00:15:28.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.777+0000 7f0659e81700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f063406aed0 0x7f063406d390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.777+0000 7f0659e81700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0654162380 0x7f0654147dd0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.777+0000 7f0659e81700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f065406af70 0x7f0654148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.777+0000 7f0659e81700 1 --2- 172.21.15.179:0/4082474483 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0654161360 0x7f06541f71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.777+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 >> 172.21.15.179:0/4082474483 conn(0x7f0654099a40 msgr2=0x7f06540cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:28.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.777+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 shutdown_connections 2023-12-07T00:15:28.777 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.777+0000 7f0659e81700 1 -- 172.21.15.179:0/4082474483 wait complete. 2023-12-07T00:15:28.778 INFO:teuthology.orchestra.run.smithi179.stderr:new fs with metadata pool 5 and data pool 6 2023-12-07T00:15:28.793 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:28.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.915+0000 7f4c9f078700 1 Processor -- start 2023-12-07T00:15:28.914 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.915+0000 7f4c9f078700 1 -- start start 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c9f078700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c980ce460 0x7f4c98160250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c9f078700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9806f890 con 0x7f4c9815c090 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c9f078700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c9815fdc0 con 0x7f4c98155ff0 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c9f078700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9815cd30 con 0x7f4c980ce460 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c9d615700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f4c9815c090 0x7f4c9815c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48250/0 (socket says 172.21.15.179:48250) 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c9d615700 1 -- 172.21.15.179:0/1800515041 learned_addr learned my addr 172.21.15.179:0/1800515041 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199763579 0 0) 0x7f4c9806f890 con 0x7f4c9815c090 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c880035b0 con 0x7f4c9815c090 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c97fff700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c980ce460 0x7f4c98160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659177901 0 0) 0x7f4c880035b0 con 0x7f4c9815c090 2023-12-07T00:15:28.918 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c980ce460 msgr2=0x7f4c98160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c980ce460 0x7f4c98160250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 >> v1:172.21.15.190:6789/0 conn(0x7f4c98155ff0 legacy=0x7f4c980cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9815d010 con 0x7f4c9815c090 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f4c900019f0 con 0x7f4c9815c090 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 >> v1:172.21.15.179:6789/0 conn(0x7f4c9815c090 legacy=0x7f4c9815c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.916+0000 7f4c977fe700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88003a30 0x7f4c88003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c977fe700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c88004850 0x7f4c88004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c977fe700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c980ce460 0x7f4c88005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9815cd30 con 0x7f4c88004850 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8800bb40 con 0x7f4c88003a30 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8800bd00 con 0x7f4c980ce460 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c97fff700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c88004850 0x7f4c88004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c9ce14700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88003a30 0x7f4c88003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c9d615700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c980ce460 0x7f4c88005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c97fff700 1 -- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c980ce460 msgr2=0x7f4c88005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:28.919 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c97fff700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c980ce460 0x7f4c88005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c97fff700 1 -- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88003a30 msgr2=0x7f4c88003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c97fff700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88003a30 0x7f4c88003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c97fff700 1 -- 172.21.15.179:0/1800515041 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880035b0 con 0x7f4c88004850 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c97fff700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c88004850 0x7f4c88004cd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009b40 tx=0x7f4c88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3799a07bb1e544 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84005a20 con 0x7f4c88004850 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c84005b80 con 0x7f4c88004850 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.917+0000 7f4c977fe700 1 -- 172.21.15.179:0/1800515041 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400e6c0 con 0x7f4c88004850 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.918+0000 7f4c9f078700 1 -- 172.21.15.179:0/1800515041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c88004850 msgr2=0x7f4c88004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.918+0000 7f4c9f078700 1 --2- 172.21.15.179:0/1800515041 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c88004850 0x7f4c88004cd0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4c84009b40 tx=0x7f4c88005880 comp rx=0 tx=0).stop 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.918+0000 7f4c9d615700 1 -- 172.21.15.179:0/1800515041 reap_dead start 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.918+0000 7f4c9f078700 1 -- 172.21.15.179:0/1800515041 shutdown_connections 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.918+0000 7f4c9f078700 1 -- 172.21.15.179:0/1800515041 >> 172.21.15.179:0/1800515041 conn(0x7f4c98072970 msgr2=0x7f4c98072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.918+0000 7f4c9f078700 1 -- 172.21.15.179:0/1800515041 shutdown_connections 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.918+0000 7f4c9f078700 1 -- 172.21.15.179:0/1800515041 wait complete. 2023-12-07T00:15:28.920 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.919+0000 7f4c9f078700 1 Processor -- start 2023-12-07T00:15:28.921 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.919+0000 7f4c9f078700 1 -- start start 2023-12-07T00:15:28.923 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9f078700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88004850 0x7f4c98140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:28.923 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9f078700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c9815ab90 0x7f4c9815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:28.923 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9f078700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c980b47a0 0x7f4c980b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:28.923 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9f078700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c981408b0 con 0x7f4c980b47a0 2023-12-07T00:15:28.923 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9f078700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9815b550 con 0x7f4c88004850 2023-12-07T00:15:28.923 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9f078700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c980b5500 con 0x7f4c9815ab90 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c980b47a0 0x7f4c980b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c980b47a0 0x7f4c980b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41360/0 (socket says 172.21.15.179:41360) 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 -- 172.21.15.179:0/869714772 learned_addr learned my addr 172.21.15.179:0/869714772 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9ce14700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88004850 0x7f4c98140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c97fff700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c9815ab90 0x7f4c9815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 -- 172.21.15.179:0/869714772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c9815ab90 msgr2=0x7f4c9815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c9815ab90 0x7f4c9815b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 -- 172.21.15.179:0/869714772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88004850 msgr2=0x7f4c98140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88004850 0x7f4c98140370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 -- 172.21.15.179:0/869714772 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980b57e0 con 0x7f4c980b47a0 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c9d615700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c980b47a0 0x7f4c980b4c50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4c980cdca0 tx=0x7f4c9000a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.920+0000 7f4c957fa700 1 -- 172.21.15.179:0/869714772 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9000ac70 con 0x7f4c980b47a0 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.921+0000 7f4c957fa700 1 -- 172.21.15.179:0/869714772 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9000ae10 con 0x7f4c980b47a0 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.921+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c98140d90 con 0x7f4c980b47a0 2023-12-07T00:15:28.924 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.921+0000 7f4c957fa700 1 -- 172.21.15.179:0/869714772 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c90013630 con 0x7f4c980b47a0 2023-12-07T00:15:28.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.921+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c980b5190 con 0x7f4c980b47a0 2023-12-07T00:15:28.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.922+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9804f290 con 0x7f4c980b47a0 2023-12-07T00:15:28.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.922+0000 7f4c957fa700 1 -- 172.21.15.179:0/869714772 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c90013790 con 0x7f4c980b47a0 2023-12-07T00:15:28.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.922+0000 7f4c957fa700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c7c06aed0 0x7f4c7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:28.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.922+0000 7f4c957fa700 1 -- 172.21.15.179:0/869714772 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4c90089f90 con 0x7f4c980b47a0 2023-12-07T00:15:28.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.923+0000 7f4c9ce14700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c7c06aed0 0x7f4c7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:28.925 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.923+0000 7f4c9ce14700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c7c06aed0 0x7f4c7c06d390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c007fd0 tx=0x7f4c8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:28.926 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:28.927+0000 7f4c957fa700 1 -- 172.21.15.179:0/869714772 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c90054f00 con 0x7f4c980b47a0 2023-12-07T00:15:29.118 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.119+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c981412b0 con 0x7f4c980b47a0 2023-12-07T00:15:29.119 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.120+0000 7f4c957fa700 1 -- 172.21.15.179:0/869714772 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16799 (secure 0 0 0) 0x7f4c981412b0 con 0x7f4c980b47a0 2023-12-07T00:15:29.119 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:29.120 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":40,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:15:28.171481+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:15:26.070056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-07T00:15:27.135451+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:29.121 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c7c06aed0 msgr2=0x7f4c7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c7c06aed0 0x7f4c7c06d390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c007fd0 tx=0x7f4c8c009040 comp rx=0 tx=0).stop 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c980b47a0 msgr2=0x7f4c980b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c980b47a0 0x7f4c980b4c50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4c980cdca0 tx=0x7f4c9000a5f0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 shutdown_connections 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4c7c06aed0 0x7f4c7c06d390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c980b47a0 0x7f4c980b4c50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c88004850 0x7f4c98140370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 --2- 172.21.15.179:0/869714772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c9815ab90 0x7f4c9815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 >> 172.21.15.179:0/869714772 conn(0x7f4c98072970 msgr2=0x7f4c9815d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 shutdown_connections 2023-12-07T00:15:29.122 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.122+0000 7f4c9f078700 1 -- 172.21.15.179:0/869714772 wait complete. 2023-12-07T00:15:29.134 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:29.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.255+0000 7f9e29aeb700 1 Processor -- start 2023-12-07T00:15:29.254 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.255+0000 7f9e29aeb700 1 -- start start 2023-12-07T00:15:29.256 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e29aeb700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9e2415bde0 0x7f9e240d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e29aeb700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e240cd020 0x7f9e240cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e29aeb700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9e24099c00 0x7f9e2409a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e29aeb700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2409a570 con 0x7f9e24099c00 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e29aeb700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2409ab50 con 0x7f9e2415bde0 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e29aeb700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240cf630 con 0x7f9e240cd020 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9e24099c00 0x7f9e2409a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9e24099c00 0x7f9e2409a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41368/0 (socket says 172.21.15.179:41368) 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 -- 172.21.15.179:0/1185769773 learned_addr learned my addr 172.21.15.179:0/1185769773 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e237fe700 1 --2- 172.21.15.179:0/1185769773 >> v2:172.21.15.190:3300/0 conn(0x7f9e2415bde0 0x7f9e240d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e22ffd700 1 --2- 172.21.15.179:0/1185769773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e240cd020 0x7f9e240cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 -- 172.21.15.179:0/1185769773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e240cd020 msgr2=0x7f9e240cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 --2- 172.21.15.179:0/1185769773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e240cd020 0x7f9e240cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 -- 172.21.15.179:0/1185769773 >> v2:172.21.15.190:3300/0 conn(0x7f9e2415bde0 msgr2=0x7f9e240d06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:29.257 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 --2- 172.21.15.179:0/1185769773 >> v2:172.21.15.190:3300/0 conn(0x7f9e2415bde0 0x7f9e240d06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 -- 172.21.15.179:0/1185769773 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e240cf8f0 con 0x7f9e24099c00 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e23fff700 1 --2- 172.21.15.179:0/1185769773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24099c00 0x7f9e2409a030 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9e2406c030 tx=0x7f9e1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33b3796fc930b46 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.256+0000 7f9e227fc700 1 -- 172.21.15.179:0/1185769773 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00e070 con 0x7f9e24099c00 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e227fc700 1 -- 172.21.15.179:0/1185769773 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1c00b910 con 0x7f9e24099c00 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e227fc700 1 -- 172.21.15.179:0/1185769773 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c00bcc0 con 0x7f9e24099c00 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 -- 172.21.15.179:0/1185769773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24099c00 msgr2=0x7f9e2409a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/1185769773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24099c00 0x7f9e2409a030 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9e2406c030 tx=0x7f9e1c00b330 comp rx=0 tx=0).stop 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 -- 172.21.15.179:0/1185769773 shutdown_connections 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/1185769773 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e24099c00 0x7f9e2409a030 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/1185769773 >> v2:172.21.15.190:3300/0 conn(0x7f9e2415bde0 0x7f9e240d06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/1185769773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e240cd020 0x7f9e240cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 -- 172.21.15.179:0/1185769773 >> 172.21.15.179:0/1185769773 conn(0x7f9e240b3550 msgr2=0x7f9e240b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 -- 172.21.15.179:0/1185769773 shutdown_connections 2023-12-07T00:15:29.258 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.257+0000 7f9e29aeb700 1 -- 172.21.15.179:0/1185769773 wait complete. 2023-12-07T00:15:29.260 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.258+0000 7f9e29aeb700 1 Processor -- start 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.258+0000 7f9e29aeb700 1 -- start start 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e29aeb700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e24099c00 0x7f9e24159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e29aeb700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240cd020 0x7f9e240cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e29aeb700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2415bde0 0x7f9e240cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e29aeb700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e240b5670 con 0x7f9e240cd020 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e29aeb700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2415c2f0 con 0x7f9e24099c00 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e29aeb700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2415c5d0 con 0x7f9e2415bde0 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e22ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240cd020 0x7f9e240cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e22ffd700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240cd020 0x7f9e240cad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41372/0 (socket says 172.21.15.179:41372) 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e22ffd700 1 -- 172.21.15.179:0/2383664868 learned_addr learned my addr 172.21.15.179:0/2383664868 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e237fe700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e24099c00 0x7f9e24159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.259+0000 7f9e23fff700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2415bde0 0x7f9e240cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e22ffd700 1 -- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2415bde0 msgr2=0x7f9e240cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.261 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e22ffd700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2415bde0 0x7f9e240cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e22ffd700 1 -- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e24099c00 msgr2=0x7f9e24159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e22ffd700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e24099c00 0x7f9e24159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e22ffd700 1 -- 172.21.15.179:0/2383664868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c009b30 con 0x7f9e240cd020 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e23fff700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2415bde0 0x7f9e240cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e22ffd700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240cd020 0x7f9e240cad00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800e9b0 tx=0x7f9e1800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e0bfff700 1 -- 172.21.15.179:0/2383664868 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18009710 con 0x7f9e240cd020 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e0bfff700 1 -- 172.21.15.179:0/2383664868 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800c850 con 0x7f9e240cd020 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2415c8b0 con 0x7f9e240cd020 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e0bfff700 1 -- 172.21.15.179:0/2383664868 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800cbc0 con 0x7f9e240cd020 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.260+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e241f1560 con 0x7f9e240cd020 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.261+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e241f1780 con 0x7f9e240cd020 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.261+0000 7f9e0bfff700 1 -- 172.21.15.179:0/2383664868 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e1800cd20 con 0x7f9e240cd020 2023-12-07T00:15:29.262 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.262+0000 7f9e0bfff700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9e1006aed0 0x7f9e1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.263 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.262+0000 7f9e237fe700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9e1006aed0 0x7f9e1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.263 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.262+0000 7f9e0bfff700 1 -- 172.21.15.179:0/2383664868 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9e18089770 con 0x7f9e240cd020 2023-12-07T00:15:29.263 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.262+0000 7f9e237fe700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9e1006aed0 0x7f9e1006d390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009ac0 tx=0x7f9e14009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:29.265 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.266+0000 7f9e0bfff700 1 -- 172.21.15.179:0/2383664868 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e180546d0 con 0x7f9e240cd020 2023-12-07T00:15:29.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.455+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e240685f0 con 0x7f9e240cd020 2023-12-07T00:15:29.455 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.456+0000 7f9e0bfff700 1 -- 172.21.15.179:0/2383664868 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16799 (secure 0 0 0) 0x7f9e18057cf0 con 0x7f9e240cd020 2023-12-07T00:15:29.456 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:29.456 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":40,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:15:28.171481+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:15:26.070056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-07T00:15:27.135451+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9e1006aed0 msgr2=0x7f9e1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9e1006aed0 0x7f9e1006d390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9e14009ac0 tx=0x7f9e14009210 comp rx=0 tx=0).stop 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240cd020 msgr2=0x7f9e240cad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240cd020 0x7f9e240cad00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800e9b0 tx=0x7f9e1800ecc0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 shutdown_connections 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f9e1006aed0 0x7f9e1006d390 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e2415bde0 0x7f9e240cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e24099c00 0x7f9e24159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 --2- 172.21.15.179:0/2383664868 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e240cd020 0x7f9e240cad00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 >> 172.21.15.179:0/2383664868 conn(0x7f9e240b3550 msgr2=0x7f9e240b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 shutdown_connections 2023-12-07T00:15:29.460 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.459+0000 7f9e29aeb700 1 -- 172.21.15.179:0/2383664868 wait complete. 2023-12-07T00:15:29.470 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-07T00:15:29.594 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.595+0000 7f072e13b700 1 Processor -- start 2023-12-07T00:15:29.595 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.595+0000 7f072e13b700 1 -- start start 2023-12-07T00:15:29.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f072e13b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 0x7f07280cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f072e13b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07280b2c40 0x7f072815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f072e13b700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07280cd980 con 0x7f072815bd10 2023-12-07T00:15:29.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f072e13b700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07280cc820 con 0x7f07280b2c40 2023-12-07T00:15:29.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f072e13b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07280cb780 con 0x7f07280cd060 2023-12-07T00:15:29.597 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f0726ffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f07280b2c40 0x7f072815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f0727fff700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f072815bd10 0x7f072815e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48284/0 (socket says 172.21.15.179:48284) 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f0727fff700 1 -- 172.21.15.179:0/2062166778 learned_addr learned my addr 172.21.15.179:0/2062166778 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.596+0000 7f07277fe700 1 --2- 172.21.15.179:0/2062166778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 0x7f07280cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f07267fc700 1 -- 172.21.15.179:0/2062166778 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991045745 0 0) 0x7f07280cd980 con 0x7f072815bd10 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f07267fc700 1 -- 172.21.15.179:0/2062166778 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07100035b0 con 0x7f072815bd10 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f0726ffd700 1 -- 172.21.15.179:0/2062166778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 msgr2=0x7f07280cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f0726ffd700 1 --2- 172.21.15.179:0/2062166778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 0x7f07280cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f0726ffd700 1 -- 172.21.15.179:0/2062166778 >> v1:172.21.15.179:6789/0 conn(0x7f072815bd10 legacy=0x7f072815e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f0726ffd700 1 -- 172.21.15.179:0/2062166778 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07280cba60 con 0x7f07280b2c40 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f0726ffd700 1 --2- 172.21.15.179:0/2062166778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f072815b7d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0718009840 tx=0x7f0718009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356a20843f51ede4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f07267fc700 1 -- 172.21.15.179:0/2062166778 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718011830 con 0x7f07280b2c40 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f07267fc700 1 -- 172.21.15.179:0/2062166778 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0718011990 con 0x7f07280b2c40 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f07267fc700 1 -- 172.21.15.179:0/2062166778 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718011d20 con 0x7f07280b2c40 2023-12-07T00:15:29.598 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f072e13b700 1 -- 172.21.15.179:0/2062166778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 msgr2=0x7f072815b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f072e13b700 1 --2- 172.21.15.179:0/2062166778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f072815b7d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0718009840 tx=0x7f0718009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:29.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.597+0000 7f072e13b700 1 -- 172.21.15.179:0/2062166778 shutdown_connections 2023-12-07T00:15:29.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.598+0000 7f072e13b700 1 --2- 172.21.15.179:0/2062166778 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 0x7f07280cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.598+0000 7f072e13b700 1 --2- 172.21.15.179:0/2062166778 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f072815b7d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.598+0000 7f072e13b700 1 -- 172.21.15.179:0/2062166778 >> 172.21.15.179:0/2062166778 conn(0x7f0728099a40 msgr2=0x7f07280b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:29.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.598+0000 7f072e13b700 1 -- 172.21.15.179:0/2062166778 shutdown_connections 2023-12-07T00:15:29.599 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.598+0000 7f072e13b700 1 -- 172.21.15.179:0/2062166778 wait complete. 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.599+0000 7f072e13b700 1 Processor -- start 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.599+0000 7f072e13b700 1 -- start start 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f072e13b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f07280c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f072e13b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 0x7f07280b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f072e13b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f072815bd10 0x7f07280c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f072e13b700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07280b5860 con 0x7f07280b2c40 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f072e13b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07280b5b00 con 0x7f072815bd10 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f072e13b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07280b5de0 con 0x7f07280cd060 2023-12-07T00:15:29.602 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f07280c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f07280c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41384/0 (socket says 172.21.15.179:41384) 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 -- 172.21.15.179:0/2479335032 learned_addr learned my addr 172.21.15.179:0/2479335032 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f0727fff700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f072815bd10 0x7f07280c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f0726ffd700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 0x7f07280b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 -- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 msgr2=0x7f07280b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 0x7f07280b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 -- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f072815bd10 msgr2=0x7f07280c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f072815bd10 0x7f07280c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 -- 172.21.15.179:0/2479335032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07180094a0 con 0x7f07280b2c40 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f0727fff700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f072815bd10 0x7f07280c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f07277fe700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f07280c8f00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f071c00e9b0 tx=0x7f071c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f070ffff700 1 -- 172.21.15.179:0/2479335032 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c009710 con 0x7f07280b2c40 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f070ffff700 1 -- 172.21.15.179:0/2479335032 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c00c850 con 0x7f07280b2c40 2023-12-07T00:15:29.603 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07280b60c0 con 0x7f07280b2c40 2023-12-07T00:15:29.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f070ffff700 1 -- 172.21.15.179:0/2479335032 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c00cbc0 con 0x7f07280b2c40 2023-12-07T00:15:29.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.600+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07281f1d50 con 0x7f07280b2c40 2023-12-07T00:15:29.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.601+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07281f1ee0 con 0x7f07280b2c40 2023-12-07T00:15:29.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.602+0000 7f070ffff700 1 -- 172.21.15.179:0/2479335032 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f071c00cd20 con 0x7f07280b2c40 2023-12-07T00:15:29.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.602+0000 7f070ffff700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f071406aed0 0x7f071406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:29.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.602+0000 7f070ffff700 1 -- 172.21.15.179:0/2479335032 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f071c089780 con 0x7f07280b2c40 2023-12-07T00:15:29.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.602+0000 7f0726ffd700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f071406aed0 0x7f071406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:29.604 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.603+0000 7f0726ffd700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f071406aed0 0x7f071406d390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f07280b3080 tx=0x7f0718008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:29.605 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.607+0000 7f070ffff700 1 -- 172.21.15.179:0/2479335032 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f071c054780 con 0x7f07280b2c40 2023-12-07T00:15:29.847 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:29.848+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f07280685f0 con 0x7f07280b2c40 2023-12-07T00:15:30.798 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.799+0000 7f070ffff700 1 -- 172.21.15.179:0/2479335032 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f071c057da0 con 0x7f07280b2c40 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f071406aed0 msgr2=0x7f071406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f071406aed0 0x7f071406d390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f07280b3080 tx=0x7f0718008030 comp rx=0 tx=0).stop 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 msgr2=0x7f07280c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f07280c8f00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f071c00e9b0 tx=0x7f071c00ed70 comp rx=0 tx=0).stop 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 shutdown_connections 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f071406aed0 0x7f071406d390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f072815bd10 0x7f07280c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f07280b2c40 0x7f07280c8f00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 --2- 172.21.15.179:0/2479335032 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07280cd060 0x7f07280b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.802+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 >> 172.21.15.179:0/2479335032 conn(0x7f0728099a40 msgr2=0x7f07280739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.803+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 shutdown_connections 2023-12-07T00:15:30.802 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.803+0000 7f072e13b700 1 -- 172.21.15.179:0/2479335032 wait complete. 2023-12-07T00:15:30.816 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-07T00:15:30.816 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-07T00:15:30.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.948+0000 7fed5e7d1700 1 Processor -- start 2023-12-07T00:15:30.947 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.948+0000 7fed5e7d1700 1 -- start start 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed5e7d1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fed5815de50 0x7fed580cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed5e7d1700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed580ccc90 0x7fed5806af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed5e7d1700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed580cc550 con 0x7fed5806b4b0 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed5e7d1700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5806b930 con 0x7fed5815de50 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed5e7d1700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed580cd1c0 con 0x7fed580ccc90 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed577fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed580ccc90 0x7fed5806af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed57fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fed5815de50 0x7fed580cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed577fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed580ccc90 0x7fed5806af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41806/0 (socket says 172.21.15.179:41806) 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed57fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fed5815de50 0x7fed580cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:43644/0 (socket says 172.21.15.179:43644) 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed577fe700 1 -- 172.21.15.179:0/3767003914 learned_addr learned my addr 172.21.15.179:0/3767003914 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.949+0000 7fed5cd6e700 1 --1- 172.21.15.179:0/3767003914 >> v1:172.21.15.190:6789/0 conn(0x7fed5806b4b0 0x7fed581619b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:54976/0 (socket says 172.21.15.179:54976) 2023-12-07T00:15:30.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed57fff700 1 -- 172.21.15.179:0/3767003914 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed580ccc90 msgr2=0x7fed5806af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed57fff700 1 --2- 172.21.15.179:0/3767003914 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed580ccc90 0x7fed5806af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed57fff700 1 -- 172.21.15.179:0/3767003914 >> v1:172.21.15.190:6789/0 conn(0x7fed5806b4b0 legacy=0x7fed581619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed56ffd700 1 -- 172.21.15.179:0/3767003914 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210563522 0 0) 0x7fed580cc550 con 0x7fed5806b4b0 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed57fff700 1 -- 172.21.15.179:0/3767003914 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580cd4a0 con 0x7fed5815de50 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed577fe700 1 --2- 172.21.15.179:0/3767003914 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed580ccc90 0x7fed5806af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed57fff700 1 --2- 172.21.15.179:0/3767003914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 0x7fed580cc010 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009840 tx=0x7fed4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c730d92913421da9 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed56ffd700 1 -- 172.21.15.179:0/3767003914 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c011830 con 0x7fed5815de50 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed56ffd700 1 -- 172.21.15.179:0/3767003914 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c011990 con 0x7fed5815de50 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed56ffd700 1 -- 172.21.15.179:0/3767003914 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c011d20 con 0x7fed5815de50 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed5e7d1700 1 -- 172.21.15.179:0/3767003914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 msgr2=0x7fed580cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/3767003914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 0x7fed580cc010 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009840 tx=0x7fed4c009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.950+0000 7fed5e7d1700 1 -- 172.21.15.179:0/3767003914 shutdown_connections 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.951+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/3767003914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 0x7fed580cc010 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.951+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/3767003914 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed580ccc90 0x7fed5806af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.951+0000 7fed5e7d1700 1 -- 172.21.15.179:0/3767003914 >> 172.21.15.179:0/3767003914 conn(0x7fed58099a40 msgr2=0x7fed58099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:30.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.951+0000 7fed5e7d1700 1 -- 172.21.15.179:0/3767003914 shutdown_connections 2023-12-07T00:15:30.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.951+0000 7fed5e7d1700 1 -- 172.21.15.179:0/3767003914 wait complete. 2023-12-07T00:15:30.954 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.952+0000 7fed5e7d1700 1 Processor -- start 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.952+0000 7fed5e7d1700 1 -- start start 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed5e7d1700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed5806b4b0 0x7fed5814f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed5e7d1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed580ccc90 0x7fed581f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed5e7d1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 0x7fed580c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed5e7d1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580c53e0 con 0x7fed580ccc90 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed5e7d1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed580add30 con 0x7fed5815de50 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed5e7d1700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed581f4670 con 0x7fed5806b4b0 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed580ccc90 0x7fed581f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed580ccc90 0x7fed581f3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41400/0 (socket says 172.21.15.179:41400) 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 -- 172.21.15.179:0/2368843388 learned_addr learned my addr 172.21.15.179:0/2368843388 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed57fff700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed5806b4b0 0x7fed5814f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed5cd6e700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 0x7fed580c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 -- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed5806b4b0 msgr2=0x7fed5814f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed5806b4b0 0x7fed5814f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 -- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 msgr2=0x7fed580c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 0x7fed580c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 -- 172.21.15.179:0/2368843388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed48009550 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed57fff700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed5806b4b0 0x7fed5814f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed577fe700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed580ccc90 0x7fed581f3f70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fed4800ebb0 tx=0x7fed4800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed54ff9700 1 -- 172.21.15.179:0/2368843388 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4800c910 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed54ff9700 1 -- 172.21.15.179:0/2368843388 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4800ca70 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c0094a0 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.953+0000 7fed54ff9700 1 -- 172.21.15.179:0/2368843388 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4800ce20 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.954+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed581f4c30 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.954+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed580ae010 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.955+0000 7fed54ff9700 1 -- 172.21.15.179:0/2368843388 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed48013470 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.955+0000 7fed54ff9700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fed4406aed0 0x7fed4406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.955+0000 7fed54ff9700 1 -- 172.21.15.179:0/2368843388 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fed48089860 con 0x7fed580ccc90 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.955+0000 7fed57fff700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fed4406aed0 0x7fed4406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:30.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.956+0000 7fed57fff700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fed4406aed0 0x7fed4406d390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0090b0 tx=0x7fed4c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:30.959 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:30.960+0000 7fed54ff9700 1 -- 172.21.15.179:0/2368843388 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed48054860 con 0x7fed580ccc90 2023-12-07T00:15:31.194 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.195+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fed580685f0 con 0x7fed580ccc90 2023-12-07T00:15:31.801 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.802+0000 7fed54ff9700 1 -- 172.21.15.179:0/2368843388 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed480170c0 con 0x7fed580ccc90 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fed4406aed0 msgr2=0x7fed4406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fed4406aed0 0x7fed4406d390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0090b0 tx=0x7fed4c008030 comp rx=0 tx=0).stop 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed580ccc90 msgr2=0x7fed581f3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed580ccc90 0x7fed581f3f70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fed4800ebb0 tx=0x7fed4800ef70 comp rx=0 tx=0).stop 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 shutdown_connections 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fed4406aed0 0x7fed4406d390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed5815de50 0x7fed580c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed5806b4b0 0x7fed5814f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 --2- 172.21.15.179:0/2368843388 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fed580ccc90 0x7fed581f3f70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 >> 172.21.15.179:0/2368843388 conn(0x7fed58099a40 msgr2=0x7fed580b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 shutdown_connections 2023-12-07T00:15:31.805 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.805+0000 7fed5e7d1700 1 -- 172.21.15.179:0/2368843388 wait complete. 2023-12-07T00:15:31.819 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-07T00:15:31.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:15:31.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.945+0000 7f668e3f4700 1 Processor -- start 2023-12-07T00:15:31.944 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.945+0000 7f668e3f4700 1 -- start start 2023-12-07T00:15:31.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f668e3f4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f668815ad10 0x7f6688099a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.948 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f668e3f4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f66880b3c50 0x7f66880adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f668e3f4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880ae3e0 con 0x7f66880b0a60 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f668e3f4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880b07f0 con 0x7f66880b3c50 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f668e3f4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66880cc690 con 0x7f668815ad10 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f668c991700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f66880b0a60 0x7f668806bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48312/0 (socket says 172.21.15.179:48312) 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f668c991700 1 -- 172.21.15.179:0/614071875 learned_addr learned my addr 172.21.15.179:0/614071875 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6687fff700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f668815ad10 0x7f6688099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f66877fe700 1 --2- 172.21.15.179:0/614071875 >> v2:172.21.15.190:3300/0 conn(0x7f66880b3c50 0x7f66880adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802630521 0 0) 0x7f66880ae3e0 con 0x7f66880b0a60 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66700035b0 con 0x7f66880b0a60 2023-12-07T00:15:31.949 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 116465874 0 0) 0x7f66700035b0 con 0x7f66880b0a60 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f668815ad10 msgr2=0x7f6688099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f668815ad10 0x7f6688099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 >> v2:172.21.15.190:3300/0 conn(0x7f66880b3c50 msgr2=0x7f66880adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 --2- 172.21.15.179:0/614071875 >> v2:172.21.15.190:3300/0 conn(0x7f66880b3c50 0x7f66880adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880cc3f0 con 0x7f66880b0a60 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f66800019f0 con 0x7f66880b0a60 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 >> v1:172.21.15.179:6789/0 conn(0x7f66880b0a60 legacy=0x7f668806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.946+0000 7f6686ffd700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670003a00 0x7f6670003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6686ffd700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6670004850 0x7f6670004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6686ffd700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f668815ad10 0x7f6670005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880b07f0 con 0x7f6670004850 2023-12-07T00:15:31.950 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880cc690 con 0x7f6670003a00 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667000ba90 con 0x7f668815ad10 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f66877fe700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6670004850 0x7f6670004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6687fff700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670003a00 0x7f6670003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f668c991700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f668815ad10 0x7f6670005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f66877fe700 1 -- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f668815ad10 msgr2=0x7f6670005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f66877fe700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f668815ad10 0x7f6670005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f66877fe700 1 -- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670003a00 msgr2=0x7f6670003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f66877fe700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670003a00 0x7f6670003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f66877fe700 1 -- 172.21.15.179:0/614071875 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700035b0 con 0x7f6670004850 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f66877fe700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6670004850 0x7f6670004cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6678009b60 tx=0x7f6670005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd31fab9e400131 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800e6c0 con 0x7f6670004850 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667800e820 con 0x7f6670004850 2023-12-07T00:15:31.951 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.947+0000 7f6686ffd700 1 -- 172.21.15.179:0/614071875 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800eb90 con 0x7f6670004850 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.948+0000 7f668e3f4700 1 -- 172.21.15.179:0/614071875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6670004850 msgr2=0x7f6670004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.948+0000 7f668e3f4700 1 --2- 172.21.15.179:0/614071875 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6670004850 0x7f6670004cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f6678009b60 tx=0x7f6670005880 comp rx=0 tx=0).stop 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.948+0000 7f668c991700 1 -- 172.21.15.179:0/614071875 reap_dead start 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.948+0000 7f668e3f4700 1 -- 172.21.15.179:0/614071875 shutdown_connections 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.948+0000 7f668e3f4700 1 -- 172.21.15.179:0/614071875 >> 172.21.15.179:0/614071875 conn(0x7f6688072660 msgr2=0x7f66880b4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.948+0000 7f668e3f4700 1 -- 172.21.15.179:0/614071875 shutdown_connections 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.948+0000 7f668e3f4700 1 -- 172.21.15.179:0/614071875 wait complete. 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.949+0000 7f668e3f4700 1 Processor -- start 2023-12-07T00:15:31.952 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.949+0000 7f668e3f4700 1 -- start start 2023-12-07T00:15:31.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f668e3f4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670004850 0x7f66881520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f668e3f4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f668814ea50 0x7f66881551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f668e3f4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6688155720 0x7f668813bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f668e3f4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688155ba0 con 0x7f668814ea50 2023-12-07T00:15:31.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f668e3f4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66881525f0 con 0x7f6670004850 2023-12-07T00:15:31.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f668e3f4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668813cb20 con 0x7f6688155720 2023-12-07T00:15:31.955 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f668814ea50 0x7f66881551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f668814ea50 0x7f66881551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41420/0 (socket says 172.21.15.179:41420) 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 -- 172.21.15.179:0/2442577935 learned_addr learned my addr 172.21.15.179:0/2442577935 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f6687fff700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670004850 0x7f66881520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f668c991700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6688155720 0x7f668813bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 -- 172.21.15.179:0/2442577935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6688155720 msgr2=0x7f668813bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6688155720 0x7f668813bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 -- 172.21.15.179:0/2442577935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670004850 msgr2=0x7f66881520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670004850 0x7f66881520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 -- 172.21.15.179:0/2442577935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668814dc90 con 0x7f668814ea50 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.950+0000 7f66877fe700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f668814ea50 0x7f66881551e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f667800e4b0 tx=0x7f66780047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.951+0000 7f6684ff9700 1 -- 172.21.15.179:0/2442577935 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667800e6c0 con 0x7f668814ea50 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.951+0000 7f6684ff9700 1 -- 172.21.15.179:0/2442577935 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678003ab0 con 0x7f668814ea50 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.951+0000 7f6684ff9700 1 -- 172.21.15.179:0/2442577935 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678003e60 con 0x7f668814ea50 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.951+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668814df70 con 0x7f668814ea50 2023-12-07T00:15:31.956 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.951+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668814e530 con 0x7f668814ea50 2023-12-07T00:15:31.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.952+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668814e8a0 con 0x7f668814ea50 2023-12-07T00:15:31.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.952+0000 7f6684ff9700 1 -- 172.21.15.179:0/2442577935 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6678013470 con 0x7f668814ea50 2023-12-07T00:15:31.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.952+0000 7f6684ff9700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f667406ae60 0x7f667406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:31.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.953+0000 7f6684ff9700 1 -- 172.21.15.179:0/2442577935 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f667808b020 con 0x7f668814ea50 2023-12-07T00:15:31.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.953+0000 7f6687fff700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f667406ae60 0x7f667406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:31.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.953+0000 7f6687fff700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f667406ae60 0x7f667406d320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f667c009b00 tx=0x7f667c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:31.957 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:31.957+0000 7f6684ff9700 1 -- 172.21.15.179:0/2442577935 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6678056140 con 0x7f668814ea50 2023-12-07T00:15:32.190 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.191+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66880685f0 con 0x7f668814ea50 2023-12-07T00:15:32.191 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.192+0000 7f6684ff9700 1 -- 172.21.15.179:0/2442577935 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f6678059760 con 0x7f668814ea50 2023-12-07T00:15:32.191 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:32.191 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1831294564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":1831294564},{"type":"v1","addr":"172.21.15.190:6835","nonce":1831294564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3698573252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3698573252},{"type":"v1","addr":"172.21.15.190:6834","nonce":3698573252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1747978630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1747978630},{"type":"v1","addr":"172.21.15.179:6836","nonce":1747978630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:15:28.171797+0000","modified":"2023-12-07T00:15:31.196712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3161235437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3161235437},{"type":"v1","addr":"172.21.15.179:6837","nonce":3161235437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-07T00:15:32.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f667406ae60 msgr2=0x7f667406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f667406ae60 0x7f667406d320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f667c009b00 tx=0x7f667c009210 comp rx=0 tx=0).stop 2023-12-07T00:15:32.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f668814ea50 msgr2=0x7f66881551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f668814ea50 0x7f66881551e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f667800e4b0 tx=0x7f66780047c0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.193 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 shutdown_connections 2023-12-07T00:15:32.194 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f667406ae60 0x7f667406d320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.194 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6688155720 0x7f668813bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.194 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6670004850 0x7f66881520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.194 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 --2- 172.21.15.179:0/2442577935 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f668814ea50 0x7f66881551e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.194 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 >> 172.21.15.179:0/2442577935 conn(0x7f6688072660 msgr2=0x7f668806e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:32.194 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 shutdown_connections 2023-12-07T00:15:32.194 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.194+0000 7f668e3f4700 1 -- 172.21.15.179:0/2442577935 wait complete. 2023-12-07T00:15:32.194 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 18 2023-12-07T00:15:32.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T00:15:32.325 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.326+0000 7f85333d1700 1 Processor -- start 2023-12-07T00:15:32.326 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.327+0000 7f85333d1700 1 -- start start 2023-12-07T00:15:32.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.327+0000 7f85333d1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f852c15de40 0x7f852c0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.327+0000 7f85333d1700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f852c15e220 0x7f852c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.327+0000 7f85333d1700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852c15f330 con 0x7f852c0b4c20 2023-12-07T00:15:32.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.327+0000 7f85333d1700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c0d1820 con 0x7f852c15e220 2023-12-07T00:15:32.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.327+0000 7f85333d1700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f852c15e720 con 0x7f852c15de40 2023-12-07T00:15:32.328 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853196e700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f852c0b4c20 0x7f852c06af70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48330/0 (socket says 172.21.15.179:48330) 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853096c700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f852c15e220 0x7f852c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853196e700 1 -- 172.21.15.179:0/4182363874 learned_addr learned my addr 172.21.15.179:0/4182363874 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853116d700 1 --2- 172.21.15.179:0/4182363874 >> v2:172.21.15.190:3300/0 conn(0x7f852c15de40 0x7f852c0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f8523fff700 1 -- 172.21.15.179:0/4182363874 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020909637 0 0) 0x7f852c15f330 con 0x7f852c0b4c20 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f8523fff700 1 -- 172.21.15.179:0/4182363874 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85180035b0 con 0x7f852c0b4c20 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853096c700 1 -- 172.21.15.179:0/4182363874 >> v2:172.21.15.190:3300/0 conn(0x7f852c15de40 msgr2=0x7f852c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853096c700 1 --2- 172.21.15.179:0/4182363874 >> v2:172.21.15.190:3300/0 conn(0x7f852c15de40 0x7f852c0b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853096c700 1 -- 172.21.15.179:0/4182363874 >> v1:172.21.15.179:6789/0 conn(0x7f852c0b4c20 legacy=0x7f852c06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853096c700 1 -- 172.21.15.179:0/4182363874 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852c15ea00 con 0x7f852c15e220 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f853096c700 1 --2- 172.21.15.179:0/4182363874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c0b2560 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f852c06bfd0 tx=0x7f8528009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4425b048fc462e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f8523fff700 1 -- 172.21.15.179:0/4182363874 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528005e30 con 0x7f852c15e220 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f8523fff700 1 -- 172.21.15.179:0/4182363874 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528006030 con 0x7f852c15e220 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.328+0000 7f8523fff700 1 -- 172.21.15.179:0/4182363874 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85280063c0 con 0x7f852c15e220 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.329+0000 7f85333d1700 1 -- 172.21.15.179:0/4182363874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 msgr2=0x7f852c0b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.329 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.329+0000 7f85333d1700 1 --2- 172.21.15.179:0/4182363874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c0b2560 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f852c06bfd0 tx=0x7f8528009b00 comp rx=0 tx=0).stop 2023-12-07T00:15:32.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.329+0000 7f85333d1700 1 -- 172.21.15.179:0/4182363874 shutdown_connections 2023-12-07T00:15:32.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.329+0000 7f85333d1700 1 --2- 172.21.15.179:0/4182363874 >> v2:172.21.15.190:3300/0 conn(0x7f852c15de40 0x7f852c0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.329+0000 7f85333d1700 1 --2- 172.21.15.179:0/4182363874 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c0b2560 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.329+0000 7f85333d1700 1 -- 172.21.15.179:0/4182363874 >> 172.21.15.179:0/4182363874 conn(0x7f852c072970 msgr2=0x7f852c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:32.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.329+0000 7f85333d1700 1 -- 172.21.15.179:0/4182363874 shutdown_connections 2023-12-07T00:15:32.330 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.329+0000 7f85333d1700 1 -- 172.21.15.179:0/4182363874 wait complete. 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.330+0000 7f85333d1700 1 Processor -- start 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.330+0000 7f85333d1700 1 -- start start 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f85333d1700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f852c0b4c20 0x7f852c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f85333d1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f852c15de40 0x7f852c148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f85333d1700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f85333d1700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0cb610 con 0x7f852c15e220 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f85333d1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0cb8f0 con 0x7f852c15de40 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f85333d1700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852c0cbbd0 con 0x7f852c0b4c20 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f853196e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f853196e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c1488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41434/0 (socket says 172.21.15.179:41434) 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.331+0000 7f853196e700 1 -- 172.21.15.179:0/2454569916 learned_addr learned my addr 172.21.15.179:0/2454569916 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853096c700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f852c15de40 0x7f852c148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.334 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853116d700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f852c0b4c20 0x7f852c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853196e700 1 -- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f852c0b4c20 msgr2=0x7f852c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853196e700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f852c0b4c20 0x7f852c0caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853196e700 1 -- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f852c15de40 msgr2=0x7f852c148370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853196e700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f852c15de40 0x7f852c148370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853196e700 1 -- 172.21.15.179:0/2454569916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528009430 con 0x7f852c15e220 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853096c700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f852c15de40 0x7f852c148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f853196e700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c1488b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f852400caa0 tx=0x7f852400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f8521ffb700 1 -- 172.21.15.179:0/2454569916 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852400aa80 con 0x7f852c15e220 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f8521ffb700 1 -- 172.21.15.179:0/2454569916 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852400abe0 con 0x7f852c15e220 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852c0cbeb0 con 0x7f852c15e220 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f8521ffb700 1 -- 172.21.15.179:0/2454569916 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524012400 con 0x7f852c15e220 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.332+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852c0cb1e0 con 0x7f852c15e220 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.333+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852c0cc6b0 con 0x7f852c15e220 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.333+0000 7f8521ffb700 1 -- 172.21.15.179:0/2454569916 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f852401b3b0 con 0x7f852c15e220 2023-12-07T00:15:32.335 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.334+0000 7f8521ffb700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f851006aed0 0x7f851006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.334+0000 7f8521ffb700 1 -- 172.21.15.179:0/2454569916 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8524089470 con 0x7f852c15e220 2023-12-07T00:15:32.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.334+0000 7f853116d700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f851006aed0 0x7f851006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.336 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.334+0000 7f853116d700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f851006aed0 0x7f851006d390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f852c0ce280 tx=0x7f851c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:32.337 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.338+0000 7f8521ffb700 1 -- 172.21.15.179:0/2454569916 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85240543e0 con 0x7f852c15e220 2023-12-07T00:15:32.529 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.530+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f852c04f290 con 0x7f852c15e220 2023-12-07T00:15:32.530 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.531+0000 7f8521ffb700 1 -- 172.21.15.179:0/2454569916 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16786 (secure 0 0 0) 0x7f8524057a00 con 0x7f852c15e220 2023-12-07T00:15:32.531 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:32.531 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":41,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T00:15:29.612986+0000","last_up_change":"2023-12-07T00:14:00.533174+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:15:26.070056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-07T00:15:27.135451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists","up"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists","up"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T00:15:32.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f851006aed0 msgr2=0x7f851006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f851006aed0 0x7f851006d390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f852c0ce280 tx=0x7f851c008040 comp rx=0 tx=0).stop 2023-12-07T00:15:32.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 msgr2=0x7f852c1488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c1488b0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f852400caa0 tx=0x7f852400ce60 comp rx=0 tx=0).stop 2023-12-07T00:15:32.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 shutdown_connections 2023-12-07T00:15:32.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f851006aed0 0x7f851006d390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.533 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f852c15e220 0x7f852c1488b0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f852c0b4c20 0x7f852c0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 --2- 172.21.15.179:0/2454569916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f852c15de40 0x7f852c148370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 >> 172.21.15.179:0/2454569916 conn(0x7f852c072970 msgr2=0x7f852c0b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:32.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 shutdown_connections 2023-12-07T00:15:32.534 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.534+0000 7f85333d1700 1 -- 172.21.15.179:0/2454569916 wait complete. 2023-12-07T00:15:32.546 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-07T00:15:32.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T00:15:32.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.668+0000 7fd081ba3700 1 Processor -- start 2023-12-07T00:15:32.668 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.668+0000 7fd081ba3700 1 -- start start 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd081ba3700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd07c15de40 0x7fd07c0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd081ba3700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd07c15e220 0x7fd07c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd081ba3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07c15f330 con 0x7fd07c0b4c20 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd081ba3700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c0d1820 con 0x7fd07c15de40 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd081ba3700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd07c15e720 con 0x7fd07c15e220 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd07b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd07c15de40 0x7fd07c0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd07b7fe700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd07c15de40 0x7fd07c0b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41440/0 (socket says 172.21.15.179:41440) 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd07b7fe700 1 -- 172.21.15.179:0/1143371587 learned_addr learned my addr 172.21.15.179:0/1143371587 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd07affd700 1 --2- 172.21.15.179:0/1143371587 >> v2:172.21.15.190:3300/0 conn(0x7fd07c15e220 0x7fd07c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.670 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd07b7fe700 1 -- 172.21.15.179:0/1143371587 >> v2:172.21.15.190:3300/0 conn(0x7fd07c15e220 msgr2=0x7fd07c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd07b7fe700 1 --2- 172.21.15.179:0/1143371587 >> v2:172.21.15.190:3300/0 conn(0x7fd07c15e220 0x7fd07c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd07b7fe700 1 -- 172.21.15.179:0/1143371587 >> v1:172.21.15.190:6789/0 conn(0x7fd07c0b4c20 legacy=0x7fd07c06af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.669+0000 7fd07b7fe700 1 -- 172.21.15.179:0/1143371587 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07c15ea00 con 0x7fd07c15de40 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd07b7fe700 1 --2- 172.21.15.179:0/1143371587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15de40 0x7fd07c0b46e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd07c15f2a0 tx=0x7fd070009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ba9aa46d1443b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd07a7fc700 1 -- 172.21.15.179:0/1143371587 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070004230 con 0x7fd07c15de40 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd07a7fc700 1 -- 172.21.15.179:0/1143371587 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd070004390 con 0x7fd07c15de40 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd07a7fc700 1 -- 172.21.15.179:0/1143371587 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0700036a0 con 0x7fd07c15de40 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd081ba3700 1 -- 172.21.15.179:0/1143371587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15de40 msgr2=0x7fd07c0b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd081ba3700 1 --2- 172.21.15.179:0/1143371587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15de40 0x7fd07c0b46e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd07c15f2a0 tx=0x7fd070009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd081ba3700 1 -- 172.21.15.179:0/1143371587 shutdown_connections 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd081ba3700 1 --2- 172.21.15.179:0/1143371587 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15de40 0x7fd07c0b46e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd081ba3700 1 --2- 172.21.15.179:0/1143371587 >> v2:172.21.15.190:3300/0 conn(0x7fd07c15e220 0x7fd07c0b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd081ba3700 1 -- 172.21.15.179:0/1143371587 >> 172.21.15.179:0/1143371587 conn(0x7fd07c072970 msgr2=0x7fd07c072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:32.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd081ba3700 1 -- 172.21.15.179:0/1143371587 shutdown_connections 2023-12-07T00:15:32.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.670+0000 7fd081ba3700 1 -- 172.21.15.179:0/1143371587 wait complete. 2023-12-07T00:15:32.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.671+0000 7fd081ba3700 1 Processor -- start 2023-12-07T00:15:32.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.672+0000 7fd081ba3700 1 -- start start 2023-12-07T00:15:32.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.672+0000 7fd081ba3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07c0b4c20 0x7fd07c06b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.672+0000 7fd081ba3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd07c15de40 0x7fd07c1e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.672+0000 7fd081ba3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15e220 0x7fd07c14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.672+0000 7fd081ba3700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c1e7b40 con 0x7fd07c15e220 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.672+0000 7fd081ba3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c1e7e20 con 0x7fd07c0b4c20 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.672+0000 7fd081ba3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd07c1e8100 con 0x7fd07c15de40 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15e220 0x7fd07c14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15e220 0x7fd07c14a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41450/0 (socket says 172.21.15.179:41450) 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 -- 172.21.15.179:0/4021315222 learned_addr learned my addr 172.21.15.179:0/4021315222 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07b7fe700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07c0b4c20 0x7fd07c06b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07affd700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd07c15de40 0x7fd07c1e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 -- 172.21.15.179:0/4021315222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd07c15de40 msgr2=0x7fd07c1e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd07c15de40 0x7fd07c1e70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 -- 172.21.15.179:0/4021315222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07c0b4c20 msgr2=0x7fd07c06b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07c0b4c20 0x7fd07c06b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 -- 172.21.15.179:0/4021315222 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070009550 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd07bfff700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15e220 0x7fd07c14a160 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd07400b970 tx=0x7fd07400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd063fff700 1 -- 172.21.15.179:0/4021315222 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400d860 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd063fff700 1 -- 172.21.15.179:0/4021315222 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07400d9c0 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd063fff700 1 -- 172.21.15.179:0/4021315222 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07400dd70 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07c1e83e0 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.673+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07c0a86c0 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.674+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07c04f290 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.675+0000 7fd063fff700 1 -- 172.21.15.179:0/4021315222 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd07400e430 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.675+0000 7fd063fff700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd06806aed0 0x7fd06806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.675+0000 7fd063fff700 1 -- 172.21.15.179:0/4021315222 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd074089530 con 0x7fd07c15e220 2023-12-07T00:15:32.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.675+0000 7fd07b7fe700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd06806aed0 0x7fd06806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:32.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.675+0000 7fd07b7fe700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd06806aed0 0x7fd06806d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd070009130 tx=0x7fd070008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:32.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.679+0000 7fd063fff700 1 -- 172.21.15.179:0/4021315222 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0740544c0 con 0x7fd07c15e220 2023-12-07T00:15:32.749 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T00:15:32.750+0000 7f6895d1d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-07T00:15:32.869 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.869+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 --> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd07c15efc0 con 0x7fd06806aed0 2023-12-07T00:15:32.877 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.878+0000 7fd063fff700 1 -- 172.21.15.179:0/4021315222 <== mgr.4104 v2:172.21.15.179:6832/1592863421 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289159 (secure 0 0 0) 0x7fd070004130 con 0x7fd06806aed0 2023-12-07T00:15:32.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:32.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd06806aed0 msgr2=0x7fd06806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd06806aed0 0x7fd06806d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd070009130 tx=0x7fd070008030 comp rx=0 tx=0).stop 2023-12-07T00:15:32.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15e220 msgr2=0x7fd07c14a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15e220 0x7fd07c14a160 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd07400b970 tx=0x7fd07400bc80 comp rx=0 tx=0).stop 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 shutdown_connections 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fd06806aed0 0x7fd06806d390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd07c15e220 0x7fd07c14a160 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd07c0b4c20 0x7fd07c06b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 --2- 172.21.15.179:0/4021315222 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd07c15de40 0x7fd07c1e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 >> 172.21.15.179:0/4021315222 conn(0x7fd07c072970 msgr2=0x7fd07c0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 shutdown_connections 2023-12-07T00:15:32.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:32.881+0000 7fd081ba3700 1 -- 172.21.15.179:0/4021315222 wait complete. 2023-12-07T00:15:32.885 INFO:teuthology.orchestra.run.smithi179.stderr:dumped all 2023-12-07T00:15:32.892 INFO:teuthology.orchestra.run.smithi179.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-12-07T00:15:32.531466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221104,"kb_used_data":4924,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":5042176,"data_stored":2818128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.766049"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618878+0000","last_change":"2023-12-07T00:15:28.627068+0000","last_active":"2023-12-07T00:15:29.618878+0000","last_peered":"2023-12-07T00:15:29.618878+0000","last_clean":"2023-12-07T00:15:29.618878+0000","last_became_active":"2023-12-07T00:15:28.626848+0000","last_became_peered":"2023-12-07T00:15:28.626848+0000","last_unstale":"2023-12-07T00:15:29.618878+0000","last_undegraded":"2023-12-07T00:15:29.618878+0000","last_fullsized":"2023-12-07T00:15:29.618878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:28:54.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618713+0000","last_change":"2023-12-07T00:15:28.625574+0000","last_active":"2023-12-07T00:15:29.618713+0000","last_peered":"2023-12-07T00:15:29.618713+0000","last_clean":"2023-12-07T00:15:29.618713+0000","last_became_active":"2023-12-07T00:15:28.625311+0000","last_became_peered":"2023-12-07T00:15:28.625311+0000","last_unstale":"2023-12-07T00:15:29.618713+0000","last_undegraded":"2023-12-07T00:15:29.618713+0000","last_fullsized":"2023-12-07T00:15:29.618713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:55:06.704060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796382+0000","last_change":"2023-12-07T00:15:28.637415+0000","last_active":"2023-12-07T00:15:29.796382+0000","last_peered":"2023-12-07T00:15:29.796382+0000","last_clean":"2023-12-07T00:15:29.796382+0000","last_became_active":"2023-12-07T00:15:28.637147+0000","last_became_peered":"2023-12-07T00:15:28.637147+0000","last_unstale":"2023-12-07T00:15:29.796382+0000","last_undegraded":"2023-12-07T00:15:29.796382+0000","last_fullsized":"2023-12-07T00:15:29.796382+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:57.170835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796096+0000","last_change":"2023-12-07T00:15:28.628842+0000","last_active":"2023-12-07T00:15:29.796096+0000","last_peered":"2023-12-07T00:15:29.796096+0000","last_clean":"2023-12-07T00:15:29.796096+0000","last_became_active":"2023-12-07T00:15:28.628613+0000","last_became_peered":"2023-12-07T00:15:28.628613+0000","last_unstale":"2023-12-07T00:15:29.796096+0000","last_undegraded":"2023-12-07T00:15:29.796096+0000","last_fullsized":"2023-12-07T00:15:29.796096+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:34:41.613308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795916+0000","last_change":"2023-12-07T00:15:28.624329+0000","last_active":"2023-12-07T00:15:29.795916+0000","last_peered":"2023-12-07T00:15:29.795916+0000","last_clean":"2023-12-07T00:15:29.795916+0000","last_became_active":"2023-12-07T00:15:28.624069+0000","last_became_peered":"2023-12-07T00:15:28.624069+0000","last_unstale":"2023-12-07T00:15:29.795916+0000","last_undegraded":"2023-12-07T00:15:29.795916+0000","last_fullsized":"2023-12-07T00:15:29.795916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:41:31.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797445+0000","last_change":"2023-12-07T00:15:28.627624+0000","last_active":"2023-12-07T00:15:29.797445+0000","last_peered":"2023-12-07T00:15:29.797445+0000","last_clean":"2023-12-07T00:15:29.797445+0000","last_became_active":"2023-12-07T00:15:28.627377+0000","last_became_peered":"2023-12-07T00:15:28.627377+0000","last_unstale":"2023-12-07T00:15:29.797445+0000","last_undegraded":"2023-12-07T00:15:29.797445+0000","last_fullsized":"2023-12-07T00:15:29.797445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:17:45.062270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797296+0000","last_change":"2023-12-07T00:15:28.623746+0000","last_active":"2023-12-07T00:15:29.797296+0000","last_peered":"2023-12-07T00:15:29.797296+0000","last_clean":"2023-12-07T00:15:29.797296+0000","last_became_active":"2023-12-07T00:15:28.623143+0000","last_became_peered":"2023-12-07T00:15:28.623143+0000","last_unstale":"2023-12-07T00:15:29.797296+0000","last_undegraded":"2023-12-07T00:15:29.797296+0000","last_fullsized":"2023-12-07T00:15:29.797296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:22:22.024184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618359+0000","last_change":"2023-12-07T00:15:28.625418+0000","last_active":"2023-12-07T00:15:29.618359+0000","last_peered":"2023-12-07T00:15:29.618359+0000","last_clean":"2023-12-07T00:15:29.618359+0000","last_became_active":"2023-12-07T00:15:28.625154+0000","last_became_peered":"2023-12-07T00:15:28.625154+0000","last_unstale":"2023-12-07T00:15:29.618359+0000","last_undegraded":"2023-12-07T00:15:29.618359+0000","last_fullsized":"2023-12-07T00:15:29.618359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:07:07.287582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797027+0000","last_change":"2023-12-07T00:15:28.634061+0000","last_active":"2023-12-07T00:15:29.797027+0000","last_peered":"2023-12-07T00:15:29.797027+0000","last_clean":"2023-12-07T00:15:29.797027+0000","last_became_active":"2023-12-07T00:15:28.633793+0000","last_became_peered":"2023-12-07T00:15:28.633793+0000","last_unstale":"2023-12-07T00:15:29.797027+0000","last_undegraded":"2023-12-07T00:15:29.797027+0000","last_fullsized":"2023-12-07T00:15:29.797027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:22:04.480736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797245+0000","last_change":"2023-12-07T00:15:28.624578+0000","last_active":"2023-12-07T00:15:29.797245+0000","last_peered":"2023-12-07T00:15:29.797245+0000","last_clean":"2023-12-07T00:15:29.797245+0000","last_became_active":"2023-12-07T00:15:28.624278+0000","last_became_peered":"2023-12-07T00:15:28.624278+0000","last_unstale":"2023-12-07T00:15:29.797245+0000","last_undegraded":"2023-12-07T00:15:29.797245+0000","last_fullsized":"2023-12-07T00:15:29.797245+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:03.220057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796909+0000","last_change":"2023-12-07T00:15:28.623411+0000","last_active":"2023-12-07T00:15:29.796909+0000","last_peered":"2023-12-07T00:15:29.796909+0000","last_clean":"2023-12-07T00:15:29.796909+0000","last_became_active":"2023-12-07T00:15:28.622930+0000","last_became_peered":"2023-12-07T00:15:28.622930+0000","last_unstale":"2023-12-07T00:15:29.796909+0000","last_undegraded":"2023-12-07T00:15:29.796909+0000","last_fullsized":"2023-12-07T00:15:29.796909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:15:09.137857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796171+0000","last_change":"2023-12-07T00:15:28.625639+0000","last_active":"2023-12-07T00:15:29.796171+0000","last_peered":"2023-12-07T00:15:29.796171+0000","last_clean":"2023-12-07T00:15:29.796171+0000","last_became_active":"2023-12-07T00:15:28.625390+0000","last_became_peered":"2023-12-07T00:15:28.625390+0000","last_unstale":"2023-12-07T00:15:29.796171+0000","last_undegraded":"2023-12-07T00:15:29.796171+0000","last_fullsized":"2023-12-07T00:15:29.796171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:22:59.546950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796463+0000","last_change":"2023-12-07T00:15:28.633469+0000","last_active":"2023-12-07T00:15:29.796463+0000","last_peered":"2023-12-07T00:15:29.796463+0000","last_clean":"2023-12-07T00:15:29.796463+0000","last_became_active":"2023-12-07T00:15:28.633130+0000","last_became_peered":"2023-12-07T00:15:28.633130+0000","last_unstale":"2023-12-07T00:15:29.796463+0000","last_undegraded":"2023-12-07T00:15:29.796463+0000","last_fullsized":"2023-12-07T00:15:29.796463+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:20:36.006513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797198+0000","last_change":"2023-12-07T00:15:28.635303+0000","last_active":"2023-12-07T00:15:29.797198+0000","last_peered":"2023-12-07T00:15:29.797198+0000","last_clean":"2023-12-07T00:15:29.797198+0000","last_became_active":"2023-12-07T00:15:28.635048+0000","last_became_peered":"2023-12-07T00:15:28.635048+0000","last_unstale":"2023-12-07T00:15:29.797198+0000","last_undegraded":"2023-12-07T00:15:29.797198+0000","last_fullsized":"2023-12-07T00:15:29.797198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:22:04.480736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796588+0000","last_change":"2023-12-07T00:15:28.629209+0000","last_active":"2023-12-07T00:15:29.796588+0000","last_peered":"2023-12-07T00:15:29.796588+0000","last_clean":"2023-12-07T00:15:29.796588+0000","last_became_active":"2023-12-07T00:15:28.628929+0000","last_became_peered":"2023-12-07T00:15:28.628929+0000","last_unstale":"2023-12-07T00:15:29.796588+0000","last_undegraded":"2023-12-07T00:15:29.796588+0000","last_fullsized":"2023-12-07T00:15:29.796588+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:55:40.004863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620012+0000","last_change":"2023-12-07T00:15:28.626359+0000","last_active":"2023-12-07T00:15:29.620012+0000","last_peered":"2023-12-07T00:15:29.620012+0000","last_clean":"2023-12-07T00:15:29.620012+0000","last_became_active":"2023-12-07T00:15:28.626101+0000","last_became_peered":"2023-12-07T00:15:28.626101+0000","last_unstale":"2023-12-07T00:15:29.620012+0000","last_undegraded":"2023-12-07T00:15:29.620012+0000","last_fullsized":"2023-12-07T00:15:29.620012+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:55:40.315839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620744+0000","last_change":"2023-12-07T00:15:28.629309+0000","last_active":"2023-12-07T00:15:29.620744+0000","last_peered":"2023-12-07T00:15:29.620744+0000","last_clean":"2023-12-07T00:15:29.620744+0000","last_became_active":"2023-12-07T00:15:28.629032+0000","last_became_peered":"2023-12-07T00:15:28.629032+0000","last_unstale":"2023-12-07T00:15:29.620744+0000","last_undegraded":"2023-12-07T00:15:29.620744+0000","last_fullsized":"2023-12-07T00:15:29.620744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:55:40.004863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619496+0000","last_change":"2023-12-07T00:15:28.639926+0000","last_active":"2023-12-07T00:15:29.619496+0000","last_peered":"2023-12-07T00:15:29.619496+0000","last_clean":"2023-12-07T00:15:29.619496+0000","last_became_active":"2023-12-07T00:15:28.639665+0000","last_became_peered":"2023-12-07T00:15:28.639665+0000","last_unstale":"2023-12-07T00:15:29.619496+0000","last_undegraded":"2023-12-07T00:15:29.619496+0000","last_fullsized":"2023-12-07T00:15:29.619496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:02:33.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795801+0000","last_change":"2023-12-07T00:15:28.627627+0000","last_active":"2023-12-07T00:15:29.795801+0000","last_peered":"2023-12-07T00:15:29.795801+0000","last_clean":"2023-12-07T00:15:29.795801+0000","last_became_active":"2023-12-07T00:15:28.627359+0000","last_became_peered":"2023-12-07T00:15:28.627359+0000","last_unstale":"2023-12-07T00:15:29.795801+0000","last_undegraded":"2023-12-07T00:15:29.795801+0000","last_fullsized":"2023-12-07T00:15:29.795801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:36:27.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619591+0000","last_change":"2023-12-07T00:15:28.640350+0000","last_active":"2023-12-07T00:15:29.619591+0000","last_peered":"2023-12-07T00:15:29.619591+0000","last_clean":"2023-12-07T00:15:29.619591+0000","last_became_active":"2023-12-07T00:15:28.640081+0000","last_became_peered":"2023-12-07T00:15:28.640081+0000","last_unstale":"2023-12-07T00:15:29.619591+0000","last_undegraded":"2023-12-07T00:15:29.619591+0000","last_fullsized":"2023-12-07T00:15:29.619591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:44:43.040271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797026+0000","last_change":"2023-12-07T00:15:28.630626+0000","last_active":"2023-12-07T00:15:29.797026+0000","last_peered":"2023-12-07T00:15:29.797026+0000","last_clean":"2023-12-07T00:15:29.797026+0000","last_became_active":"2023-12-07T00:15:28.630347+0000","last_became_peered":"2023-12-07T00:15:28.630347+0000","last_unstale":"2023-12-07T00:15:29.797026+0000","last_undegraded":"2023-12-07T00:15:29.797026+0000","last_fullsized":"2023-12-07T00:15:29.797026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:20:55.170050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796631+0000","last_change":"2023-12-07T00:15:28.627468+0000","last_active":"2023-12-07T00:15:29.796631+0000","last_peered":"2023-12-07T00:15:29.796631+0000","last_clean":"2023-12-07T00:15:29.796631+0000","last_became_active":"2023-12-07T00:15:28.627191+0000","last_became_peered":"2023-12-07T00:15:28.627191+0000","last_unstale":"2023-12-07T00:15:29.796631+0000","last_undegraded":"2023-12-07T00:15:29.796631+0000","last_fullsized":"2023-12-07T00:15:29.796631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:22:59.546950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620808+0000","last_change":"2023-12-07T00:15:28.626656+0000","last_active":"2023-12-07T00:15:29.620808+0000","last_peered":"2023-12-07T00:15:29.620808+0000","last_clean":"2023-12-07T00:15:29.620808+0000","last_became_active":"2023-12-07T00:15:28.625793+0000","last_became_peered":"2023-12-07T00:15:28.625793+0000","last_unstale":"2023-12-07T00:15:29.620808+0000","last_undegraded":"2023-12-07T00:15:29.620808+0000","last_fullsized":"2023-12-07T00:15:29.620808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:37:33.170176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795686+0000","last_change":"2023-12-07T00:15:28.631456+0000","last_active":"2023-12-07T00:15:29.795686+0000","last_peered":"2023-12-07T00:15:29.795686+0000","last_clean":"2023-12-07T00:15:29.795686+0000","last_became_active":"2023-12-07T00:15:28.631203+0000","last_became_peered":"2023-12-07T00:15:28.631203+0000","last_unstale":"2023-12-07T00:15:29.795686+0000","last_undegraded":"2023-12-07T00:15:29.795686+0000","last_fullsized":"2023-12-07T00:15:29.795686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:58:49.507527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620258+0000","last_change":"2023-12-07T00:15:28.638701+0000","last_active":"2023-12-07T00:15:29.620258+0000","last_peered":"2023-12-07T00:15:29.620258+0000","last_clean":"2023-12-07T00:15:29.620258+0000","last_became_active":"2023-12-07T00:15:28.638480+0000","last_became_peered":"2023-12-07T00:15:28.638480+0000","last_unstale":"2023-12-07T00:15:29.620258+0000","last_undegraded":"2023-12-07T00:15:29.620258+0000","last_fullsized":"2023-12-07T00:15:29.620258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:57:33.425255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797637+0000","last_change":"2023-12-07T00:15:28.631567+0000","last_active":"2023-12-07T00:15:29.797637+0000","last_peered":"2023-12-07T00:15:29.797637+0000","last_clean":"2023-12-07T00:15:29.797637+0000","last_became_active":"2023-12-07T00:15:28.631206+0000","last_became_peered":"2023-12-07T00:15:28.631206+0000","last_unstale":"2023-12-07T00:15:29.797637+0000","last_undegraded":"2023-12-07T00:15:29.797637+0000","last_fullsized":"2023-12-07T00:15:29.797637+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:57.170835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619657+0000","last_change":"2023-12-07T00:15:28.638808+0000","last_active":"2023-12-07T00:15:29.619657+0000","last_peered":"2023-12-07T00:15:29.619657+0000","last_clean":"2023-12-07T00:15:29.619657+0000","last_became_active":"2023-12-07T00:15:28.638291+0000","last_became_peered":"2023-12-07T00:15:28.638291+0000","last_unstale":"2023-12-07T00:15:29.619657+0000","last_undegraded":"2023-12-07T00:15:29.619657+0000","last_fullsized":"2023-12-07T00:15:29.619657+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:33:50.580466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797317+0000","last_change":"2023-12-07T00:15:28.625181+0000","last_active":"2023-12-07T00:15:29.797317+0000","last_peered":"2023-12-07T00:15:29.797317+0000","last_clean":"2023-12-07T00:15:29.797317+0000","last_became_active":"2023-12-07T00:15:28.624906+0000","last_became_peered":"2023-12-07T00:15:28.624906+0000","last_unstale":"2023-12-07T00:15:29.797317+0000","last_undegraded":"2023-12-07T00:15:29.797317+0000","last_fullsized":"2023-12-07T00:15:29.797317+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:11:24.386466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619590+0000","last_change":"2023-12-07T00:15:28.635444+0000","last_active":"2023-12-07T00:15:29.619590+0000","last_peered":"2023-12-07T00:15:29.619590+0000","last_clean":"2023-12-07T00:15:29.619590+0000","last_became_active":"2023-12-07T00:15:28.635163+0000","last_became_peered":"2023-12-07T00:15:28.635163+0000","last_unstale":"2023-12-07T00:15:29.619590+0000","last_undegraded":"2023-12-07T00:15:29.619590+0000","last_fullsized":"2023-12-07T00:15:29.619590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:28:12.415108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619360+0000","last_change":"2023-12-07T00:15:28.640022+0000","last_active":"2023-12-07T00:15:29.619360+0000","last_peered":"2023-12-07T00:15:29.619360+0000","last_clean":"2023-12-07T00:15:29.619360+0000","last_became_active":"2023-12-07T00:15:28.639677+0000","last_became_peered":"2023-12-07T00:15:28.639677+0000","last_unstale":"2023-12-07T00:15:29.619360+0000","last_undegraded":"2023-12-07T00:15:29.619360+0000","last_fullsized":"2023-12-07T00:15:29.619360+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:49:15.844412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620061+0000","last_change":"2023-12-07T00:15:28.625976+0000","last_active":"2023-12-07T00:15:29.620061+0000","last_peered":"2023-12-07T00:15:29.620061+0000","last_clean":"2023-12-07T00:15:29.620061+0000","last_became_active":"2023-12-07T00:15:28.625396+0000","last_became_peered":"2023-12-07T00:15:28.625396+0000","last_unstale":"2023-12-07T00:15:29.620061+0000","last_undegraded":"2023-12-07T00:15:29.620061+0000","last_fullsized":"2023-12-07T00:15:29.620061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:17:45.062270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797315+0000","last_change":"2023-12-07T00:15:28.627681+0000","last_active":"2023-12-07T00:15:29.797315+0000","last_peered":"2023-12-07T00:15:29.797315+0000","last_clean":"2023-12-07T00:15:29.797315+0000","last_became_active":"2023-12-07T00:15:28.627431+0000","last_became_peered":"2023-12-07T00:15:28.627431+0000","last_unstale":"2023-12-07T00:15:29.797315+0000","last_undegraded":"2023-12-07T00:15:29.797315+0000","last_fullsized":"2023-12-07T00:15:29.797315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:55:40.315839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620268+0000","last_change":"2023-12-07T00:15:28.631942+0000","last_active":"2023-12-07T00:15:29.620268+0000","last_peered":"2023-12-07T00:15:29.620268+0000","last_clean":"2023-12-07T00:15:29.620268+0000","last_became_active":"2023-12-07T00:15:28.631664+0000","last_became_peered":"2023-12-07T00:15:28.631664+0000","last_unstale":"2023-12-07T00:15:29.620268+0000","last_undegraded":"2023-12-07T00:15:29.620268+0000","last_fullsized":"2023-12-07T00:15:29.620268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:13.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619525+0000","last_change":"2023-12-07T00:15:27.791180+0000","last_active":"2023-12-07T00:15:29.619525+0000","last_peered":"2023-12-07T00:15:29.619525+0000","last_clean":"2023-12-07T00:15:29.619525+0000","last_became_active":"2023-12-07T00:15:27.790917+0000","last_became_peered":"2023-12-07T00:15:27.790917+0000","last_unstale":"2023-12-07T00:15:29.619525+0000","last_undegraded":"2023-12-07T00:15:29.619525+0000","last_fullsized":"2023-12-07T00:15:29.619525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:42:45.080166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797676+0000","last_change":"2023-12-07T00:15:28.637420+0000","last_active":"2023-12-07T00:15:29.797676+0000","last_peered":"2023-12-07T00:15:29.797676+0000","last_clean":"2023-12-07T00:15:29.797676+0000","last_became_active":"2023-12-07T00:15:28.637135+0000","last_became_peered":"2023-12-07T00:15:28.637135+0000","last_unstale":"2023-12-07T00:15:29.797676+0000","last_undegraded":"2023-12-07T00:15:29.797676+0000","last_fullsized":"2023-12-07T00:15:29.797676+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:13.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796780+0000","last_change":"2023-12-07T00:15:27.792381+0000","last_active":"2023-12-07T00:15:29.796780+0000","last_peered":"2023-12-07T00:15:29.796780+0000","last_clean":"2023-12-07T00:15:29.796780+0000","last_became_active":"2023-12-07T00:15:27.792099+0000","last_became_peered":"2023-12-07T00:15:27.792099+0000","last_unstale":"2023-12-07T00:15:29.796780+0000","last_undegraded":"2023-12-07T00:15:29.796780+0000","last_fullsized":"2023-12-07T00:15:29.796780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:27.681015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797291+0000","last_change":"2023-12-07T00:15:28.634902+0000","last_active":"2023-12-07T00:15:29.797291+0000","last_peered":"2023-12-07T00:15:29.797291+0000","last_clean":"2023-12-07T00:15:29.797291+0000","last_became_active":"2023-12-07T00:15:28.634619+0000","last_became_peered":"2023-12-07T00:15:28.634619+0000","last_unstale":"2023-12-07T00:15:29.797291+0000","last_undegraded":"2023-12-07T00:15:29.797291+0000","last_fullsized":"2023-12-07T00:15:29.797291+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:20:36.006513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797733+0000","last_change":"2023-12-07T00:15:27.789489+0000","last_active":"2023-12-07T00:15:29.797733+0000","last_peered":"2023-12-07T00:15:29.797733+0000","last_clean":"2023-12-07T00:15:29.797733+0000","last_became_active":"2023-12-07T00:15:27.789127+0000","last_became_peered":"2023-12-07T00:15:27.789127+0000","last_unstale":"2023-12-07T00:15:29.797733+0000","last_undegraded":"2023-12-07T00:15:29.797733+0000","last_fullsized":"2023-12-07T00:15:29.797733+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:33:49.573234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618976+0000","last_change":"2023-12-07T00:15:28.635349+0000","last_active":"2023-12-07T00:15:29.618976+0000","last_peered":"2023-12-07T00:15:29.618976+0000","last_clean":"2023-12-07T00:15:29.618976+0000","last_became_active":"2023-12-07T00:15:28.635197+0000","last_became_peered":"2023-12-07T00:15:28.635197+0000","last_unstale":"2023-12-07T00:15:29.618976+0000","last_undegraded":"2023-12-07T00:15:29.618976+0000","last_fullsized":"2023-12-07T00:15:29.618976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:38:01.682938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796970+0000","last_change":"2023-12-07T00:15:27.785930+0000","last_active":"2023-12-07T00:15:29.796970+0000","last_peered":"2023-12-07T00:15:29.796970+0000","last_clean":"2023-12-07T00:15:29.796970+0000","last_became_active":"2023-12-07T00:15:27.785187+0000","last_became_peered":"2023-12-07T00:15:27.785187+0000","last_unstale":"2023-12-07T00:15:29.796970+0000","last_undegraded":"2023-12-07T00:15:29.796970+0000","last_fullsized":"2023-12-07T00:15:29.796970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:28:11.407876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795939+0000","last_change":"2023-12-07T00:15:28.627058+0000","last_active":"2023-12-07T00:15:29.795939+0000","last_peered":"2023-12-07T00:15:29.795939+0000","last_clean":"2023-12-07T00:15:29.795939+0000","last_became_active":"2023-12-07T00:15:28.626793+0000","last_became_peered":"2023-12-07T00:15:28.626793+0000","last_unstale":"2023-12-07T00:15:29.795939+0000","last_undegraded":"2023-12-07T00:15:29.795939+0000","last_fullsized":"2023-12-07T00:15:29.795939+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:17:45.062270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796830+0000","last_change":"2023-12-07T00:15:27.789913+0000","last_active":"2023-12-07T00:15:29.796830+0000","last_peered":"2023-12-07T00:15:29.796830+0000","last_clean":"2023-12-07T00:15:29.796830+0000","last_became_active":"2023-12-07T00:15:27.789584+0000","last_became_peered":"2023-12-07T00:15:27.789584+0000","last_unstale":"2023-12-07T00:15:29.796830+0000","last_undegraded":"2023-12-07T00:15:29.796830+0000","last_fullsized":"2023-12-07T00:15:29.796830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:50.116094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797341+0000","last_change":"2023-12-07T00:15:28.631189+0000","last_active":"2023-12-07T00:15:29.797341+0000","last_peered":"2023-12-07T00:15:29.797341+0000","last_clean":"2023-12-07T00:15:29.797341+0000","last_became_active":"2023-12-07T00:15:28.630896+0000","last_became_peered":"2023-12-07T00:15:28.630896+0000","last_unstale":"2023-12-07T00:15:29.797341+0000","last_undegraded":"2023-12-07T00:15:29.797341+0000","last_fullsized":"2023-12-07T00:15:29.797341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:07:07.287582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620205+0000","last_change":"2023-12-07T00:15:27.792394+0000","last_active":"2023-12-07T00:15:29.620205+0000","last_peered":"2023-12-07T00:15:29.620205+0000","last_clean":"2023-12-07T00:15:29.620205+0000","last_became_active":"2023-12-07T00:15:27.792126+0000","last_became_peered":"2023-12-07T00:15:27.792126+0000","last_unstale":"2023-12-07T00:15:29.620205+0000","last_undegraded":"2023-12-07T00:15:29.620205+0000","last_fullsized":"2023-12-07T00:15:29.620205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:27.681015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797185+0000","last_change":"2023-12-07T00:15:28.632288+0000","last_active":"2023-12-07T00:15:29.797185+0000","last_peered":"2023-12-07T00:15:29.797185+0000","last_clean":"2023-12-07T00:15:29.797185+0000","last_became_active":"2023-12-07T00:15:28.632011+0000","last_became_peered":"2023-12-07T00:15:28.632011+0000","last_unstale":"2023-12-07T00:15:29.797185+0000","last_undegraded":"2023-12-07T00:15:29.797185+0000","last_fullsized":"2023-12-07T00:15:29.797185+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:13.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797424+0000","last_change":"2023-12-07T00:15:27.795678+0000","last_active":"2023-12-07T00:15:29.797424+0000","last_peered":"2023-12-07T00:15:29.797424+0000","last_clean":"2023-12-07T00:15:29.797424+0000","last_became_active":"2023-12-07T00:15:27.795393+0000","last_became_peered":"2023-12-07T00:15:27.795393+0000","last_unstale":"2023-12-07T00:15:29.797424+0000","last_undegraded":"2023-12-07T00:15:29.797424+0000","last_fullsized":"2023-12-07T00:15:29.797424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:57:32.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618627+0000","last_change":"2023-12-07T00:15:28.633033+0000","last_active":"2023-12-07T00:15:29.618627+0000","last_peered":"2023-12-07T00:15:29.618627+0000","last_clean":"2023-12-07T00:15:29.618627+0000","last_became_active":"2023-12-07T00:15:28.632855+0000","last_became_peered":"2023-12-07T00:15:28.632855+0000","last_unstale":"2023-12-07T00:15:29.618627+0000","last_undegraded":"2023-12-07T00:15:29.618627+0000","last_fullsized":"2023-12-07T00:15:29.618627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:52:12.824603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796236+0000","last_change":"2023-12-07T00:15:27.788406+0000","last_active":"2023-12-07T00:15:29.796236+0000","last_peered":"2023-12-07T00:15:29.796236+0000","last_clean":"2023-12-07T00:15:29.796236+0000","last_became_active":"2023-12-07T00:15:27.788095+0000","last_became_peered":"2023-12-07T00:15:27.788095+0000","last_unstale":"2023-12-07T00:15:29.796236+0000","last_undegraded":"2023-12-07T00:15:29.796236+0000","last_fullsized":"2023-12-07T00:15:29.796236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:49:14.837180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796163+0000","last_change":"2023-12-07T00:15:28.624671+0000","last_active":"2023-12-07T00:15:29.796163+0000","last_peered":"2023-12-07T00:15:29.796163+0000","last_clean":"2023-12-07T00:15:29.796163+0000","last_became_active":"2023-12-07T00:15:28.624441+0000","last_became_peered":"2023-12-07T00:15:28.624441+0000","last_unstale":"2023-12-07T00:15:29.796163+0000","last_undegraded":"2023-12-07T00:15:29.796163+0000","last_fullsized":"2023-12-07T00:15:29.796163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:42:46.087398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618934+0000","last_change":"2023-12-07T00:15:27.786089+0000","last_active":"2023-12-07T00:15:29.618934+0000","last_peered":"2023-12-07T00:15:29.618934+0000","last_clean":"2023-12-07T00:15:29.618934+0000","last_became_active":"2023-12-07T00:15:27.785687+0000","last_became_peered":"2023-12-07T00:15:27.785687+0000","last_unstale":"2023-12-07T00:15:29.618934+0000","last_undegraded":"2023-12-07T00:15:29.618934+0000","last_fullsized":"2023-12-07T00:15:29.618934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:15:08.130625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620197+0000","last_change":"2023-12-07T00:15:28.635629+0000","last_active":"2023-12-07T00:15:29.620197+0000","last_peered":"2023-12-07T00:15:29.620197+0000","last_clean":"2023-12-07T00:15:29.620197+0000","last_became_active":"2023-12-07T00:15:28.635182+0000","last_became_peered":"2023-12-07T00:15:28.635182+0000","last_unstale":"2023-12-07T00:15:29.620197+0000","last_undegraded":"2023-12-07T00:15:29.620197+0000","last_fullsized":"2023-12-07T00:15:29.620197+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:51.123326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797339+0000","last_change":"2023-12-07T00:15:27.788892+0000","last_active":"2023-12-07T00:15:29.797339+0000","last_peered":"2023-12-07T00:15:29.797339+0000","last_clean":"2023-12-07T00:15:29.797339+0000","last_became_active":"2023-12-07T00:15:27.788615+0000","last_became_peered":"2023-12-07T00:15:27.788615+0000","last_unstale":"2023-12-07T00:15:29.797339+0000","last_undegraded":"2023-12-07T00:15:29.797339+0000","last_fullsized":"2023-12-07T00:15:29.797339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:55:39.308606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796672+0000","last_change":"2023-12-07T00:15:28.627066+0000","last_active":"2023-12-07T00:15:29.796672+0000","last_peered":"2023-12-07T00:15:29.796672+0000","last_clean":"2023-12-07T00:15:29.796672+0000","last_became_active":"2023-12-07T00:15:28.626808+0000","last_became_peered":"2023-12-07T00:15:28.626808+0000","last_unstale":"2023-12-07T00:15:29.796672+0000","last_undegraded":"2023-12-07T00:15:29.796672+0000","last_fullsized":"2023-12-07T00:15:29.796672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:13.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797019+0000","last_change":"2023-12-07T00:15:27.787696+0000","last_active":"2023-12-07T00:15:29.797019+0000","last_peered":"2023-12-07T00:15:29.797019+0000","last_clean":"2023-12-07T00:15:29.797019+0000","last_became_active":"2023-12-07T00:15:27.787430+0000","last_became_peered":"2023-12-07T00:15:27.787430+0000","last_unstale":"2023-12-07T00:15:29.797019+0000","last_undegraded":"2023-12-07T00:15:29.797019+0000","last_fullsized":"2023-12-07T00:15:29.797019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:56.163603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796882+0000","last_change":"2023-12-07T00:15:28.627569+0000","last_active":"2023-12-07T00:15:29.796882+0000","last_peered":"2023-12-07T00:15:29.796882+0000","last_clean":"2023-12-07T00:15:29.796882+0000","last_became_active":"2023-12-07T00:15:28.627287+0000","last_became_peered":"2023-12-07T00:15:28.627287+0000","last_unstale":"2023-12-07T00:15:29.796882+0000","last_undegraded":"2023-12-07T00:15:29.796882+0000","last_fullsized":"2023-12-07T00:15:29.796882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:57.170835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618968+0000","last_change":"2023-12-07T00:15:27.789037+0000","last_active":"2023-12-07T00:15:29.618968+0000","last_peered":"2023-12-07T00:15:29.618968+0000","last_clean":"2023-12-07T00:15:29.618968+0000","last_became_active":"2023-12-07T00:15:27.788732+0000","last_became_peered":"2023-12-07T00:15:27.788732+0000","last_unstale":"2023-12-07T00:15:29.618968+0000","last_undegraded":"2023-12-07T00:15:29.618968+0000","last_fullsized":"2023-12-07T00:15:29.618968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:56.163603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796329+0000","last_change":"2023-12-07T00:15:28.634058+0000","last_active":"2023-12-07T00:15:29.796329+0000","last_peered":"2023-12-07T00:15:29.796329+0000","last_clean":"2023-12-07T00:15:29.796329+0000","last_became_active":"2023-12-07T00:15:28.633793+0000","last_became_peered":"2023-12-07T00:15:28.633793+0000","last_unstale":"2023-12-07T00:15:29.796329+0000","last_undegraded":"2023-12-07T00:15:29.796329+0000","last_fullsized":"2023-12-07T00:15:29.796329+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:51.123326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618603+0000","last_change":"2023-12-07T00:15:27.785046+0000","last_active":"2023-12-07T00:15:29.618603+0000","last_peered":"2023-12-07T00:15:29.618603+0000","last_clean":"2023-12-07T00:15:29.618603+0000","last_became_active":"2023-12-07T00:15:27.784782+0000","last_became_peered":"2023-12-07T00:15:27.784782+0000","last_unstale":"2023-12-07T00:15:29.618603+0000","last_undegraded":"2023-12-07T00:15:29.618603+0000","last_fullsized":"2023-12-07T00:15:29.618603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:02.212825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618426+0000","last_change":"2023-12-07T00:15:28.627158+0000","last_active":"2023-12-07T00:15:29.618426+0000","last_peered":"2023-12-07T00:15:29.618426+0000","last_clean":"2023-12-07T00:15:29.618426+0000","last_became_active":"2023-12-07T00:15:28.626894+0000","last_became_peered":"2023-12-07T00:15:28.626894+0000","last_unstale":"2023-12-07T00:15:29.618426+0000","last_undegraded":"2023-12-07T00:15:29.618426+0000","last_fullsized":"2023-12-07T00:15:29.618426+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:41:35.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797615+0000","last_change":"2023-12-07T00:15:27.795466+0000","last_active":"2023-12-07T00:15:29.797615+0000","last_peered":"2023-12-07T00:15:29.797615+0000","last_clean":"2023-12-07T00:15:29.797615+0000","last_became_active":"2023-12-07T00:15:27.795272+0000","last_became_peered":"2023-12-07T00:15:27.795272+0000","last_unstale":"2023-12-07T00:15:29.797615+0000","last_undegraded":"2023-12-07T00:15:29.797615+0000","last_fullsized":"2023-12-07T00:15:29.797615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:02:32.966386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620211+0000","last_change":"2023-12-07T00:15:28.625944+0000","last_active":"2023-12-07T00:15:29.620211+0000","last_peered":"2023-12-07T00:15:29.620211+0000","last_clean":"2023-12-07T00:15:29.620211+0000","last_became_active":"2023-12-07T00:15:28.625371+0000","last_became_peered":"2023-12-07T00:15:28.625371+0000","last_unstale":"2023-12-07T00:15:29.620211+0000","last_undegraded":"2023-12-07T00:15:29.620211+0000","last_fullsized":"2023-12-07T00:15:29.620211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:57.170835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619280+0000","last_change":"2023-12-07T00:15:27.789339+0000","last_active":"2023-12-07T00:15:29.619280+0000","last_peered":"2023-12-07T00:15:29.619280+0000","last_clean":"2023-12-07T00:15:29.619280+0000","last_became_active":"2023-12-07T00:15:27.789030+0000","last_became_peered":"2023-12-07T00:15:27.789030+0000","last_unstale":"2023-12-07T00:15:29.619280+0000","last_undegraded":"2023-12-07T00:15:29.619280+0000","last_fullsized":"2023-12-07T00:15:29.619280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:34:40.606076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618504+0000","last_change":"2023-12-07T00:15:28.628053+0000","last_active":"2023-12-07T00:15:29.618504+0000","last_peered":"2023-12-07T00:15:29.618504+0000","last_clean":"2023-12-07T00:15:29.618504+0000","last_became_active":"2023-12-07T00:15:28.627762+0000","last_became_peered":"2023-12-07T00:15:28.627762+0000","last_unstale":"2023-12-07T00:15:29.618504+0000","last_undegraded":"2023-12-07T00:15:29.618504+0000","last_fullsized":"2023-12-07T00:15:29.618504+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:48:35.959270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620358+0000","last_change":"2023-12-07T00:15:27.792884+0000","last_active":"2023-12-07T00:15:29.620358+0000","last_peered":"2023-12-07T00:15:29.620358+0000","last_clean":"2023-12-07T00:15:29.620358+0000","last_became_active":"2023-12-07T00:15:27.792385+0000","last_became_peered":"2023-12-07T00:15:27.792385+0000","last_unstale":"2023-12-07T00:15:29.620358+0000","last_undegraded":"2023-12-07T00:15:29.620358+0000","last_fullsized":"2023-12-07T00:15:29.620358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:52:38.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618803+0000","last_change":"2023-12-07T00:15:28.634737+0000","last_active":"2023-12-07T00:15:29.618803+0000","last_peered":"2023-12-07T00:15:29.618803+0000","last_clean":"2023-12-07T00:15:29.618803+0000","last_became_active":"2023-12-07T00:15:28.634496+0000","last_became_peered":"2023-12-07T00:15:28.634496+0000","last_unstale":"2023-12-07T00:15:29.618803+0000","last_undegraded":"2023-12-07T00:15:29.618803+0000","last_fullsized":"2023-12-07T00:15:29.618803+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:04:13.749525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797219+0000","last_change":"2023-12-07T00:15:27.790632+0000","last_active":"2023-12-07T00:15:29.797219+0000","last_peered":"2023-12-07T00:15:29.797219+0000","last_clean":"2023-12-07T00:15:29.797219+0000","last_became_active":"2023-12-07T00:15:27.790369+0000","last_became_peered":"2023-12-07T00:15:27.790369+0000","last_unstale":"2023-12-07T00:15:29.797219+0000","last_undegraded":"2023-12-07T00:15:29.797219+0000","last_fullsized":"2023-12-07T00:15:29.797219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:22:03.473504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796746+0000","last_change":"2023-12-07T00:15:28.635231+0000","last_active":"2023-12-07T00:15:29.796746+0000","last_peered":"2023-12-07T00:15:29.796746+0000","last_clean":"2023-12-07T00:15:29.796746+0000","last_became_active":"2023-12-07T00:15:28.634919+0000","last_became_peered":"2023-12-07T00:15:28.634919+0000","last_unstale":"2023-12-07T00:15:29.796746+0000","last_undegraded":"2023-12-07T00:15:29.796746+0000","last_fullsized":"2023-12-07T00:15:29.796746+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:37:33.170176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797397+0000","last_change":"2023-12-07T00:15:27.795839+0000","last_active":"2023-12-07T00:15:29.797397+0000","last_peered":"2023-12-07T00:15:29.797397+0000","last_clean":"2023-12-07T00:15:29.797397+0000","last_became_active":"2023-12-07T00:15:27.795497+0000","last_became_peered":"2023-12-07T00:15:27.795497+0000","last_unstale":"2023-12-07T00:15:29.797397+0000","last_undegraded":"2023-12-07T00:15:29.797397+0000","last_fullsized":"2023-12-07T00:15:29.797397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:17:44.055038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797354+0000","last_change":"2023-12-07T00:15:28.633238+0000","last_active":"2023-12-07T00:15:29.797354+0000","last_peered":"2023-12-07T00:15:29.797354+0000","last_clean":"2023-12-07T00:15:29.797354+0000","last_became_active":"2023-12-07T00:15:28.632969+0000","last_became_peered":"2023-12-07T00:15:28.632969+0000","last_unstale":"2023-12-07T00:15:29.797354+0000","last_undegraded":"2023-12-07T00:15:29.797354+0000","last_fullsized":"2023-12-07T00:15:29.797354+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:55:40.004863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795900+0000","last_change":"2023-12-07T00:15:27.789176+0000","last_active":"2023-12-07T00:15:29.795900+0000","last_peered":"2023-12-07T00:15:29.795900+0000","last_clean":"2023-12-07T00:15:29.795900+0000","last_became_active":"2023-12-07T00:15:27.788834+0000","last_became_peered":"2023-12-07T00:15:27.788834+0000","last_unstale":"2023-12-07T00:15:29.795900+0000","last_undegraded":"2023-12-07T00:15:29.795900+0000","last_fullsized":"2023-12-07T00:15:29.795900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:40:41.921279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796114+0000","last_change":"2023-12-07T00:15:28.628493+0000","last_active":"2023-12-07T00:15:29.796114+0000","last_peered":"2023-12-07T00:15:29.796114+0000","last_clean":"2023-12-07T00:15:29.796114+0000","last_became_active":"2023-12-07T00:15:28.628114+0000","last_became_peered":"2023-12-07T00:15:28.628114+0000","last_unstale":"2023-12-07T00:15:29.796114+0000","last_undegraded":"2023-12-07T00:15:29.796114+0000","last_fullsized":"2023-12-07T00:15:29.796114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:52:39.336149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797531+0000","last_change":"2023-12-07T00:15:27.789647+0000","last_active":"2023-12-07T00:15:29.797531+0000","last_peered":"2023-12-07T00:15:29.797531+0000","last_clean":"2023-12-07T00:15:29.797531+0000","last_became_active":"2023-12-07T00:15:27.789352+0000","last_became_peered":"2023-12-07T00:15:27.789352+0000","last_unstale":"2023-12-07T00:15:29.797531+0000","last_undegraded":"2023-12-07T00:15:29.797531+0000","last_fullsized":"2023-12-07T00:15:29.797531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:28:11.407876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620068+0000","last_change":"2023-12-07T00:15:28.625585+0000","last_active":"2023-12-07T00:15:29.620068+0000","last_peered":"2023-12-07T00:15:29.620068+0000","last_clean":"2023-12-07T00:15:29.620068+0000","last_became_active":"2023-12-07T00:15:28.625259+0000","last_became_peered":"2023-12-07T00:15:28.625259+0000","last_unstale":"2023-12-07T00:15:29.620068+0000","last_undegraded":"2023-12-07T00:15:29.620068+0000","last_fullsized":"2023-12-07T00:15:29.620068+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:22:59.546950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795995+0000","last_change":"2023-12-07T00:15:27.782608+0000","last_active":"2023-12-07T00:15:29.795995+0000","last_peered":"2023-12-07T00:15:29.795995+0000","last_clean":"2023-12-07T00:15:29.795995+0000","last_became_active":"2023-12-07T00:15:27.782228+0000","last_became_peered":"2023-12-07T00:15:27.782228+0000","last_unstale":"2023-12-07T00:15:29.795995+0000","last_undegraded":"2023-12-07T00:15:29.795995+0000","last_fullsized":"2023-12-07T00:15:29.795995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:09:59.887437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795895+0000","last_change":"2023-12-07T00:15:28.629758+0000","last_active":"2023-12-07T00:15:29.795895+0000","last_peered":"2023-12-07T00:15:29.795895+0000","last_clean":"2023-12-07T00:15:29.795895+0000","last_became_active":"2023-12-07T00:15:28.629588+0000","last_became_peered":"2023-12-07T00:15:28.629588+0000","last_unstale":"2023-12-07T00:15:29.795895+0000","last_undegraded":"2023-12-07T00:15:29.795895+0000","last_fullsized":"2023-12-07T00:15:29.795895+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:55:40.315839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795888+0000","last_change":"2023-12-07T00:15:27.784622+0000","last_active":"2023-12-07T00:15:29.795888+0000","last_peered":"2023-12-07T00:15:29.795888+0000","last_clean":"2023-12-07T00:15:29.795888+0000","last_became_active":"2023-12-07T00:15:27.784331+0000","last_became_peered":"2023-12-07T00:15:27.784331+0000","last_unstale":"2023-12-07T00:15:29.795888+0000","last_undegraded":"2023-12-07T00:15:29.795888+0000","last_fullsized":"2023-12-07T00:15:29.795888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:50:41.769868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797159+0000","last_change":"2023-12-07T00:15:28.640255+0000","last_active":"2023-12-07T00:15:29.797159+0000","last_peered":"2023-12-07T00:15:29.797159+0000","last_clean":"2023-12-07T00:15:29.797159+0000","last_became_active":"2023-12-07T00:15:28.639952+0000","last_became_peered":"2023-12-07T00:15:28.639952+0000","last_unstale":"2023-12-07T00:15:29.797159+0000","last_undegraded":"2023-12-07T00:15:29.797159+0000","last_fullsized":"2023-12-07T00:15:29.797159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:50:24.151612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620355+0000","last_change":"2023-12-07T00:15:27.792477+0000","last_active":"2023-12-07T00:15:29.620355+0000","last_peered":"2023-12-07T00:15:29.620355+0000","last_clean":"2023-12-07T00:15:29.620355+0000","last_became_active":"2023-12-07T00:15:27.792182+0000","last_became_peered":"2023-12-07T00:15:27.792182+0000","last_unstale":"2023-12-07T00:15:29.620355+0000","last_undegraded":"2023-12-07T00:15:29.620355+0000","last_fullsized":"2023-12-07T00:15:29.620355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:49:47.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618523+0000","last_change":"2023-12-07T00:15:28.626530+0000","last_active":"2023-12-07T00:15:29.618523+0000","last_peered":"2023-12-07T00:15:29.618523+0000","last_clean":"2023-12-07T00:15:29.618523+0000","last_became_active":"2023-12-07T00:15:28.626268+0000","last_became_peered":"2023-12-07T00:15:28.626268+0000","last_unstale":"2023-12-07T00:15:29.618523+0000","last_undegraded":"2023-12-07T00:15:29.618523+0000","last_fullsized":"2023-12-07T00:15:29.618523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:34:25.611656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795605+0000","last_change":"2023-12-07T00:15:27.781325+0000","last_active":"2023-12-07T00:15:29.795605+0000","last_peered":"2023-12-07T00:15:29.795605+0000","last_clean":"2023-12-07T00:15:29.795605+0000","last_became_active":"2023-12-07T00:15:27.781038+0000","last_became_peered":"2023-12-07T00:15:27.781038+0000","last_unstale":"2023-12-07T00:15:29.795605+0000","last_undegraded":"2023-12-07T00:15:29.795605+0000","last_fullsized":"2023-12-07T00:15:29.795605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:16:53.865938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797488+0000","last_change":"2023-12-07T00:15:28.637266+0000","last_active":"2023-12-07T00:15:29.797488+0000","last_peered":"2023-12-07T00:15:29.797488+0000","last_clean":"2023-12-07T00:15:29.797488+0000","last_became_active":"2023-12-07T00:15:28.636994+0000","last_became_peered":"2023-12-07T00:15:28.636994+0000","last_unstale":"2023-12-07T00:15:29.797488+0000","last_undegraded":"2023-12-07T00:15:29.797488+0000","last_fullsized":"2023-12-07T00:15:29.797488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:51.123326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797156+0000","last_change":"2023-12-07T00:15:27.792307+0000","last_active":"2023-12-07T00:15:29.797156+0000","last_peered":"2023-12-07T00:15:29.797156+0000","last_clean":"2023-12-07T00:15:29.797156+0000","last_became_active":"2023-12-07T00:15:27.791956+0000","last_became_peered":"2023-12-07T00:15:27.791956+0000","last_unstale":"2023-12-07T00:15:29.797156+0000","last_undegraded":"2023-12-07T00:15:29.797156+0000","last_fullsized":"2023-12-07T00:15:29.797156+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:12.595121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620355+0000","last_change":"2023-12-07T00:15:28.635178+0000","last_active":"2023-12-07T00:15:29.620355+0000","last_peered":"2023-12-07T00:15:29.620355+0000","last_clean":"2023-12-07T00:15:29.620355+0000","last_became_active":"2023-12-07T00:15:28.634925+0000","last_became_peered":"2023-12-07T00:15:28.634925+0000","last_unstale":"2023-12-07T00:15:29.620355+0000","last_undegraded":"2023-12-07T00:15:29.620355+0000","last_fullsized":"2023-12-07T00:15:29.620355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:20:36.006513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795885+0000","last_change":"2023-12-07T00:15:27.788481+0000","last_active":"2023-12-07T00:15:29.795885+0000","last_peered":"2023-12-07T00:15:29.795885+0000","last_clean":"2023-12-07T00:15:29.795885+0000","last_became_active":"2023-12-07T00:15:27.788185+0000","last_became_peered":"2023-12-07T00:15:27.788185+0000","last_unstale":"2023-12-07T00:15:29.795885+0000","last_undegraded":"2023-12-07T00:15:29.795885+0000","last_fullsized":"2023-12-07T00:15:29.795885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:34.806120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618756+0000","last_change":"2023-12-07T00:15:28.624167+0000","last_active":"2023-12-07T00:15:29.618756+0000","last_peered":"2023-12-07T00:15:29.618756+0000","last_clean":"2023-12-07T00:15:29.618756+0000","last_became_active":"2023-12-07T00:15:28.623904+0000","last_became_peered":"2023-12-07T00:15:28.623904+0000","last_unstale":"2023-12-07T00:15:29.618756+0000","last_undegraded":"2023-12-07T00:15:29.618756+0000","last_fullsized":"2023-12-07T00:15:29.618756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:08:46.406011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796478+0000","last_change":"2023-12-07T00:15:27.781155+0000","last_active":"2023-12-07T00:15:29.796478+0000","last_peered":"2023-12-07T00:15:29.796478+0000","last_clean":"2023-12-07T00:15:29.796478+0000","last_became_active":"2023-12-07T00:15:27.780922+0000","last_became_peered":"2023-12-07T00:15:27.780922+0000","last_unstale":"2023-12-07T00:15:29.796478+0000","last_undegraded":"2023-12-07T00:15:29.796478+0000","last_fullsized":"2023-12-07T00:15:29.796478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:57:32.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795807+0000","last_change":"2023-12-07T00:15:28.634643+0000","last_active":"2023-12-07T00:15:29.795807+0000","last_peered":"2023-12-07T00:15:29.795807+0000","last_clean":"2023-12-07T00:15:29.795807+0000","last_became_active":"2023-12-07T00:15:28.634390+0000","last_became_peered":"2023-12-07T00:15:28.634390+0000","last_unstale":"2023-12-07T00:15:29.795807+0000","last_undegraded":"2023-12-07T00:15:29.795807+0000","last_fullsized":"2023-12-07T00:15:29.795807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:33:50.580466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796280+0000","last_change":"2023-12-07T00:15:27.787447+0000","last_active":"2023-12-07T00:15:29.796280+0000","last_peered":"2023-12-07T00:15:29.796280+0000","last_clean":"2023-12-07T00:15:29.796280+0000","last_became_active":"2023-12-07T00:15:27.787244+0000","last_became_peered":"2023-12-07T00:15:27.787244+0000","last_unstale":"2023-12-07T00:15:29.796280+0000","last_undegraded":"2023-12-07T00:15:29.796280+0000","last_fullsized":"2023-12-07T00:15:29.796280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:02:32.966386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797450+0000","last_change":"2023-12-07T00:15:28.635243+0000","last_active":"2023-12-07T00:15:29.797450+0000","last_peered":"2023-12-07T00:15:29.797450+0000","last_clean":"2023-12-07T00:15:29.797450+0000","last_became_active":"2023-12-07T00:15:28.634973+0000","last_became_peered":"2023-12-07T00:15:28.634973+0000","last_unstale":"2023-12-07T00:15:29.797450+0000","last_undegraded":"2023-12-07T00:15:29.797450+0000","last_fullsized":"2023-12-07T00:15:29.797450+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:22:59.546950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619303+0000","last_change":"2023-12-07T00:15:27.786270+0000","last_active":"2023-12-07T00:15:29.619303+0000","last_peered":"2023-12-07T00:15:29.619303+0000","last_clean":"2023-12-07T00:15:29.619303+0000","last_became_active":"2023-12-07T00:15:27.785658+0000","last_became_peered":"2023-12-07T00:15:27.785658+0000","last_unstale":"2023-12-07T00:15:29.619303+0000","last_undegraded":"2023-12-07T00:15:29.619303+0000","last_fullsized":"2023-12-07T00:15:29.619303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:27.681015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796919+0000","last_change":"2023-12-07T00:15:28.626317+0000","last_active":"2023-12-07T00:15:29.796919+0000","last_peered":"2023-12-07T00:15:29.796919+0000","last_clean":"2023-12-07T00:15:29.796919+0000","last_became_active":"2023-12-07T00:15:28.625981+0000","last_became_peered":"2023-12-07T00:15:28.625981+0000","last_unstale":"2023-12-07T00:15:29.796919+0000","last_undegraded":"2023-12-07T00:15:29.796919+0000","last_fullsized":"2023-12-07T00:15:29.796919+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:51.123326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797443+0000","last_change":"2023-12-07T00:15:27.784882+0000","last_active":"2023-12-07T00:15:29.797443+0000","last_peered":"2023-12-07T00:15:29.797443+0000","last_clean":"2023-12-07T00:15:29.797443+0000","last_became_active":"2023-12-07T00:15:27.784599+0000","last_became_peered":"2023-12-07T00:15:27.784599+0000","last_unstale":"2023-12-07T00:15:29.797443+0000","last_undegraded":"2023-12-07T00:15:29.797443+0000","last_fullsized":"2023-12-07T00:15:29.797443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:44:42.033039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620314+0000","last_change":"2023-12-07T00:15:28.635420+0000","last_active":"2023-12-07T00:15:29.620314+0000","last_peered":"2023-12-07T00:15:29.620314+0000","last_clean":"2023-12-07T00:15:29.620314+0000","last_became_active":"2023-12-07T00:15:28.634593+0000","last_became_peered":"2023-12-07T00:15:28.634593+0000","last_unstale":"2023-12-07T00:15:29.620314+0000","last_undegraded":"2023-12-07T00:15:29.620314+0000","last_fullsized":"2023-12-07T00:15:29.620314+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:22:04.480736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618379+0000","last_change":"2023-12-07T00:15:27.786413+0000","last_active":"2023-12-07T00:15:29.618379+0000","last_peered":"2023-12-07T00:15:29.618379+0000","last_clean":"2023-12-07T00:15:29.618379+0000","last_became_active":"2023-12-07T00:15:27.786165+0000","last_became_peered":"2023-12-07T00:15:27.786165+0000","last_unstale":"2023-12-07T00:15:29.618379+0000","last_undegraded":"2023-12-07T00:15:29.618379+0000","last_fullsized":"2023-12-07T00:15:29.618379+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:50.116094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797105+0000","last_change":"2023-12-07T00:15:28.624751+0000","last_active":"2023-12-07T00:15:29.797105+0000","last_peered":"2023-12-07T00:15:29.797105+0000","last_clean":"2023-12-07T00:15:29.797105+0000","last_became_active":"2023-12-07T00:15:28.624434+0000","last_became_peered":"2023-12-07T00:15:28.624434+0000","last_unstale":"2023-12-07T00:15:29.797105+0000","last_undegraded":"2023-12-07T00:15:29.797105+0000","last_fullsized":"2023-12-07T00:15:29.797105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:39:00.280001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620307+0000","last_change":"2023-12-07T00:15:27.798133+0000","last_active":"2023-12-07T00:15:29.620307+0000","last_peered":"2023-12-07T00:15:29.620307+0000","last_clean":"2023-12-07T00:15:29.620307+0000","last_became_active":"2023-12-07T00:15:27.797895+0000","last_became_peered":"2023-12-07T00:15:27.797895+0000","last_unstale":"2023-12-07T00:15:29.620307+0000","last_undegraded":"2023-12-07T00:15:29.620307+0000","last_fullsized":"2023-12-07T00:15:29.620307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:57:32.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-07T00:15:28.621179+0000","last_change":"2023-12-07T00:14:04.636514+0000","last_active":"2023-12-07T00:15:28.621179+0000","last_peered":"2023-12-07T00:15:28.621179+0000","last_clean":"2023-12-07T00:15:28.621179+0000","last_became_active":"2023-12-07T00:14:04.635540+0000","last_became_peered":"2023-12-07T00:14:04.635540+0000","last_unstale":"2023-12-07T00:15:28.621179+0000","last_undegraded":"2023-12-07T00:15:28.621179+0000","last_fullsized":"2023-12-07T00:15:28.621179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_clean_scrub_stamp":"2023-12-07T00:14:03.541217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:08:01.012662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":796949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.629},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.503}]},{"osd":6,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":205481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.433}]},{"osd":3,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.63},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":9.8849999999999998,"5min":9.8849999999999998,"15min":9.8849999999999998},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.379},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":9.9830000000000005,"5min":9.9830000000000005,"15min":9.9830000000000005},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":9.9199999999999999,"5min":9.9199999999999999,"15min":9.9199999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.622}]},{"osd":6,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":9.8260000000000005,"5min":9.8260000000000005,"15min":9.8260000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":9.9529999999999994,"5min":9.9529999999999994,"15min":9.9529999999999994},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":795301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.222},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.20499999999999999}]},{"osd":2,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.255},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.312}]},{"osd":1,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.503}]},{"osd":6,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.437}]},{"osd":7,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":199925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.315},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.371}]},{"osd":4,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.57599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":205503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.623}]},{"osd":5,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.436}]},{"osd":7,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":205011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":9.5730000000000004,"5min":9.5730000000000004,"15min":9.5730000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.74,"5min":1.74,"15min":1.74},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":20.481000000000002,"5min":20.481000000000002,"15min":20.481000000000002},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.623},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.76800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T00:15:32.898 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-07T00:15:33.053 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.054+0000 7f7414f77700 1 Processor -- start 2023-12-07T00:15:33.054 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.054+0000 7f7414f77700 1 -- start start 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.055+0000 7f7414f77700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f741015e220 0x7f74100b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.055+0000 7f7414f77700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74100b2aa0 0x7f741015f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.055+0000 7f7414f77700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741015f330 con 0x7f741015de40 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.055+0000 7f7414f77700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74100d1820 con 0x7f741015e220 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.055+0000 7f7414f77700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74100b2ed0 con 0x7f74100b2aa0 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740ed9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74100b2aa0 0x7f741015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740ed9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74100b2aa0 0x7f741015f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.179:41868/0 (socket says 172.21.15.179:41868) 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740ed9d700 1 -- 172.21.15.179:0/2848429377 learned_addr learned my addr 172.21.15.179:0/2848429377 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740dd9b700 1 --2- 172.21.15.179:0/2848429377 >> v2:172.21.15.190:3300/0 conn(0x7f741015e220 0x7f74100b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.056 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740ed9d700 1 -- 172.21.15.179:0/2848429377 >> v2:172.21.15.190:3300/0 conn(0x7f741015e220 msgr2=0x7f74100b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740ed9d700 1 --2- 172.21.15.179:0/2848429377 >> v2:172.21.15.190:3300/0 conn(0x7f741015e220 0x7f74100b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740ed9d700 1 -- 172.21.15.179:0/2848429377 >> v1:172.21.15.190:6789/0 conn(0x7f741015de40 legacy=0x7f74100b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740ed9d700 1 -- 172.21.15.179:0/2848429377 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741015e720 con 0x7f74100b2aa0 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740dd9b700 1 --2- 172.21.15.179:0/2848429377 >> v2:172.21.15.190:3300/0 conn(0x7f741015e220 0x7f74100b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.056+0000 7f740ed9d700 1 --2- 172.21.15.179:0/2848429377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74100b2aa0 0x7f741015f870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7408009e50 tx=0x7f740800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54fc9a44d3f744b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f740d59a700 1 -- 172.21.15.179:0/2848429377 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800e070 con 0x7f74100b2aa0 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f740d59a700 1 -- 172.21.15.179:0/2848429377 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740800b910 con 0x7f74100b2aa0 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f740d59a700 1 -- 172.21.15.179:0/2848429377 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740800bcc0 con 0x7f74100b2aa0 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f7414f77700 1 -- 172.21.15.179:0/2848429377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74100b2aa0 msgr2=0x7f741015f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.057 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f7414f77700 1 --2- 172.21.15.179:0/2848429377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74100b2aa0 0x7f741015f870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7408009e50 tx=0x7f740800b330 comp rx=0 tx=0).stop 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f7414f77700 1 -- 172.21.15.179:0/2848429377 shutdown_connections 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f7414f77700 1 --2- 172.21.15.179:0/2848429377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74100b2aa0 0x7f741015f870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f7414f77700 1 --2- 172.21.15.179:0/2848429377 >> v2:172.21.15.190:3300/0 conn(0x7f741015e220 0x7f74100b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f7414f77700 1 -- 172.21.15.179:0/2848429377 >> 172.21.15.179:0/2848429377 conn(0x7f7410072970 msgr2=0x7f7410072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f7414f77700 1 -- 172.21.15.179:0/2848429377 shutdown_connections 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.057+0000 7f7414f77700 1 -- 172.21.15.179:0/2848429377 wait complete. 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f7414f77700 1 Processor -- start 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f7414f77700 1 -- start start 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f7414f77700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74100b2aa0 0x7f74101e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f7414f77700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f741015de40 0x7f74100cef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f7414f77700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f741015e220 0x7f741014aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f7414f77700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100cead0 con 0x7f741015de40 2023-12-07T00:15:33.060 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f7414f77700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74100cdec0 con 0x7f74100b2aa0 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f7414f77700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74100ce1a0 con 0x7f741015e220 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f740dd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f741015de40 0x7f74100cef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f740dd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f741015de40 0x7f74100cef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41460/0 (socket says 172.21.15.179:41460) 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.059+0000 7f740dd9b700 1 -- 172.21.15.179:0/2342086259 learned_addr learned my addr 172.21.15.179:0/2342086259 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740ed9d700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f741015e220 0x7f741014aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740e59c700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74100b2aa0 0x7f74101e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740dd9b700 1 -- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f741015e220 msgr2=0x7f741014aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740dd9b700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f741015e220 0x7f741014aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740dd9b700 1 -- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74100b2aa0 msgr2=0x7f74101e7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740dd9b700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74100b2aa0 0x7f74101e7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.061 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740dd9b700 1 -- 172.21.15.179:0/2342086259 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7400009430 con 0x7f741015de40 2023-12-07T00:15:33.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740e59c700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74100b2aa0 0x7f74101e7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:33.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f740dd9b700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f741015de40 0x7f74100cef60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f740000e980 tx=0x7f740000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f73feffd700 1 -- 172.21.15.179:0/2342086259 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000096e0 con 0x7f741015de40 2023-12-07T00:15:33.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f73feffd700 1 -- 172.21.15.179:0/2342086259 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7400005a20 con 0x7f741015de40 2023-12-07T00:15:33.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7408009b30 con 0x7f741015de40 2023-12-07T00:15:33.062 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f73feffd700 1 -- 172.21.15.179:0/2342086259 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400005dd0 con 0x7f741015de40 2023-12-07T00:15:33.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.060+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74100ce760 con 0x7f741015de40 2023-12-07T00:15:33.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.061+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741004f290 con 0x7f741015de40 2023-12-07T00:15:33.063 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.061+0000 7f73feffd700 1 -- 172.21.15.179:0/2342086259 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f740000c850 con 0x7f741015de40 2023-12-07T00:15:33.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.062+0000 7f73feffd700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f73f006aed0 0x7f73f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.062+0000 7f73feffd700 1 -- 172.21.15.179:0/2342086259 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7400089930 con 0x7f741015de40 2023-12-07T00:15:33.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.062+0000 7f740e59c700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f73f006aed0 0x7f73f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.064 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.062+0000 7f740e59c700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f73f006aed0 0x7f73f006d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7404000f60 tx=0x7f7404009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.065 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.066+0000 7f73feffd700 1 -- 172.21.15.179:0/2342086259 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7400054930 con 0x7f741015de40 2023-12-07T00:15:33.253 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.254+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 --> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f741015efc0 con 0x7f73f006aed0 2023-12-07T00:15:33.260 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.261+0000 7f73feffd700 1 -- 172.21.15.179:0/2342086259 <== mgr.4104 v2:172.21.15.179:6832/1592863421 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289159 (secure 0 0 0) 0x7f74040123d0 con 0x7f73f006aed0 2023-12-07T00:15:33.264 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:33.266 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f73f006aed0 msgr2=0x7f73f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.266 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f73f006aed0 0x7f73f006d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7404000f60 tx=0x7f7404009040 comp rx=0 tx=0).stop 2023-12-07T00:15:33.266 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f741015de40 msgr2=0x7f74100cef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.266 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f741015de40 0x7f74100cef60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f740000e980 tx=0x7f740000ed40 comp rx=0 tx=0).stop 2023-12-07T00:15:33.266 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 shutdown_connections 2023-12-07T00:15:33.266 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f73f006aed0 0x7f73f006d390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.267 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f741015e220 0x7f741014aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.267 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74100b2aa0 0x7f74101e7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.267 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 --2- 172.21.15.179:0/2342086259 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f741015de40 0x7f74100cef60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.267 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 >> 172.21.15.179:0/2342086259 conn(0x7f7410072970 msgr2=0x7f74100b16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:33.267 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 shutdown_connections 2023-12-07T00:15:33.267 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.265+0000 7f7414f77700 1 -- 172.21.15.179:0/2342086259 wait complete. 2023-12-07T00:15:33.267 INFO:teuthology.orchestra.run.smithi179.stderr:dumped all 2023-12-07T00:15:33.276 INFO:teuthology.orchestra.run.smithi179.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-12-07T00:15:32.531466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221104,"kb_used_data":4924,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753616,"statfs":{"total":773094113280,"available":772867702784,"internally_reserved":0,"allocated":5042176,"data_stored":2818128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.766049"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618878+0000","last_change":"2023-12-07T00:15:28.627068+0000","last_active":"2023-12-07T00:15:29.618878+0000","last_peered":"2023-12-07T00:15:29.618878+0000","last_clean":"2023-12-07T00:15:29.618878+0000","last_became_active":"2023-12-07T00:15:28.626848+0000","last_became_peered":"2023-12-07T00:15:28.626848+0000","last_unstale":"2023-12-07T00:15:29.618878+0000","last_undegraded":"2023-12-07T00:15:29.618878+0000","last_fullsized":"2023-12-07T00:15:29.618878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:28:54.785148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618713+0000","last_change":"2023-12-07T00:15:28.625574+0000","last_active":"2023-12-07T00:15:29.618713+0000","last_peered":"2023-12-07T00:15:29.618713+0000","last_clean":"2023-12-07T00:15:29.618713+0000","last_became_active":"2023-12-07T00:15:28.625311+0000","last_became_peered":"2023-12-07T00:15:28.625311+0000","last_unstale":"2023-12-07T00:15:29.618713+0000","last_undegraded":"2023-12-07T00:15:29.618713+0000","last_fullsized":"2023-12-07T00:15:29.618713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:55:06.704060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796382+0000","last_change":"2023-12-07T00:15:28.637415+0000","last_active":"2023-12-07T00:15:29.796382+0000","last_peered":"2023-12-07T00:15:29.796382+0000","last_clean":"2023-12-07T00:15:29.796382+0000","last_became_active":"2023-12-07T00:15:28.637147+0000","last_became_peered":"2023-12-07T00:15:28.637147+0000","last_unstale":"2023-12-07T00:15:29.796382+0000","last_undegraded":"2023-12-07T00:15:29.796382+0000","last_fullsized":"2023-12-07T00:15:29.796382+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:57.170835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796096+0000","last_change":"2023-12-07T00:15:28.628842+0000","last_active":"2023-12-07T00:15:29.796096+0000","last_peered":"2023-12-07T00:15:29.796096+0000","last_clean":"2023-12-07T00:15:29.796096+0000","last_became_active":"2023-12-07T00:15:28.628613+0000","last_became_peered":"2023-12-07T00:15:28.628613+0000","last_unstale":"2023-12-07T00:15:29.796096+0000","last_undegraded":"2023-12-07T00:15:29.796096+0000","last_fullsized":"2023-12-07T00:15:29.796096+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:34:41.613308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795916+0000","last_change":"2023-12-07T00:15:28.624329+0000","last_active":"2023-12-07T00:15:29.795916+0000","last_peered":"2023-12-07T00:15:29.795916+0000","last_clean":"2023-12-07T00:15:29.795916+0000","last_became_active":"2023-12-07T00:15:28.624069+0000","last_became_peered":"2023-12-07T00:15:28.624069+0000","last_unstale":"2023-12-07T00:15:29.795916+0000","last_undegraded":"2023-12-07T00:15:29.795916+0000","last_fullsized":"2023-12-07T00:15:29.795916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:41:31.830869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797445+0000","last_change":"2023-12-07T00:15:28.627624+0000","last_active":"2023-12-07T00:15:29.797445+0000","last_peered":"2023-12-07T00:15:29.797445+0000","last_clean":"2023-12-07T00:15:29.797445+0000","last_became_active":"2023-12-07T00:15:28.627377+0000","last_became_peered":"2023-12-07T00:15:28.627377+0000","last_unstale":"2023-12-07T00:15:29.797445+0000","last_undegraded":"2023-12-07T00:15:29.797445+0000","last_fullsized":"2023-12-07T00:15:29.797445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:17:45.062270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797296+0000","last_change":"2023-12-07T00:15:28.623746+0000","last_active":"2023-12-07T00:15:29.797296+0000","last_peered":"2023-12-07T00:15:29.797296+0000","last_clean":"2023-12-07T00:15:29.797296+0000","last_became_active":"2023-12-07T00:15:28.623143+0000","last_became_peered":"2023-12-07T00:15:28.623143+0000","last_unstale":"2023-12-07T00:15:29.797296+0000","last_undegraded":"2023-12-07T00:15:29.797296+0000","last_fullsized":"2023-12-07T00:15:29.797296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:22:22.024184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618359+0000","last_change":"2023-12-07T00:15:28.625418+0000","last_active":"2023-12-07T00:15:29.618359+0000","last_peered":"2023-12-07T00:15:29.618359+0000","last_clean":"2023-12-07T00:15:29.618359+0000","last_became_active":"2023-12-07T00:15:28.625154+0000","last_became_peered":"2023-12-07T00:15:28.625154+0000","last_unstale":"2023-12-07T00:15:29.618359+0000","last_undegraded":"2023-12-07T00:15:29.618359+0000","last_fullsized":"2023-12-07T00:15:29.618359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:07:07.287582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797027+0000","last_change":"2023-12-07T00:15:28.634061+0000","last_active":"2023-12-07T00:15:29.797027+0000","last_peered":"2023-12-07T00:15:29.797027+0000","last_clean":"2023-12-07T00:15:29.797027+0000","last_became_active":"2023-12-07T00:15:28.633793+0000","last_became_peered":"2023-12-07T00:15:28.633793+0000","last_unstale":"2023-12-07T00:15:29.797027+0000","last_undegraded":"2023-12-07T00:15:29.797027+0000","last_fullsized":"2023-12-07T00:15:29.797027+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:22:04.480736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797245+0000","last_change":"2023-12-07T00:15:28.624578+0000","last_active":"2023-12-07T00:15:29.797245+0000","last_peered":"2023-12-07T00:15:29.797245+0000","last_clean":"2023-12-07T00:15:29.797245+0000","last_became_active":"2023-12-07T00:15:28.624278+0000","last_became_peered":"2023-12-07T00:15:28.624278+0000","last_unstale":"2023-12-07T00:15:29.797245+0000","last_undegraded":"2023-12-07T00:15:29.797245+0000","last_fullsized":"2023-12-07T00:15:29.797245+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:03.220057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796909+0000","last_change":"2023-12-07T00:15:28.623411+0000","last_active":"2023-12-07T00:15:29.796909+0000","last_peered":"2023-12-07T00:15:29.796909+0000","last_clean":"2023-12-07T00:15:29.796909+0000","last_became_active":"2023-12-07T00:15:28.622930+0000","last_became_peered":"2023-12-07T00:15:28.622930+0000","last_unstale":"2023-12-07T00:15:29.796909+0000","last_undegraded":"2023-12-07T00:15:29.796909+0000","last_fullsized":"2023-12-07T00:15:29.796909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:15:09.137857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796171+0000","last_change":"2023-12-07T00:15:28.625639+0000","last_active":"2023-12-07T00:15:29.796171+0000","last_peered":"2023-12-07T00:15:29.796171+0000","last_clean":"2023-12-07T00:15:29.796171+0000","last_became_active":"2023-12-07T00:15:28.625390+0000","last_became_peered":"2023-12-07T00:15:28.625390+0000","last_unstale":"2023-12-07T00:15:29.796171+0000","last_undegraded":"2023-12-07T00:15:29.796171+0000","last_fullsized":"2023-12-07T00:15:29.796171+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:22:59.546950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796463+0000","last_change":"2023-12-07T00:15:28.633469+0000","last_active":"2023-12-07T00:15:29.796463+0000","last_peered":"2023-12-07T00:15:29.796463+0000","last_clean":"2023-12-07T00:15:29.796463+0000","last_became_active":"2023-12-07T00:15:28.633130+0000","last_became_peered":"2023-12-07T00:15:28.633130+0000","last_unstale":"2023-12-07T00:15:29.796463+0000","last_undegraded":"2023-12-07T00:15:29.796463+0000","last_fullsized":"2023-12-07T00:15:29.796463+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:20:36.006513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797198+0000","last_change":"2023-12-07T00:15:28.635303+0000","last_active":"2023-12-07T00:15:29.797198+0000","last_peered":"2023-12-07T00:15:29.797198+0000","last_clean":"2023-12-07T00:15:29.797198+0000","last_became_active":"2023-12-07T00:15:28.635048+0000","last_became_peered":"2023-12-07T00:15:28.635048+0000","last_unstale":"2023-12-07T00:15:29.797198+0000","last_undegraded":"2023-12-07T00:15:29.797198+0000","last_fullsized":"2023-12-07T00:15:29.797198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:22:04.480736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796588+0000","last_change":"2023-12-07T00:15:28.629209+0000","last_active":"2023-12-07T00:15:29.796588+0000","last_peered":"2023-12-07T00:15:29.796588+0000","last_clean":"2023-12-07T00:15:29.796588+0000","last_became_active":"2023-12-07T00:15:28.628929+0000","last_became_peered":"2023-12-07T00:15:28.628929+0000","last_unstale":"2023-12-07T00:15:29.796588+0000","last_undegraded":"2023-12-07T00:15:29.796588+0000","last_fullsized":"2023-12-07T00:15:29.796588+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:55:40.004863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620012+0000","last_change":"2023-12-07T00:15:28.626359+0000","last_active":"2023-12-07T00:15:29.620012+0000","last_peered":"2023-12-07T00:15:29.620012+0000","last_clean":"2023-12-07T00:15:29.620012+0000","last_became_active":"2023-12-07T00:15:28.626101+0000","last_became_peered":"2023-12-07T00:15:28.626101+0000","last_unstale":"2023-12-07T00:15:29.620012+0000","last_undegraded":"2023-12-07T00:15:29.620012+0000","last_fullsized":"2023-12-07T00:15:29.620012+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:55:40.315839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620744+0000","last_change":"2023-12-07T00:15:28.629309+0000","last_active":"2023-12-07T00:15:29.620744+0000","last_peered":"2023-12-07T00:15:29.620744+0000","last_clean":"2023-12-07T00:15:29.620744+0000","last_became_active":"2023-12-07T00:15:28.629032+0000","last_became_peered":"2023-12-07T00:15:28.629032+0000","last_unstale":"2023-12-07T00:15:29.620744+0000","last_undegraded":"2023-12-07T00:15:29.620744+0000","last_fullsized":"2023-12-07T00:15:29.620744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:55:40.004863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619496+0000","last_change":"2023-12-07T00:15:28.639926+0000","last_active":"2023-12-07T00:15:29.619496+0000","last_peered":"2023-12-07T00:15:29.619496+0000","last_clean":"2023-12-07T00:15:29.619496+0000","last_became_active":"2023-12-07T00:15:28.639665+0000","last_became_peered":"2023-12-07T00:15:28.639665+0000","last_unstale":"2023-12-07T00:15:29.619496+0000","last_undegraded":"2023-12-07T00:15:29.619496+0000","last_fullsized":"2023-12-07T00:15:29.619496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:02:33.973618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795801+0000","last_change":"2023-12-07T00:15:28.627627+0000","last_active":"2023-12-07T00:15:29.795801+0000","last_peered":"2023-12-07T00:15:29.795801+0000","last_clean":"2023-12-07T00:15:29.795801+0000","last_became_active":"2023-12-07T00:15:28.627359+0000","last_became_peered":"2023-12-07T00:15:28.627359+0000","last_unstale":"2023-12-07T00:15:29.795801+0000","last_undegraded":"2023-12-07T00:15:29.795801+0000","last_fullsized":"2023-12-07T00:15:29.795801+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:36:27.998178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619591+0000","last_change":"2023-12-07T00:15:28.640350+0000","last_active":"2023-12-07T00:15:29.619591+0000","last_peered":"2023-12-07T00:15:29.619591+0000","last_clean":"2023-12-07T00:15:29.619591+0000","last_became_active":"2023-12-07T00:15:28.640081+0000","last_became_peered":"2023-12-07T00:15:28.640081+0000","last_unstale":"2023-12-07T00:15:29.619591+0000","last_undegraded":"2023-12-07T00:15:29.619591+0000","last_fullsized":"2023-12-07T00:15:29.619591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:44:43.040271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797026+0000","last_change":"2023-12-07T00:15:28.630626+0000","last_active":"2023-12-07T00:15:29.797026+0000","last_peered":"2023-12-07T00:15:29.797026+0000","last_clean":"2023-12-07T00:15:29.797026+0000","last_became_active":"2023-12-07T00:15:28.630347+0000","last_became_peered":"2023-12-07T00:15:28.630347+0000","last_unstale":"2023-12-07T00:15:29.797026+0000","last_undegraded":"2023-12-07T00:15:29.797026+0000","last_fullsized":"2023-12-07T00:15:29.797026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:20:55.170050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796631+0000","last_change":"2023-12-07T00:15:28.627468+0000","last_active":"2023-12-07T00:15:29.796631+0000","last_peered":"2023-12-07T00:15:29.796631+0000","last_clean":"2023-12-07T00:15:29.796631+0000","last_became_active":"2023-12-07T00:15:28.627191+0000","last_became_peered":"2023-12-07T00:15:28.627191+0000","last_unstale":"2023-12-07T00:15:29.796631+0000","last_undegraded":"2023-12-07T00:15:29.796631+0000","last_fullsized":"2023-12-07T00:15:29.796631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:22:59.546950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620808+0000","last_change":"2023-12-07T00:15:28.626656+0000","last_active":"2023-12-07T00:15:29.620808+0000","last_peered":"2023-12-07T00:15:29.620808+0000","last_clean":"2023-12-07T00:15:29.620808+0000","last_became_active":"2023-12-07T00:15:28.625793+0000","last_became_peered":"2023-12-07T00:15:28.625793+0000","last_unstale":"2023-12-07T00:15:29.620808+0000","last_undegraded":"2023-12-07T00:15:29.620808+0000","last_fullsized":"2023-12-07T00:15:29.620808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:37:33.170176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795686+0000","last_change":"2023-12-07T00:15:28.631456+0000","last_active":"2023-12-07T00:15:29.795686+0000","last_peered":"2023-12-07T00:15:29.795686+0000","last_clean":"2023-12-07T00:15:29.795686+0000","last_became_active":"2023-12-07T00:15:28.631203+0000","last_became_peered":"2023-12-07T00:15:28.631203+0000","last_unstale":"2023-12-07T00:15:29.795686+0000","last_undegraded":"2023-12-07T00:15:29.795686+0000","last_fullsized":"2023-12-07T00:15:29.795686+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:58:49.507527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620258+0000","last_change":"2023-12-07T00:15:28.638701+0000","last_active":"2023-12-07T00:15:29.620258+0000","last_peered":"2023-12-07T00:15:29.620258+0000","last_clean":"2023-12-07T00:15:29.620258+0000","last_became_active":"2023-12-07T00:15:28.638480+0000","last_became_peered":"2023-12-07T00:15:28.638480+0000","last_unstale":"2023-12-07T00:15:29.620258+0000","last_undegraded":"2023-12-07T00:15:29.620258+0000","last_fullsized":"2023-12-07T00:15:29.620258+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:57:33.425255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797637+0000","last_change":"2023-12-07T00:15:28.631567+0000","last_active":"2023-12-07T00:15:29.797637+0000","last_peered":"2023-12-07T00:15:29.797637+0000","last_clean":"2023-12-07T00:15:29.797637+0000","last_became_active":"2023-12-07T00:15:28.631206+0000","last_became_peered":"2023-12-07T00:15:28.631206+0000","last_unstale":"2023-12-07T00:15:29.797637+0000","last_undegraded":"2023-12-07T00:15:29.797637+0000","last_fullsized":"2023-12-07T00:15:29.797637+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:57.170835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619657+0000","last_change":"2023-12-07T00:15:28.638808+0000","last_active":"2023-12-07T00:15:29.619657+0000","last_peered":"2023-12-07T00:15:29.619657+0000","last_clean":"2023-12-07T00:15:29.619657+0000","last_became_active":"2023-12-07T00:15:28.638291+0000","last_became_peered":"2023-12-07T00:15:28.638291+0000","last_unstale":"2023-12-07T00:15:29.619657+0000","last_undegraded":"2023-12-07T00:15:29.619657+0000","last_fullsized":"2023-12-07T00:15:29.619657+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:33:50.580466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797317+0000","last_change":"2023-12-07T00:15:28.625181+0000","last_active":"2023-12-07T00:15:29.797317+0000","last_peered":"2023-12-07T00:15:29.797317+0000","last_clean":"2023-12-07T00:15:29.797317+0000","last_became_active":"2023-12-07T00:15:28.624906+0000","last_became_peered":"2023-12-07T00:15:28.624906+0000","last_unstale":"2023-12-07T00:15:29.797317+0000","last_undegraded":"2023-12-07T00:15:29.797317+0000","last_fullsized":"2023-12-07T00:15:29.797317+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:11:24.386466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619590+0000","last_change":"2023-12-07T00:15:28.635444+0000","last_active":"2023-12-07T00:15:29.619590+0000","last_peered":"2023-12-07T00:15:29.619590+0000","last_clean":"2023-12-07T00:15:29.619590+0000","last_became_active":"2023-12-07T00:15:28.635163+0000","last_became_peered":"2023-12-07T00:15:28.635163+0000","last_unstale":"2023-12-07T00:15:29.619590+0000","last_undegraded":"2023-12-07T00:15:29.619590+0000","last_fullsized":"2023-12-07T00:15:29.619590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:28:12.415108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619360+0000","last_change":"2023-12-07T00:15:28.640022+0000","last_active":"2023-12-07T00:15:29.619360+0000","last_peered":"2023-12-07T00:15:29.619360+0000","last_clean":"2023-12-07T00:15:29.619360+0000","last_became_active":"2023-12-07T00:15:28.639677+0000","last_became_peered":"2023-12-07T00:15:28.639677+0000","last_unstale":"2023-12-07T00:15:29.619360+0000","last_undegraded":"2023-12-07T00:15:29.619360+0000","last_fullsized":"2023-12-07T00:15:29.619360+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:49:15.844412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620061+0000","last_change":"2023-12-07T00:15:28.625976+0000","last_active":"2023-12-07T00:15:29.620061+0000","last_peered":"2023-12-07T00:15:29.620061+0000","last_clean":"2023-12-07T00:15:29.620061+0000","last_became_active":"2023-12-07T00:15:28.625396+0000","last_became_peered":"2023-12-07T00:15:28.625396+0000","last_unstale":"2023-12-07T00:15:29.620061+0000","last_undegraded":"2023-12-07T00:15:29.620061+0000","last_fullsized":"2023-12-07T00:15:29.620061+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:17:45.062270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797315+0000","last_change":"2023-12-07T00:15:28.627681+0000","last_active":"2023-12-07T00:15:29.797315+0000","last_peered":"2023-12-07T00:15:29.797315+0000","last_clean":"2023-12-07T00:15:29.797315+0000","last_became_active":"2023-12-07T00:15:28.627431+0000","last_became_peered":"2023-12-07T00:15:28.627431+0000","last_unstale":"2023-12-07T00:15:29.797315+0000","last_undegraded":"2023-12-07T00:15:29.797315+0000","last_fullsized":"2023-12-07T00:15:29.797315+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:55:40.315839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620268+0000","last_change":"2023-12-07T00:15:28.631942+0000","last_active":"2023-12-07T00:15:29.620268+0000","last_peered":"2023-12-07T00:15:29.620268+0000","last_clean":"2023-12-07T00:15:29.620268+0000","last_became_active":"2023-12-07T00:15:28.631664+0000","last_became_peered":"2023-12-07T00:15:28.631664+0000","last_unstale":"2023-12-07T00:15:29.620268+0000","last_undegraded":"2023-12-07T00:15:29.620268+0000","last_fullsized":"2023-12-07T00:15:29.620268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:13.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619525+0000","last_change":"2023-12-07T00:15:27.791180+0000","last_active":"2023-12-07T00:15:29.619525+0000","last_peered":"2023-12-07T00:15:29.619525+0000","last_clean":"2023-12-07T00:15:29.619525+0000","last_became_active":"2023-12-07T00:15:27.790917+0000","last_became_peered":"2023-12-07T00:15:27.790917+0000","last_unstale":"2023-12-07T00:15:29.619525+0000","last_undegraded":"2023-12-07T00:15:29.619525+0000","last_fullsized":"2023-12-07T00:15:29.619525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:42:45.080166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797676+0000","last_change":"2023-12-07T00:15:28.637420+0000","last_active":"2023-12-07T00:15:29.797676+0000","last_peered":"2023-12-07T00:15:29.797676+0000","last_clean":"2023-12-07T00:15:29.797676+0000","last_became_active":"2023-12-07T00:15:28.637135+0000","last_became_peered":"2023-12-07T00:15:28.637135+0000","last_unstale":"2023-12-07T00:15:29.797676+0000","last_undegraded":"2023-12-07T00:15:29.797676+0000","last_fullsized":"2023-12-07T00:15:29.797676+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:13.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796780+0000","last_change":"2023-12-07T00:15:27.792381+0000","last_active":"2023-12-07T00:15:29.796780+0000","last_peered":"2023-12-07T00:15:29.796780+0000","last_clean":"2023-12-07T00:15:29.796780+0000","last_became_active":"2023-12-07T00:15:27.792099+0000","last_became_peered":"2023-12-07T00:15:27.792099+0000","last_unstale":"2023-12-07T00:15:29.796780+0000","last_undegraded":"2023-12-07T00:15:29.796780+0000","last_fullsized":"2023-12-07T00:15:29.796780+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:27.681015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797291+0000","last_change":"2023-12-07T00:15:28.634902+0000","last_active":"2023-12-07T00:15:29.797291+0000","last_peered":"2023-12-07T00:15:29.797291+0000","last_clean":"2023-12-07T00:15:29.797291+0000","last_became_active":"2023-12-07T00:15:28.634619+0000","last_became_peered":"2023-12-07T00:15:28.634619+0000","last_unstale":"2023-12-07T00:15:29.797291+0000","last_undegraded":"2023-12-07T00:15:29.797291+0000","last_fullsized":"2023-12-07T00:15:29.797291+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:20:36.006513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797733+0000","last_change":"2023-12-07T00:15:27.789489+0000","last_active":"2023-12-07T00:15:29.797733+0000","last_peered":"2023-12-07T00:15:29.797733+0000","last_clean":"2023-12-07T00:15:29.797733+0000","last_became_active":"2023-12-07T00:15:27.789127+0000","last_became_peered":"2023-12-07T00:15:27.789127+0000","last_unstale":"2023-12-07T00:15:29.797733+0000","last_undegraded":"2023-12-07T00:15:29.797733+0000","last_fullsized":"2023-12-07T00:15:29.797733+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:33:49.573234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618976+0000","last_change":"2023-12-07T00:15:28.635349+0000","last_active":"2023-12-07T00:15:29.618976+0000","last_peered":"2023-12-07T00:15:29.618976+0000","last_clean":"2023-12-07T00:15:29.618976+0000","last_became_active":"2023-12-07T00:15:28.635197+0000","last_became_peered":"2023-12-07T00:15:28.635197+0000","last_unstale":"2023-12-07T00:15:29.618976+0000","last_undegraded":"2023-12-07T00:15:29.618976+0000","last_fullsized":"2023-12-07T00:15:29.618976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:38:01.682938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796970+0000","last_change":"2023-12-07T00:15:27.785930+0000","last_active":"2023-12-07T00:15:29.796970+0000","last_peered":"2023-12-07T00:15:29.796970+0000","last_clean":"2023-12-07T00:15:29.796970+0000","last_became_active":"2023-12-07T00:15:27.785187+0000","last_became_peered":"2023-12-07T00:15:27.785187+0000","last_unstale":"2023-12-07T00:15:29.796970+0000","last_undegraded":"2023-12-07T00:15:29.796970+0000","last_fullsized":"2023-12-07T00:15:29.796970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:28:11.407876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795939+0000","last_change":"2023-12-07T00:15:28.627058+0000","last_active":"2023-12-07T00:15:29.795939+0000","last_peered":"2023-12-07T00:15:29.795939+0000","last_clean":"2023-12-07T00:15:29.795939+0000","last_became_active":"2023-12-07T00:15:28.626793+0000","last_became_peered":"2023-12-07T00:15:28.626793+0000","last_unstale":"2023-12-07T00:15:29.795939+0000","last_undegraded":"2023-12-07T00:15:29.795939+0000","last_fullsized":"2023-12-07T00:15:29.795939+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:17:45.062270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796830+0000","last_change":"2023-12-07T00:15:27.789913+0000","last_active":"2023-12-07T00:15:29.796830+0000","last_peered":"2023-12-07T00:15:29.796830+0000","last_clean":"2023-12-07T00:15:29.796830+0000","last_became_active":"2023-12-07T00:15:27.789584+0000","last_became_peered":"2023-12-07T00:15:27.789584+0000","last_unstale":"2023-12-07T00:15:29.796830+0000","last_undegraded":"2023-12-07T00:15:29.796830+0000","last_fullsized":"2023-12-07T00:15:29.796830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:50.116094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797341+0000","last_change":"2023-12-07T00:15:28.631189+0000","last_active":"2023-12-07T00:15:29.797341+0000","last_peered":"2023-12-07T00:15:29.797341+0000","last_clean":"2023-12-07T00:15:29.797341+0000","last_became_active":"2023-12-07T00:15:28.630896+0000","last_became_peered":"2023-12-07T00:15:28.630896+0000","last_unstale":"2023-12-07T00:15:29.797341+0000","last_undegraded":"2023-12-07T00:15:29.797341+0000","last_fullsized":"2023-12-07T00:15:29.797341+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:07:07.287582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620205+0000","last_change":"2023-12-07T00:15:27.792394+0000","last_active":"2023-12-07T00:15:29.620205+0000","last_peered":"2023-12-07T00:15:29.620205+0000","last_clean":"2023-12-07T00:15:29.620205+0000","last_became_active":"2023-12-07T00:15:27.792126+0000","last_became_peered":"2023-12-07T00:15:27.792126+0000","last_unstale":"2023-12-07T00:15:29.620205+0000","last_undegraded":"2023-12-07T00:15:29.620205+0000","last_fullsized":"2023-12-07T00:15:29.620205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:27.681015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797185+0000","last_change":"2023-12-07T00:15:28.632288+0000","last_active":"2023-12-07T00:15:29.797185+0000","last_peered":"2023-12-07T00:15:29.797185+0000","last_clean":"2023-12-07T00:15:29.797185+0000","last_became_active":"2023-12-07T00:15:28.632011+0000","last_became_peered":"2023-12-07T00:15:28.632011+0000","last_unstale":"2023-12-07T00:15:29.797185+0000","last_undegraded":"2023-12-07T00:15:29.797185+0000","last_fullsized":"2023-12-07T00:15:29.797185+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:13.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797424+0000","last_change":"2023-12-07T00:15:27.795678+0000","last_active":"2023-12-07T00:15:29.797424+0000","last_peered":"2023-12-07T00:15:29.797424+0000","last_clean":"2023-12-07T00:15:29.797424+0000","last_became_active":"2023-12-07T00:15:27.795393+0000","last_became_peered":"2023-12-07T00:15:27.795393+0000","last_unstale":"2023-12-07T00:15:29.797424+0000","last_undegraded":"2023-12-07T00:15:29.797424+0000","last_fullsized":"2023-12-07T00:15:29.797424+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:57:32.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618627+0000","last_change":"2023-12-07T00:15:28.633033+0000","last_active":"2023-12-07T00:15:29.618627+0000","last_peered":"2023-12-07T00:15:29.618627+0000","last_clean":"2023-12-07T00:15:29.618627+0000","last_became_active":"2023-12-07T00:15:28.632855+0000","last_became_peered":"2023-12-07T00:15:28.632855+0000","last_unstale":"2023-12-07T00:15:29.618627+0000","last_undegraded":"2023-12-07T00:15:29.618627+0000","last_fullsized":"2023-12-07T00:15:29.618627+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:52:12.824603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796236+0000","last_change":"2023-12-07T00:15:27.788406+0000","last_active":"2023-12-07T00:15:29.796236+0000","last_peered":"2023-12-07T00:15:29.796236+0000","last_clean":"2023-12-07T00:15:29.796236+0000","last_became_active":"2023-12-07T00:15:27.788095+0000","last_became_peered":"2023-12-07T00:15:27.788095+0000","last_unstale":"2023-12-07T00:15:29.796236+0000","last_undegraded":"2023-12-07T00:15:29.796236+0000","last_fullsized":"2023-12-07T00:15:29.796236+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T04:49:14.837180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796163+0000","last_change":"2023-12-07T00:15:28.624671+0000","last_active":"2023-12-07T00:15:29.796163+0000","last_peered":"2023-12-07T00:15:29.796163+0000","last_clean":"2023-12-07T00:15:29.796163+0000","last_became_active":"2023-12-07T00:15:28.624441+0000","last_became_peered":"2023-12-07T00:15:28.624441+0000","last_unstale":"2023-12-07T00:15:29.796163+0000","last_undegraded":"2023-12-07T00:15:29.796163+0000","last_fullsized":"2023-12-07T00:15:29.796163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:42:46.087398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618934+0000","last_change":"2023-12-07T00:15:27.786089+0000","last_active":"2023-12-07T00:15:29.618934+0000","last_peered":"2023-12-07T00:15:29.618934+0000","last_clean":"2023-12-07T00:15:29.618934+0000","last_became_active":"2023-12-07T00:15:27.785687+0000","last_became_peered":"2023-12-07T00:15:27.785687+0000","last_unstale":"2023-12-07T00:15:29.618934+0000","last_undegraded":"2023-12-07T00:15:29.618934+0000","last_fullsized":"2023-12-07T00:15:29.618934+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:15:08.130625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620197+0000","last_change":"2023-12-07T00:15:28.635629+0000","last_active":"2023-12-07T00:15:29.620197+0000","last_peered":"2023-12-07T00:15:29.620197+0000","last_clean":"2023-12-07T00:15:29.620197+0000","last_became_active":"2023-12-07T00:15:28.635182+0000","last_became_peered":"2023-12-07T00:15:28.635182+0000","last_unstale":"2023-12-07T00:15:29.620197+0000","last_undegraded":"2023-12-07T00:15:29.620197+0000","last_fullsized":"2023-12-07T00:15:29.620197+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:51.123326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797339+0000","last_change":"2023-12-07T00:15:27.788892+0000","last_active":"2023-12-07T00:15:29.797339+0000","last_peered":"2023-12-07T00:15:29.797339+0000","last_clean":"2023-12-07T00:15:29.797339+0000","last_became_active":"2023-12-07T00:15:27.788615+0000","last_became_peered":"2023-12-07T00:15:27.788615+0000","last_unstale":"2023-12-07T00:15:29.797339+0000","last_undegraded":"2023-12-07T00:15:29.797339+0000","last_fullsized":"2023-12-07T00:15:29.797339+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:55:39.308606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796672+0000","last_change":"2023-12-07T00:15:28.627066+0000","last_active":"2023-12-07T00:15:29.796672+0000","last_peered":"2023-12-07T00:15:29.796672+0000","last_clean":"2023-12-07T00:15:29.796672+0000","last_became_active":"2023-12-07T00:15:28.626808+0000","last_became_peered":"2023-12-07T00:15:28.626808+0000","last_unstale":"2023-12-07T00:15:29.796672+0000","last_undegraded":"2023-12-07T00:15:29.796672+0000","last_fullsized":"2023-12-07T00:15:29.796672+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:13.602354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797019+0000","last_change":"2023-12-07T00:15:27.787696+0000","last_active":"2023-12-07T00:15:29.797019+0000","last_peered":"2023-12-07T00:15:29.797019+0000","last_clean":"2023-12-07T00:15:29.797019+0000","last_became_active":"2023-12-07T00:15:27.787430+0000","last_became_peered":"2023-12-07T00:15:27.787430+0000","last_unstale":"2023-12-07T00:15:29.797019+0000","last_undegraded":"2023-12-07T00:15:29.797019+0000","last_fullsized":"2023-12-07T00:15:29.797019+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:56.163603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796882+0000","last_change":"2023-12-07T00:15:28.627569+0000","last_active":"2023-12-07T00:15:29.796882+0000","last_peered":"2023-12-07T00:15:29.796882+0000","last_clean":"2023-12-07T00:15:29.796882+0000","last_became_active":"2023-12-07T00:15:28.627287+0000","last_became_peered":"2023-12-07T00:15:28.627287+0000","last_unstale":"2023-12-07T00:15:29.796882+0000","last_undegraded":"2023-12-07T00:15:29.796882+0000","last_fullsized":"2023-12-07T00:15:29.796882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:57.170835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618968+0000","last_change":"2023-12-07T00:15:27.789037+0000","last_active":"2023-12-07T00:15:29.618968+0000","last_peered":"2023-12-07T00:15:29.618968+0000","last_clean":"2023-12-07T00:15:29.618968+0000","last_became_active":"2023-12-07T00:15:27.788732+0000","last_became_peered":"2023-12-07T00:15:27.788732+0000","last_unstale":"2023-12-07T00:15:29.618968+0000","last_undegraded":"2023-12-07T00:15:29.618968+0000","last_fullsized":"2023-12-07T00:15:29.618968+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:56.163603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796329+0000","last_change":"2023-12-07T00:15:28.634058+0000","last_active":"2023-12-07T00:15:29.796329+0000","last_peered":"2023-12-07T00:15:29.796329+0000","last_clean":"2023-12-07T00:15:29.796329+0000","last_became_active":"2023-12-07T00:15:28.633793+0000","last_became_peered":"2023-12-07T00:15:28.633793+0000","last_unstale":"2023-12-07T00:15:29.796329+0000","last_undegraded":"2023-12-07T00:15:29.796329+0000","last_fullsized":"2023-12-07T00:15:29.796329+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:51.123326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618603+0000","last_change":"2023-12-07T00:15:27.785046+0000","last_active":"2023-12-07T00:15:29.618603+0000","last_peered":"2023-12-07T00:15:29.618603+0000","last_clean":"2023-12-07T00:15:29.618603+0000","last_became_active":"2023-12-07T00:15:27.784782+0000","last_became_peered":"2023-12-07T00:15:27.784782+0000","last_unstale":"2023-12-07T00:15:29.618603+0000","last_undegraded":"2023-12-07T00:15:29.618603+0000","last_fullsized":"2023-12-07T00:15:29.618603+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:41:02.212825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618426+0000","last_change":"2023-12-07T00:15:28.627158+0000","last_active":"2023-12-07T00:15:29.618426+0000","last_peered":"2023-12-07T00:15:29.618426+0000","last_clean":"2023-12-07T00:15:29.618426+0000","last_became_active":"2023-12-07T00:15:28.626894+0000","last_became_peered":"2023-12-07T00:15:28.626894+0000","last_unstale":"2023-12-07T00:15:29.618426+0000","last_undegraded":"2023-12-07T00:15:29.618426+0000","last_fullsized":"2023-12-07T00:15:29.618426+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:41:35.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797615+0000","last_change":"2023-12-07T00:15:27.795466+0000","last_active":"2023-12-07T00:15:29.797615+0000","last_peered":"2023-12-07T00:15:29.797615+0000","last_clean":"2023-12-07T00:15:29.797615+0000","last_became_active":"2023-12-07T00:15:27.795272+0000","last_became_peered":"2023-12-07T00:15:27.795272+0000","last_unstale":"2023-12-07T00:15:29.797615+0000","last_undegraded":"2023-12-07T00:15:29.797615+0000","last_fullsized":"2023-12-07T00:15:29.797615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:02:32.966386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620211+0000","last_change":"2023-12-07T00:15:28.625944+0000","last_active":"2023-12-07T00:15:29.620211+0000","last_peered":"2023-12-07T00:15:29.620211+0000","last_clean":"2023-12-07T00:15:29.620211+0000","last_became_active":"2023-12-07T00:15:28.625371+0000","last_became_peered":"2023-12-07T00:15:28.625371+0000","last_unstale":"2023-12-07T00:15:29.620211+0000","last_undegraded":"2023-12-07T00:15:29.620211+0000","last_fullsized":"2023-12-07T00:15:29.620211+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:05:57.170835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619280+0000","last_change":"2023-12-07T00:15:27.789339+0000","last_active":"2023-12-07T00:15:29.619280+0000","last_peered":"2023-12-07T00:15:29.619280+0000","last_clean":"2023-12-07T00:15:29.619280+0000","last_became_active":"2023-12-07T00:15:27.789030+0000","last_became_peered":"2023-12-07T00:15:27.789030+0000","last_unstale":"2023-12-07T00:15:29.619280+0000","last_undegraded":"2023-12-07T00:15:29.619280+0000","last_fullsized":"2023-12-07T00:15:29.619280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:34:40.606076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618504+0000","last_change":"2023-12-07T00:15:28.628053+0000","last_active":"2023-12-07T00:15:29.618504+0000","last_peered":"2023-12-07T00:15:29.618504+0000","last_clean":"2023-12-07T00:15:29.618504+0000","last_became_active":"2023-12-07T00:15:28.627762+0000","last_became_peered":"2023-12-07T00:15:28.627762+0000","last_unstale":"2023-12-07T00:15:29.618504+0000","last_undegraded":"2023-12-07T00:15:29.618504+0000","last_fullsized":"2023-12-07T00:15:29.618504+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:48:35.959270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620358+0000","last_change":"2023-12-07T00:15:27.792884+0000","last_active":"2023-12-07T00:15:29.620358+0000","last_peered":"2023-12-07T00:15:29.620358+0000","last_clean":"2023-12-07T00:15:29.620358+0000","last_became_active":"2023-12-07T00:15:27.792385+0000","last_became_peered":"2023-12-07T00:15:27.792385+0000","last_unstale":"2023-12-07T00:15:29.620358+0000","last_undegraded":"2023-12-07T00:15:29.620358+0000","last_fullsized":"2023-12-07T00:15:29.620358+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:52:38.328917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618803+0000","last_change":"2023-12-07T00:15:28.634737+0000","last_active":"2023-12-07T00:15:29.618803+0000","last_peered":"2023-12-07T00:15:29.618803+0000","last_clean":"2023-12-07T00:15:29.618803+0000","last_became_active":"2023-12-07T00:15:28.634496+0000","last_became_peered":"2023-12-07T00:15:28.634496+0000","last_unstale":"2023-12-07T00:15:29.618803+0000","last_undegraded":"2023-12-07T00:15:29.618803+0000","last_fullsized":"2023-12-07T00:15:29.618803+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:04:13.749525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797219+0000","last_change":"2023-12-07T00:15:27.790632+0000","last_active":"2023-12-07T00:15:29.797219+0000","last_peered":"2023-12-07T00:15:29.797219+0000","last_clean":"2023-12-07T00:15:29.797219+0000","last_became_active":"2023-12-07T00:15:27.790369+0000","last_became_peered":"2023-12-07T00:15:27.790369+0000","last_unstale":"2023-12-07T00:15:29.797219+0000","last_undegraded":"2023-12-07T00:15:29.797219+0000","last_fullsized":"2023-12-07T00:15:29.797219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:22:03.473504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796746+0000","last_change":"2023-12-07T00:15:28.635231+0000","last_active":"2023-12-07T00:15:29.796746+0000","last_peered":"2023-12-07T00:15:29.796746+0000","last_clean":"2023-12-07T00:15:29.796746+0000","last_became_active":"2023-12-07T00:15:28.634919+0000","last_became_peered":"2023-12-07T00:15:28.634919+0000","last_unstale":"2023-12-07T00:15:29.796746+0000","last_undegraded":"2023-12-07T00:15:29.796746+0000","last_fullsized":"2023-12-07T00:15:29.796746+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:37:33.170176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797397+0000","last_change":"2023-12-07T00:15:27.795839+0000","last_active":"2023-12-07T00:15:29.797397+0000","last_peered":"2023-12-07T00:15:29.797397+0000","last_clean":"2023-12-07T00:15:29.797397+0000","last_became_active":"2023-12-07T00:15:27.795497+0000","last_became_peered":"2023-12-07T00:15:27.795497+0000","last_unstale":"2023-12-07T00:15:29.797397+0000","last_undegraded":"2023-12-07T00:15:29.797397+0000","last_fullsized":"2023-12-07T00:15:29.797397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:17:44.055038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797354+0000","last_change":"2023-12-07T00:15:28.633238+0000","last_active":"2023-12-07T00:15:29.797354+0000","last_peered":"2023-12-07T00:15:29.797354+0000","last_clean":"2023-12-07T00:15:29.797354+0000","last_became_active":"2023-12-07T00:15:28.632969+0000","last_became_peered":"2023-12-07T00:15:28.632969+0000","last_unstale":"2023-12-07T00:15:29.797354+0000","last_undegraded":"2023-12-07T00:15:29.797354+0000","last_fullsized":"2023-12-07T00:15:29.797354+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:55:40.004863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795900+0000","last_change":"2023-12-07T00:15:27.789176+0000","last_active":"2023-12-07T00:15:29.795900+0000","last_peered":"2023-12-07T00:15:29.795900+0000","last_clean":"2023-12-07T00:15:29.795900+0000","last_became_active":"2023-12-07T00:15:27.788834+0000","last_became_peered":"2023-12-07T00:15:27.788834+0000","last_unstale":"2023-12-07T00:15:29.795900+0000","last_undegraded":"2023-12-07T00:15:29.795900+0000","last_fullsized":"2023-12-07T00:15:29.795900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:40:41.921279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796114+0000","last_change":"2023-12-07T00:15:28.628493+0000","last_active":"2023-12-07T00:15:29.796114+0000","last_peered":"2023-12-07T00:15:29.796114+0000","last_clean":"2023-12-07T00:15:29.796114+0000","last_became_active":"2023-12-07T00:15:28.628114+0000","last_became_peered":"2023-12-07T00:15:28.628114+0000","last_unstale":"2023-12-07T00:15:29.796114+0000","last_undegraded":"2023-12-07T00:15:29.796114+0000","last_fullsized":"2023-12-07T00:15:29.796114+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:52:39.336149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797531+0000","last_change":"2023-12-07T00:15:27.789647+0000","last_active":"2023-12-07T00:15:29.797531+0000","last_peered":"2023-12-07T00:15:29.797531+0000","last_clean":"2023-12-07T00:15:29.797531+0000","last_became_active":"2023-12-07T00:15:27.789352+0000","last_became_peered":"2023-12-07T00:15:27.789352+0000","last_unstale":"2023-12-07T00:15:29.797531+0000","last_undegraded":"2023-12-07T00:15:29.797531+0000","last_fullsized":"2023-12-07T00:15:29.797531+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:28:11.407876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620068+0000","last_change":"2023-12-07T00:15:28.625585+0000","last_active":"2023-12-07T00:15:29.620068+0000","last_peered":"2023-12-07T00:15:29.620068+0000","last_clean":"2023-12-07T00:15:29.620068+0000","last_became_active":"2023-12-07T00:15:28.625259+0000","last_became_peered":"2023-12-07T00:15:28.625259+0000","last_unstale":"2023-12-07T00:15:29.620068+0000","last_undegraded":"2023-12-07T00:15:29.620068+0000","last_fullsized":"2023-12-07T00:15:29.620068+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:22:59.546950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795995+0000","last_change":"2023-12-07T00:15:27.782608+0000","last_active":"2023-12-07T00:15:29.795995+0000","last_peered":"2023-12-07T00:15:29.795995+0000","last_clean":"2023-12-07T00:15:29.795995+0000","last_became_active":"2023-12-07T00:15:27.782228+0000","last_became_peered":"2023-12-07T00:15:27.782228+0000","last_unstale":"2023-12-07T00:15:29.795995+0000","last_undegraded":"2023-12-07T00:15:29.795995+0000","last_fullsized":"2023-12-07T00:15:29.795995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T12:09:59.887437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795895+0000","last_change":"2023-12-07T00:15:28.629758+0000","last_active":"2023-12-07T00:15:29.795895+0000","last_peered":"2023-12-07T00:15:29.795895+0000","last_clean":"2023-12-07T00:15:29.795895+0000","last_became_active":"2023-12-07T00:15:28.629588+0000","last_became_peered":"2023-12-07T00:15:28.629588+0000","last_unstale":"2023-12-07T00:15:29.795895+0000","last_undegraded":"2023-12-07T00:15:29.795895+0000","last_fullsized":"2023-12-07T00:15:29.795895+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:55:40.315839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795888+0000","last_change":"2023-12-07T00:15:27.784622+0000","last_active":"2023-12-07T00:15:29.795888+0000","last_peered":"2023-12-07T00:15:29.795888+0000","last_clean":"2023-12-07T00:15:29.795888+0000","last_became_active":"2023-12-07T00:15:27.784331+0000","last_became_peered":"2023-12-07T00:15:27.784331+0000","last_unstale":"2023-12-07T00:15:29.795888+0000","last_undegraded":"2023-12-07T00:15:29.795888+0000","last_fullsized":"2023-12-07T00:15:29.795888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:50:41.769868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797159+0000","last_change":"2023-12-07T00:15:28.640255+0000","last_active":"2023-12-07T00:15:29.797159+0000","last_peered":"2023-12-07T00:15:29.797159+0000","last_clean":"2023-12-07T00:15:29.797159+0000","last_became_active":"2023-12-07T00:15:28.639952+0000","last_became_peered":"2023-12-07T00:15:28.639952+0000","last_unstale":"2023-12-07T00:15:29.797159+0000","last_undegraded":"2023-12-07T00:15:29.797159+0000","last_fullsized":"2023-12-07T00:15:29.797159+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:50:24.151612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620355+0000","last_change":"2023-12-07T00:15:27.792477+0000","last_active":"2023-12-07T00:15:29.620355+0000","last_peered":"2023-12-07T00:15:29.620355+0000","last_clean":"2023-12-07T00:15:29.620355+0000","last_became_active":"2023-12-07T00:15:27.792182+0000","last_became_peered":"2023-12-07T00:15:27.792182+0000","last_unstale":"2023-12-07T00:15:29.620355+0000","last_undegraded":"2023-12-07T00:15:29.620355+0000","last_fullsized":"2023-12-07T00:15:29.620355+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:49:47.550427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618523+0000","last_change":"2023-12-07T00:15:28.626530+0000","last_active":"2023-12-07T00:15:29.618523+0000","last_peered":"2023-12-07T00:15:29.618523+0000","last_clean":"2023-12-07T00:15:29.618523+0000","last_became_active":"2023-12-07T00:15:28.626268+0000","last_became_peered":"2023-12-07T00:15:28.626268+0000","last_unstale":"2023-12-07T00:15:29.618523+0000","last_undegraded":"2023-12-07T00:15:29.618523+0000","last_fullsized":"2023-12-07T00:15:29.618523+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T08:34:25.611656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795605+0000","last_change":"2023-12-07T00:15:27.781325+0000","last_active":"2023-12-07T00:15:29.795605+0000","last_peered":"2023-12-07T00:15:29.795605+0000","last_clean":"2023-12-07T00:15:29.795605+0000","last_became_active":"2023-12-07T00:15:27.781038+0000","last_became_peered":"2023-12-07T00:15:27.781038+0000","last_unstale":"2023-12-07T00:15:29.795605+0000","last_undegraded":"2023-12-07T00:15:29.795605+0000","last_fullsized":"2023-12-07T00:15:29.795605+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T07:16:53.865938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797488+0000","last_change":"2023-12-07T00:15:28.637266+0000","last_active":"2023-12-07T00:15:29.797488+0000","last_peered":"2023-12-07T00:15:29.797488+0000","last_clean":"2023-12-07T00:15:29.797488+0000","last_became_active":"2023-12-07T00:15:28.636994+0000","last_became_peered":"2023-12-07T00:15:28.636994+0000","last_unstale":"2023-12-07T00:15:29.797488+0000","last_undegraded":"2023-12-07T00:15:29.797488+0000","last_fullsized":"2023-12-07T00:15:29.797488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:51.123326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797156+0000","last_change":"2023-12-07T00:15:27.792307+0000","last_active":"2023-12-07T00:15:29.797156+0000","last_peered":"2023-12-07T00:15:29.797156+0000","last_clean":"2023-12-07T00:15:29.797156+0000","last_became_active":"2023-12-07T00:15:27.791956+0000","last_became_peered":"2023-12-07T00:15:27.791956+0000","last_unstale":"2023-12-07T00:15:29.797156+0000","last_undegraded":"2023-12-07T00:15:29.797156+0000","last_fullsized":"2023-12-07T00:15:29.797156+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:59:12.595121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620355+0000","last_change":"2023-12-07T00:15:28.635178+0000","last_active":"2023-12-07T00:15:29.620355+0000","last_peered":"2023-12-07T00:15:29.620355+0000","last_clean":"2023-12-07T00:15:29.620355+0000","last_became_active":"2023-12-07T00:15:28.634925+0000","last_became_peered":"2023-12-07T00:15:28.634925+0000","last_unstale":"2023-12-07T00:15:29.620355+0000","last_undegraded":"2023-12-07T00:15:29.620355+0000","last_fullsized":"2023-12-07T00:15:29.620355+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T00:20:36.006513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795885+0000","last_change":"2023-12-07T00:15:27.788481+0000","last_active":"2023-12-07T00:15:29.795885+0000","last_peered":"2023-12-07T00:15:29.795885+0000","last_clean":"2023-12-07T00:15:29.795885+0000","last_became_active":"2023-12-07T00:15:27.788185+0000","last_became_peered":"2023-12-07T00:15:27.788185+0000","last_unstale":"2023-12-07T00:15:29.795885+0000","last_undegraded":"2023-12-07T00:15:29.795885+0000","last_fullsized":"2023-12-07T00:15:29.795885+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T11:35:34.806120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618756+0000","last_change":"2023-12-07T00:15:28.624167+0000","last_active":"2023-12-07T00:15:29.618756+0000","last_peered":"2023-12-07T00:15:29.618756+0000","last_clean":"2023-12-07T00:15:29.618756+0000","last_became_active":"2023-12-07T00:15:28.623904+0000","last_became_peered":"2023-12-07T00:15:28.623904+0000","last_unstale":"2023-12-07T00:15:29.618756+0000","last_undegraded":"2023-12-07T00:15:29.618756+0000","last_fullsized":"2023-12-07T00:15:29.618756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:08:46.406011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796478+0000","last_change":"2023-12-07T00:15:27.781155+0000","last_active":"2023-12-07T00:15:29.796478+0000","last_peered":"2023-12-07T00:15:29.796478+0000","last_clean":"2023-12-07T00:15:29.796478+0000","last_became_active":"2023-12-07T00:15:27.780922+0000","last_became_peered":"2023-12-07T00:15:27.780922+0000","last_unstale":"2023-12-07T00:15:29.796478+0000","last_undegraded":"2023-12-07T00:15:29.796478+0000","last_fullsized":"2023-12-07T00:15:29.796478+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:57:32.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.795807+0000","last_change":"2023-12-07T00:15:28.634643+0000","last_active":"2023-12-07T00:15:29.795807+0000","last_peered":"2023-12-07T00:15:29.795807+0000","last_clean":"2023-12-07T00:15:29.795807+0000","last_became_active":"2023-12-07T00:15:28.634390+0000","last_became_peered":"2023-12-07T00:15:28.634390+0000","last_unstale":"2023-12-07T00:15:29.795807+0000","last_undegraded":"2023-12-07T00:15:29.795807+0000","last_fullsized":"2023-12-07T00:15:29.795807+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T01:33:50.580466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796280+0000","last_change":"2023-12-07T00:15:27.787447+0000","last_active":"2023-12-07T00:15:29.796280+0000","last_peered":"2023-12-07T00:15:29.796280+0000","last_clean":"2023-12-07T00:15:29.796280+0000","last_became_active":"2023-12-07T00:15:27.787244+0000","last_became_peered":"2023-12-07T00:15:27.787244+0000","last_unstale":"2023-12-07T00:15:29.796280+0000","last_undegraded":"2023-12-07T00:15:29.796280+0000","last_fullsized":"2023-12-07T00:15:29.796280+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T05:02:32.966386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797450+0000","last_change":"2023-12-07T00:15:28.635243+0000","last_active":"2023-12-07T00:15:29.797450+0000","last_peered":"2023-12-07T00:15:29.797450+0000","last_clean":"2023-12-07T00:15:29.797450+0000","last_became_active":"2023-12-07T00:15:28.634973+0000","last_became_peered":"2023-12-07T00:15:28.634973+0000","last_unstale":"2023-12-07T00:15:29.797450+0000","last_undegraded":"2023-12-07T00:15:29.797450+0000","last_fullsized":"2023-12-07T00:15:29.797450+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:22:59.546950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.619303+0000","last_change":"2023-12-07T00:15:27.786270+0000","last_active":"2023-12-07T00:15:29.619303+0000","last_peered":"2023-12-07T00:15:29.619303+0000","last_clean":"2023-12-07T00:15:29.619303+0000","last_became_active":"2023-12-07T00:15:27.785658+0000","last_became_peered":"2023-12-07T00:15:27.785658+0000","last_unstale":"2023-12-07T00:15:29.619303+0000","last_undegraded":"2023-12-07T00:15:29.619303+0000","last_fullsized":"2023-12-07T00:15:29.619303+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:27:27.681015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.796919+0000","last_change":"2023-12-07T00:15:28.626317+0000","last_active":"2023-12-07T00:15:29.796919+0000","last_peered":"2023-12-07T00:15:29.796919+0000","last_clean":"2023-12-07T00:15:29.796919+0000","last_became_active":"2023-12-07T00:15:28.625981+0000","last_became_peered":"2023-12-07T00:15:28.625981+0000","last_unstale":"2023-12-07T00:15:29.796919+0000","last_undegraded":"2023-12-07T00:15:29.796919+0000","last_fullsized":"2023-12-07T00:15:29.796919+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:51.123326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797443+0000","last_change":"2023-12-07T00:15:27.784882+0000","last_active":"2023-12-07T00:15:29.797443+0000","last_peered":"2023-12-07T00:15:29.797443+0000","last_clean":"2023-12-07T00:15:29.797443+0000","last_became_active":"2023-12-07T00:15:27.784599+0000","last_became_peered":"2023-12-07T00:15:27.784599+0000","last_unstale":"2023-12-07T00:15:29.797443+0000","last_undegraded":"2023-12-07T00:15:29.797443+0000","last_fullsized":"2023-12-07T00:15:29.797443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T03:44:42.033039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620314+0000","last_change":"2023-12-07T00:15:28.635420+0000","last_active":"2023-12-07T00:15:29.620314+0000","last_peered":"2023-12-07T00:15:29.620314+0000","last_clean":"2023-12-07T00:15:29.620314+0000","last_became_active":"2023-12-07T00:15:28.634593+0000","last_became_peered":"2023-12-07T00:15:28.634593+0000","last_unstale":"2023-12-07T00:15:29.620314+0000","last_undegraded":"2023-12-07T00:15:29.620314+0000","last_fullsized":"2023-12-07T00:15:29.620314+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:22:04.480736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.618379+0000","last_change":"2023-12-07T00:15:27.786413+0000","last_active":"2023-12-07T00:15:29.618379+0000","last_peered":"2023-12-07T00:15:29.618379+0000","last_clean":"2023-12-07T00:15:29.618379+0000","last_became_active":"2023-12-07T00:15:27.786165+0000","last_became_peered":"2023-12-07T00:15:27.786165+0000","last_unstale":"2023-12-07T00:15:29.618379+0000","last_undegraded":"2023-12-07T00:15:29.618379+0000","last_fullsized":"2023-12-07T00:15:29.618379+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T10:16:50.116094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.797105+0000","last_change":"2023-12-07T00:15:28.624751+0000","last_active":"2023-12-07T00:15:29.797105+0000","last_peered":"2023-12-07T00:15:29.797105+0000","last_clean":"2023-12-07T00:15:29.797105+0000","last_became_active":"2023-12-07T00:15:28.624434+0000","last_became_peered":"2023-12-07T00:15:28.624434+0000","last_unstale":"2023-12-07T00:15:29.797105+0000","last_undegraded":"2023-12-07T00:15:29.797105+0000","last_fullsized":"2023-12-07T00:15:29.797105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:27.763324+0000","last_clean_scrub_stamp":"2023-12-07T00:15:27.763324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T02:39:00.280001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-07T00:15:29.620307+0000","last_change":"2023-12-07T00:15:27.798133+0000","last_active":"2023-12-07T00:15:29.620307+0000","last_peered":"2023-12-07T00:15:29.620307+0000","last_clean":"2023-12-07T00:15:29.620307+0000","last_became_active":"2023-12-07T00:15:27.797895+0000","last_became_peered":"2023-12-07T00:15:27.797895+0000","last_unstale":"2023-12-07T00:15:29.620307+0000","last_undegraded":"2023-12-07T00:15:29.620307+0000","last_fullsized":"2023-12-07T00:15:29.620307+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:15:26.756092+0000","last_clean_scrub_stamp":"2023-12-07T00:15:26.756092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T06:57:32.418023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-07T00:15:28.621179+0000","last_change":"2023-12-07T00:14:04.636514+0000","last_active":"2023-12-07T00:15:28.621179+0000","last_peered":"2023-12-07T00:15:28.621179+0000","last_clean":"2023-12-07T00:15:28.621179+0000","last_became_active":"2023-12-07T00:14:04.635540+0000","last_became_peered":"2023-12-07T00:14:04.635540+0000","last_unstale":"2023-12-07T00:15:28.621179+0000","last_undegraded":"2023-12-07T00:15:28.621179+0000","last_fullsized":"2023-12-07T00:15:28.621179+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T00:14:03.541217+0000","last_clean_scrub_stamp":"2023-12-07T00:14:03.541217+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T09:08:01.012662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":796949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.629},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.503}]},{"osd":6,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":205481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.433}]},{"osd":3,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.63},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":9.8849999999999998,"5min":9.8849999999999998,"15min":9.8849999999999998},"last":0.29299999999999998}]},{"osd":2,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"last":0.379},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":9.9830000000000005,"5min":9.9830000000000005,"15min":9.9830000000000005},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":9.9199999999999999,"5min":9.9199999999999999,"15min":9.9199999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.65200000000000002}]},{"osd":5,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.622}]},{"osd":6,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":9.8260000000000005,"5min":9.8260000000000005,"15min":9.8260000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.71899999999999997}]},{"osd":7,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.72899999999999998},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":9.9529999999999994,"5min":9.9529999999999994,"15min":9.9529999999999994},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1073152,"data_stored":795301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.222},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.20499999999999999}]},{"osd":2,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.255},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Dec 7 00:15:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":204969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.312}]},{"osd":1,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.503}]},{"osd":6,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.437}]},{"osd":7,"last update":"Thu Dec 7 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":479232,"data_stored":199925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.434,"5min":0.434,"15min":0.434},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.315},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.371}]},{"osd":4,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Dec 7 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.57599999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":205503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.51500000000000001}]},{"osd":3,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.623}]},{"osd":5,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.378},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.436}]},{"osd":7,"last update":"Thu Dec 7 00:15:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40799999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":205011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":9.5730000000000004,"5min":9.5730000000000004,"15min":9.5730000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.74,"5min":1.74,"15min":1.74},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":20.481000000000002,"5min":20.481000000000002,"15min":20.481000000000002},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.623},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.66200000000000003}]},{"osd":3,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.1320000000000001,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Dec 7 00:15:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.76800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T00:15:33.280 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-07T00:15:33.281 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-07T00:15:33.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.445+0000 7f2470d3e700 1 Processor -- start 2023-12-07T00:15:33.444 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.445+0000 7f2470d3e700 1 -- start start 2023-12-07T00:15:33.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f2470d3e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f246c15bba0 0x7f246c15bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f2470d3e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0ccee0 0x7f246c15fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.448 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f2470d3e700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246c15f640 con 0x7f246c1602f0 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f2470d3e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246c0b03e0 con 0x7f246c15bba0 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f2470d3e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c15c8c0 con 0x7f246c0ccee0 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246ad9d700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f246c1602f0 0x7f246c0cf890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48370/0 (socket says 172.21.15.179:48370) 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246ad9d700 1 -- 172.21.15.179:0/3901429040 learned_addr learned my addr 172.21.15.179:0/3901429040 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839832188 0 0) 0x7f246c15f640 con 0x7f246c1602f0 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246a59c700 1 --2- 172.21.15.179:0/3901429040 >> v2:172.21.15.190:3300/0 conn(0x7f246c15bba0 0x7f246c15bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f2469d9b700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0ccee0 0x7f246c15fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24540035b0 con 0x7f246c1602f0 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726998115 0 0) 0x7f24540035b0 con 0x7f246c1602f0 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0ccee0 msgr2=0x7f246c15fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:33.449 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0ccee0 0x7f246c15fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.450 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 >> v2:172.21.15.190:3300/0 conn(0x7f246c15bba0 msgr2=0x7f246c15bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:33.450 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 --2- 172.21.15.179:0/3901429040 >> v2:172.21.15.190:3300/0 conn(0x7f246c15bba0 0x7f246c15bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.450 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c15cba0 con 0x7f246c1602f0 2023-12-07T00:15:33.450 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f24640019f0 con 0x7f246c1602f0 2023-12-07T00:15:33.450 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 >> v1:172.21.15.179:6789/0 conn(0x7f246c1602f0 legacy=0x7f246c0cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.451 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0ccee0 0x7f2454003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.451 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f2454004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.451 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.446+0000 7f246959a700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2454004d90 0x7f2454005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.451 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0b03e0 con 0x7f2454003f80 2023-12-07T00:15:33.451 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c15c8c0 con 0x7f2454004d90 2023-12-07T00:15:33.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245400ba60 con 0x7f246c0ccee0 2023-12-07T00:15:33.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f2469d9b700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f2454004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246a59c700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0ccee0 0x7f2454003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246ad9d700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2454004d90 0x7f2454005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f2469d9b700 1 -- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0ccee0 msgr2=0x7f2454003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:33.452 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f2469d9b700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0ccee0 0x7f2454003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f2469d9b700 1 -- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2454004d90 msgr2=0x7f2454005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:33.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f2469d9b700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2454004d90 0x7f2454005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f2469d9b700 1 -- 172.21.15.179:0/3901429040 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540035b0 con 0x7f2454003f80 2023-12-07T00:15:33.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246ad9d700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2454004d90 0x7f2454005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:33.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f2469d9b700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f2454004850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2460009b90 tx=0x7f2454005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872f7bd16018139f server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000e6c0 con 0x7f2454003f80 2023-12-07T00:15:33.453 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246000e820 con 0x7f2454003f80 2023-12-07T00:15:33.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.447+0000 7f246959a700 1 -- 172.21.15.179:0/3901429040 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246000eb90 con 0x7f2454003f80 2023-12-07T00:15:33.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.448+0000 7f2470d3e700 1 -- 172.21.15.179:0/3901429040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 msgr2=0x7f2454004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.448+0000 7f2470d3e700 1 --2- 172.21.15.179:0/3901429040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f2454004850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2460009b90 tx=0x7f2454005880 comp rx=0 tx=0).stop 2023-12-07T00:15:33.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.448+0000 7f246ad9d700 1 -- 172.21.15.179:0/3901429040 reap_dead start 2023-12-07T00:15:33.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.448+0000 7f2470d3e700 1 -- 172.21.15.179:0/3901429040 shutdown_connections 2023-12-07T00:15:33.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.448+0000 7f2470d3e700 1 -- 172.21.15.179:0/3901429040 >> 172.21.15.179:0/3901429040 conn(0x7f246c099a40 msgr2=0x7f246c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:33.454 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.448+0000 7f2470d3e700 1 -- 172.21.15.179:0/3901429040 shutdown_connections 2023-12-07T00:15:33.455 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.448+0000 7f2470d3e700 1 -- 172.21.15.179:0/3901429040 wait complete. 2023-12-07T00:15:33.455 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.449+0000 7f2470d3e700 1 Processor -- start 2023-12-07T00:15:33.455 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.449+0000 7f2470d3e700 1 -- start start 2023-12-07T00:15:33.461 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f2470d3e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f246c0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.461 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f2470d3e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f246c1590d0 0x7f246c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.461 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f2470d3e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0b61d0 0x7f246c15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.461 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f2470d3e700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c6210 con 0x7f2454003f80 2023-12-07T00:15:33.461 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f2470d3e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246c14f330 con 0x7f246c1590d0 2023-12-07T00:15:33.461 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f2470d3e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246c0c5600 con 0x7f246c0b61d0 2023-12-07T00:15:33.462 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f246c0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.462 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f246c0c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41478/0 (socket says 172.21.15.179:41478) 2023-12-07T00:15:33.462 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 -- 172.21.15.179:0/3223420036 learned_addr learned my addr 172.21.15.179:0/3223420036 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:33.462 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 -- 172.21.15.179:0/3223420036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0b61d0 msgr2=0x7f246c15dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.462 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0b61d0 0x7f246c15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.463 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 -- 172.21.15.179:0/3223420036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f246c1590d0 msgr2=0x7f246c14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.463 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f2469d9b700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f246c1590d0 0x7f246c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.463 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f246c1590d0 0x7f246c14edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.463 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 -- 172.21.15.179:0/3223420036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0c58e0 con 0x7f2454003f80 2023-12-07T00:15:33.463 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.450+0000 7f246a59c700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f246c0c7b70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f245c011a20 tx=0x7f245c011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.463 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.451+0000 7f245affd700 1 -- 172.21.15.179:0/3223420036 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c00fa00 con 0x7f2454003f80 2023-12-07T00:15:33.464 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.451+0000 7f245affd700 1 -- 172.21.15.179:0/3223420036 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c00fb60 con 0x7f2454003f80 2023-12-07T00:15:33.464 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.451+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246c0c5bc0 con 0x7f2454003f80 2023-12-07T00:15:33.464 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.451+0000 7f245affd700 1 -- 172.21.15.179:0/3223420036 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c014440 con 0x7f2454003f80 2023-12-07T00:15:33.464 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.451+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246c0b6680 con 0x7f2454003f80 2023-12-07T00:15:33.464 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.452+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246c0c64f0 con 0x7f2454003f80 2023-12-07T00:15:33.464 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.452+0000 7f245affd700 1 -- 172.21.15.179:0/3223420036 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f245c0145a0 con 0x7f2454003f80 2023-12-07T00:15:33.465 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.452+0000 7f245affd700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f244c06aed0 0x7f244c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.465 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.452+0000 7f245affd700 1 -- 172.21.15.179:0/3223420036 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f245c089e60 con 0x7f2454003f80 2023-12-07T00:15:33.465 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.453+0000 7f2469d9b700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f244c06aed0 0x7f244c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.465 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.453+0000 7f2469d9b700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f244c06aed0 0x7f244c06d390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f246c159510 tx=0x7f2460008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.465 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.457+0000 7f245affd700 1 -- 172.21.15.179:0/3223420036 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f245c054e60 con 0x7f2454003f80 2023-12-07T00:15:33.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.725+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f246c0685f0 con 0x7f2454003f80 2023-12-07T00:15:33.726 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.727+0000 7f245affd700 1 -- 172.21.15.179:0/3223420036 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f245c058480 con 0x7f2454003f80 2023-12-07T00:15:33.726 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2023-12-07T00:15:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAbDnFlnRJ6HBAAOpJ30jTvFKlEPFblPq5rqw== 2023-12-07T00:15:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: caps mds = "allow" 2023-12-07T00:15:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: caps mon = "allow r" 2023-12-07T00:15:33.727 INFO:teuthology.orchestra.run.smithi179.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-07T00:15:33.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f244c06aed0 msgr2=0x7f244c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f244c06aed0 0x7f244c06d390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f246c159510 tx=0x7f2460008030 comp rx=0 tx=0).stop 2023-12-07T00:15:33.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 msgr2=0x7f246c0c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f246c0c7b70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f245c011a20 tx=0x7f245c011de0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 shutdown_connections 2023-12-07T00:15:33.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f244c06aed0 0x7f244c06d390 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f246c0b61d0 0x7f246c15dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2454003f80 0x7f246c0c7b70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 --2- 172.21.15.179:0/3223420036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f246c1590d0 0x7f246c14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 >> 172.21.15.179:0/3223420036 conn(0x7f246c099a40 msgr2=0x7f246c099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:33.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 shutdown_connections 2023-12-07T00:15:33.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.730+0000 7f2470d3e700 1 -- 172.21.15.179:0/3223420036 wait complete. 2023-12-07T00:15:33.730 INFO:teuthology.orchestra.run.smithi179.stderr:updated caps for client.0 2023-12-07T00:15:33.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-07T00:15:33.863 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.863+0000 7fb27ccd0700 1 Processor -- start 2023-12-07T00:15:33.863 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.863+0000 7fb27ccd0700 1 -- start start 2023-12-07T00:15:33.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.864+0000 7fb27ccd0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb27815bde0 0x7fb2780d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.864+0000 7fb27ccd0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2780cd020 0x7fb2780cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.881 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.864+0000 7fb27ccd0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27809ab50 con 0x7fb278099c00 2023-12-07T00:15:33.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.864+0000 7fb27ccd0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2780cf630 con 0x7fb27815bde0 2023-12-07T00:15:33.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.864+0000 7fb27ccd0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780cf8f0 con 0x7fb2780cd020 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27659c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb27815bde0 0x7fb2780d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27659c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb27815bde0 0x7fb2780d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:43738/0 (socket says 172.21.15.179:43738) 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb275d9b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2780cd020 0x7fb2780cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27659c700 1 -- 172.21.15.179:0/3491270383 learned_addr learned my addr 172.21.15.179:0/3491270383 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27659c700 1 -- 172.21.15.179:0/3491270383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2780cd020 msgr2=0x7fb2780cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27659c700 1 --2- 172.21.15.179:0/3491270383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2780cd020 0x7fb2780cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27659c700 1 -- 172.21.15.179:0/3491270383 >> v1:172.21.15.190:6789/0 conn(0x7fb278099c00 legacy=0x7fb27815f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27659c700 1 -- 172.21.15.179:0/3491270383 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2780cfbd0 con 0x7fb27815bde0 2023-12-07T00:15:33.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb275d9b700 1 --2- 172.21.15.179:0/3491270383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2780cd020 0x7fb2780cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T00:15:33.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27659c700 1 --2- 172.21.15.179:0/3491270383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb27815bde0 0x7fb2780d06b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0098f0 tx=0x7fb26c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921d17b69f8d9fac server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27559a700 1 -- 172.21.15.179:0/3491270383 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c011830 con 0x7fb27815bde0 2023-12-07T00:15:33.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27559a700 1 -- 172.21.15.179:0/3491270383 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c011990 con 0x7fb27815bde0 2023-12-07T00:15:33.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.865+0000 7fb27559a700 1 -- 172.21.15.179:0/3491270383 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c011d20 con 0x7fb27815bde0 2023-12-07T00:15:33.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.866+0000 7fb27ccd0700 1 -- 172.21.15.179:0/3491270383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb27815bde0 msgr2=0x7fb2780d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.866+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/3491270383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb27815bde0 0x7fb2780d06b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0098f0 tx=0x7fb26c009c00 comp rx=0 tx=0).stop 2023-12-07T00:15:33.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.866+0000 7fb27ccd0700 1 -- 172.21.15.179:0/3491270383 shutdown_connections 2023-12-07T00:15:33.884 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.866+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/3491270383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb27815bde0 0x7fb2780d06b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.866+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/3491270383 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2780cd020 0x7fb2780cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.866+0000 7fb27ccd0700 1 -- 172.21.15.179:0/3491270383 >> 172.21.15.179:0/3491270383 conn(0x7fb2780b3550 msgr2=0x7fb2780b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.866+0000 7fb27ccd0700 1 -- 172.21.15.179:0/3491270383 shutdown_connections 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.866+0000 7fb27ccd0700 1 -- 172.21.15.179:0/3491270383 wait complete. 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.867+0000 7fb27ccd0700 1 Processor -- start 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.867+0000 7fb27ccd0700 1 -- start start 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb27ccd0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb278099c00 0x7fb2781505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb27ccd0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2780cd020 0x7fb2780b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb27ccd0700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb27815bde0 0x7fb27815e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.885 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb27ccd0700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780b6230 con 0x7fb27815bde0 2023-12-07T00:15:33.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb27ccd0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780b4c50 con 0x7fb2780cd020 2023-12-07T00:15:33.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb27ccd0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2780b4f30 con 0x7fb278099c00 2023-12-07T00:15:33.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb276d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb27815bde0 0x7fb27815e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb276d9d700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb27815bde0 0x7fb27815e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41494/0 (socket says 172.21.15.179:41494) 2023-12-07T00:15:33.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb276d9d700 1 -- 172.21.15.179:0/751353186 learned_addr learned my addr 172.21.15.179:0/751353186 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:33.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb27659c700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb278099c00 0x7fb2781505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.886 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.868+0000 7fb275d9b700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2780cd020 0x7fb2780b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb276d9d700 1 -- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb278099c00 msgr2=0x7fb2781505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb276d9d700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb278099c00 0x7fb2781505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb276d9d700 1 -- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2780cd020 msgr2=0x7fb2780b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb276d9d700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2780cd020 0x7fb2780b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb276d9d700 1 -- 172.21.15.179:0/751353186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680094a0 con 0x7fb27815bde0 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb27659c700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb278099c00 0x7fb2781505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb275d9b700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2780cd020 0x7fb2780b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb276d9d700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb27815bde0 0x7fb27815e9f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb27000cc50 tx=0x7fb27000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.887 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb266ffd700 1 -- 172.21.15.179:0/751353186 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27000ad80 con 0x7fb27815bde0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb266ffd700 1 -- 172.21.15.179:0/751353186 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27000ce50 con 0x7fb27815bde0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb266ffd700 1 -- 172.21.15.179:0/751353186 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270003c40 con 0x7fb27815bde0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26c009550 con 0x7fb27815bde0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.869+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2780b54f0 con 0x7fb27815bde0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.870+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2780685f0 con 0x7fb27815bde0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.870+0000 7fb266ffd700 1 -- 172.21.15.179:0/751353186 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2700050d0 con 0x7fb27815bde0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.871+0000 7fb266ffd700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb25806aed0 0x7fb25806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.871+0000 7fb266ffd700 1 -- 172.21.15.179:0/751353186 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb2700898e0 con 0x7fb27815bde0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.871+0000 7fb27659c700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb25806aed0 0x7fb25806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.871+0000 7fb27659c700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb25806aed0 0x7fb25806d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb26c014040 tx=0x7fb26c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:33.888 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:33.875+0000 7fb266ffd700 1 -- 172.21.15.179:0/751353186 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2700547d0 con 0x7fb27815bde0 2023-12-07T00:15:34.108 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.109+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2780b4460 con 0x7fb27815bde0 2023-12-07T00:15:34.109 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.110+0000 7fb266ffd700 1 -- 172.21.15.179:0/751353186 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fb270057df0 con 0x7fb27815bde0 2023-12-07T00:15:34.109 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:34.109 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4898,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6835/1831294564","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6833","nonce":1831294564},{"type":"v1","addr":"172.21.15.190:6835","nonce":1831294564}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6834/3698573252","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":3698573252},{"type":"v1","addr":"172.21.15.190:6834","nonce":3698573252}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5286,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6836/1747978630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6835","nonce":1747978630},{"type":"v1","addr":"172.21.15.179:6836","nonce":1747978630}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-07T00:15:28.171797+0000","modified":"2023-12-07T00:15:31.196712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.179:6837/3161235437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":3161235437},{"type":"v1","addr":"172.21.15.179:6837","nonce":3161235437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb25806aed0 msgr2=0x7fb25806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb25806aed0 0x7fb25806d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb26c014040 tx=0x7fb26c008030 comp rx=0 tx=0).stop 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb27815bde0 msgr2=0x7fb27815e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb27815bde0 0x7fb27815e9f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb27000cc50 tx=0x7fb27000a340 comp rx=0 tx=0).stop 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 shutdown_connections 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fb25806aed0 0x7fb25806d390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb27815bde0 0x7fb27815e9f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb278099c00 0x7fb2781505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 --2- 172.21.15.179:0/751353186 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2780cd020 0x7fb2780b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 >> 172.21.15.179:0/751353186 conn(0x7fb2780b3550 msgr2=0x7fb2780b2430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:34.112 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 shutdown_connections 2023-12-07T00:15:34.113 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.112+0000 7fb27ccd0700 1 -- 172.21.15.179:0/751353186 wait complete. 2023-12-07T00:15:34.113 INFO:teuthology.orchestra.run.smithi179.stderr:dumped fsmap epoch 18 2023-12-07T00:15:34.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-07T00:15:28.171797+0000', 'modified': '2023-12-07T00:15:31.196712+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5289}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5289': {'gid': 5289, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.179:6837/3161235437', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 3161235437}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 3161235437}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-07T00:15:34.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-07T00:15:34.528 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-07T00:15:34.653 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.653+0000 7f1b3bec3700 1 Processor -- start 2023-12-07T00:15:34.653 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.654+0000 7f1b3bec3700 1 -- start start 2023-12-07T00:15:34.655 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.654+0000 7f1b3bec3700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1b3415de40 0x7f1b340b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.655 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.654+0000 7f1b3bec3700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3415f330 con 0x7f1b340b2c70 2023-12-07T00:15:34.655 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.654+0000 7f1b3bec3700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3415e720 con 0x7f1b3415e220 2023-12-07T00:15:34.655 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.654+0000 7f1b3bec3700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b340d1820 con 0x7f1b3415de40 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b3a460700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f1b340b2c70 0x7f1b3415f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48402/0 (socket says 172.21.15.179:48402) 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b3a460700 1 -- 172.21.15.179:0/1599976383 learned_addr learned my addr 172.21.15.179:0/1599976383 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/1599976383 >> v2:172.21.15.190:3300/0 conn(0x7f1b3415de40 0x7f1b340b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b38c5d700 1 -- 172.21.15.179:0/1599976383 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164635854 0 0) 0x7f1b3415f330 con 0x7f1b340b2c70 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b38c5d700 1 -- 172.21.15.179:0/1599976383 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b200035b0 con 0x7f1b340b2c70 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b38c5d700 1 -- 172.21.15.179:0/1599976383 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705115377 0 0) 0x7f1b3415e720 con 0x7f1b3415e220 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b38c5d700 1 -- 172.21.15.179:0/1599976383 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b3415f330 con 0x7f1b3415e220 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b39c5f700 1 -- 172.21.15.179:0/1599976383 >> v1:172.21.15.190:6789/0 conn(0x7f1b3415e220 legacy=0x7f1b340b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b39c5f700 1 -- 172.21.15.179:0/1599976383 >> v1:172.21.15.179:6789/0 conn(0x7f1b340b2c70 legacy=0x7f1b3415f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b39c5f700 1 -- 172.21.15.179:0/1599976383 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3415ea00 con 0x7f1b3415de40 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/1599976383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 0x7f1b340b46e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009840 tx=0x7f1b24009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdd24f7bfd7b4456 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b38c5d700 1 -- 172.21.15.179:0/1599976383 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24011830 con 0x7f1b3415de40 2023-12-07T00:15:34.656 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.655+0000 7f1b38c5d700 1 -- 172.21.15.179:0/1599976383 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24011990 con 0x7f1b3415de40 2023-12-07T00:15:34.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.656+0000 7f1b38c5d700 1 -- 172.21.15.179:0/1599976383 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24011d20 con 0x7f1b3415de40 2023-12-07T00:15:34.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.656+0000 7f1b3bec3700 1 -- 172.21.15.179:0/1599976383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 msgr2=0x7f1b340b46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.656+0000 7f1b3bec3700 1 --2- 172.21.15.179:0/1599976383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 0x7f1b340b46e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009840 tx=0x7f1b24009b50 comp rx=0 tx=0).stop 2023-12-07T00:15:34.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.656+0000 7f1b3bec3700 1 -- 172.21.15.179:0/1599976383 shutdown_connections 2023-12-07T00:15:34.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.656+0000 7f1b3bec3700 1 --2- 172.21.15.179:0/1599976383 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 0x7f1b340b46e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.656+0000 7f1b3bec3700 1 -- 172.21.15.179:0/1599976383 >> 172.21.15.179:0/1599976383 conn(0x7f1b34072970 msgr2=0x7f1b34072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:34.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.656+0000 7f1b3bec3700 1 -- 172.21.15.179:0/1599976383 shutdown_connections 2023-12-07T00:15:34.657 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.656+0000 7f1b3bec3700 1 -- 172.21.15.179:0/1599976383 wait complete. 2023-12-07T00:15:34.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.658+0000 7f1b3bec3700 1 Processor -- start 2023-12-07T00:15:34.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.658+0000 7f1b3bec3700 1 -- start start 2023-12-07T00:15:34.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3bec3700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b340b2c70 0x7f1b3414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3bec3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 0x7f1b3406be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3bec3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3415e220 0x7f1b3406c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3bec3700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3414ea00 con 0x7f1b340b2c70 2023-12-07T00:15:34.659 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3bec3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340caad0 con 0x7f1b3415de40 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3bec3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b340cadb0 con 0x7f1b3415e220 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b340b2c70 0x7f1b3414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b340b2c70 0x7f1b3414e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41502/0 (socket says 172.21.15.179:41502) 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 -- 172.21.15.179:0/3967533920 learned_addr learned my addr 172.21.15.179:0/3967533920 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3945e700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 0x7f1b3406be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3a460700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3415e220 0x7f1b3406c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 -- 172.21.15.179:0/3967533920 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3415e220 msgr2=0x7f1b3406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3415e220 0x7f1b3406c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 -- 172.21.15.179:0/3967533920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 msgr2=0x7f1b3406be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 0x7f1b3406be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.660 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 -- 172.21.15.179:0/3967533920 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240094a0 con 0x7f1b340b2c70 2023-12-07T00:15:34.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b340b2c70 0x7f1b3414e4c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009b90 tx=0x7f1b24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b2a7fc700 1 -- 172.21.15.179:0/3967533920 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2401a860 con 0x7f1b340b2c70 2023-12-07T00:15:34.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b2a7fc700 1 -- 172.21.15.179:0/3967533920 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2401a9c0 con 0x7f1b340b2c70 2023-12-07T00:15:34.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3bec3700 1 -- 172.21.15.179:0/3967533920 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b340cb090 con 0x7f1b340b2c70 2023-12-07T00:15:34.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b2a7fc700 1 -- 172.21.15.179:0/3967533920 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2401ad50 con 0x7f1b340b2c70 2023-12-07T00:15:34.661 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.659+0000 7f1b3bec3700 1 -- 172.21.15.179:0/3967533920 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b340cb650 con 0x7f1b340b2c70 2023-12-07T00:15:34.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.661+0000 7f1b2a7fc700 1 -- 172.21.15.179:0/3967533920 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b24022070 con 0x7f1b340b2c70 2023-12-07T00:15:34.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.661+0000 7f1b2a7fc700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b1806aed0 0x7f1b1806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.661+0000 7f1b2a7fc700 1 -- 172.21.15.179:0/3967533920 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1b2408a7e0 con 0x7f1b340b2c70 2023-12-07T00:15:34.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.661+0000 7f1b3945e700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b1806aed0 0x7f1b1806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.662+0000 7f1b3945e700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b1806aed0 0x7f1b1806d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b34157660 tx=0x7f1b30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.663+0000 7f1b480bcb80 1 Processor -- start 2023-12-07T00:15:34.662 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.663+0000 7f1b480bcb80 1 -- start start 2023-12-07T00:15:34.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af96f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af96fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af952e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641af89c770 con 0x5641af929080 2023-12-07T00:15:34.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641af883750 con 0x5641af926490 2023-12-07T00:15:34.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641af881070 con 0x5641af93eed0 2023-12-07T00:15:34.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b39c5f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af96f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.665 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b39c5f700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af96f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41510/0 (socket says 172.21.15.179:41510) 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.664+0000 7f1b39c5f700 1 -- 172.21.15.179:0/1666213672 learned_addr learned my addr 172.21.15.179:0/1666213672 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b3a460700 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af952e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b39c5f700 1 -- 172.21.15.179:0/1666213672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 msgr2=0x5641af96fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b3945e700 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af96fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af96fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b39c5f700 1 -- 172.21.15.179:0/1666213672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 msgr2=0x5641af952e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af952e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b39c5f700 1 -- 172.21.15.179:0/1666213672 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641af6f95e0 con 0x5641af929080 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af96f840 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1b24055950 tx=0x7f1b24059060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffb9dcaa07af08d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b177fe700 1 -- 172.21.15.179:0/1666213672 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240594a0 con 0x5641af929080 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b177fe700 1 -- 172.21.15.179:0/1666213672 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2405d5f0 con 0x5641af929080 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b177fe700 1 -- 172.21.15.179:0/1666213672 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240617a0 con 0x5641af929080 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b480bcb80 1 -- 172.21.15.179:0/1666213672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 msgr2=0x5641af96f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.665+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af96f840 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1b24055950 tx=0x7f1b24059060 comp rx=0 tx=0).stop 2023-12-07T00:15:34.666 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 -- 172.21.15.179:0/1666213672 shutdown_connections 2023-12-07T00:15:34.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af952e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af96f840 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/1666213672 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af96fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 -- 172.21.15.179:0/1666213672 >> 172.21.15.179:0/1666213672 conn(0x5641af857310 msgr2=0x5641af96de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:34.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 -- 172.21.15.179:0/1666213672 shutdown_connections 2023-12-07T00:15:34.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 -- 172.21.15.179:0/1666213672 wait complete. 2023-12-07T00:15:34.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 -- start start 2023-12-07T00:15:34.667 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.666+0000 7f1b480bcb80 1 Processor -- start 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af926490 0x5641af97cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af967360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af93eed0 0x5641af96c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641af87c960 con 0x5641af929080 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641af836510 con 0x5641af93eed0 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641af8361b0 con 0x5641af926490 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b480bcb80 10 client.0 _ll_register_callbacks cb 0x5641af761a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b3945e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af967360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b3945e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af967360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41518/0 (socket says 172.21.15.179:41518) 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b3945e700 1 -- 172.21.15.179:0/3245030190 learned_addr learned my addr 172.21.15.179:0/3245030190 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af926490 0x5641af97cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.667+0000 7f1b3a460700 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af93eed0 0x5641af96c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b3945e700 1 -- 172.21.15.179:0/3245030190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af926490 msgr2=0x5641af97cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b3945e700 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af926490 0x5641af97cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b3945e700 1 -- 172.21.15.179:0/3245030190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af93eed0 msgr2=0x5641af96c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b3945e700 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af93eed0 0x5641af96c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b3945e700 1 -- 172.21.15.179:0/3245030190 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b340cb650 con 0x5641af929080 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b3945e700 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af967360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1b3415e650 tx=0x7f1b30000f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf5b8273c45eee0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b14ff9700 1 -- 172.21.15.179:0/3245030190 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b300154c0 con 0x5641af929080 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b14ff9700 1 -- 172.21.15.179:0/3245030190 <== mon.0 v2:172.21.15.179:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1b30021bc0 con 0x5641af929080 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 1 -- 172.21.15.179:0/3245030190 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641af91ba40 con 0x5641af929080 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b14ff9700 1 -- 172.21.15.179:0/3245030190 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b30021d80 con 0x5641af929080 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 10 client.5454 fetch_fsmap learned FSMap version 18 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 1 -- 172.21.15.179:0/3245030190 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5641af6a5d90 con 0x5641af929080 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b14ff9700 1 -- 172.21.15.179:0/3245030190 <== mon.0 v2:172.21.15.179:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5641af91ba40 con 0x5641af929080 2023-12-07T00:15:34.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b14ff9700 1 -- 172.21.15.179:0/3245030190 <== mon.0 v2:172.21.15.179:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1b30021420 con 0x5641af929080 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 10 client.5454 fetch_fsmap finished waiting for FSMap version 18 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 10 client.5454 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 20 client.5454 populate_metadata read hostname 'smithi179' 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] conn(0x5641af952ed0 0x5641af956330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 4 client.5454 mds_command: new command op to 5289 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b480bcb80 1 -- 172.21.15.179:0/3245030190 --> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641af8f7840 con 0x5641af952ed0 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.668+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] conn(0x5641af952ed0 0x5641af956330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.669+0000 7f1b14ff9700 10 client.5454 ms_handle_connect on v2:172.21.15.179:6834/3161235437 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.669+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] conn(0x5641af952ed0 0x5641af956330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40392e4d533a11bb server_cookie=23269745e890f1f1 in_seq=0 out_seq=0 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.669+0000 7f1b14ff9700 1 -- 172.21.15.179:0/3245030190 <== mds.0 v2:172.21.15.179:6834/3161235437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5641af8f7840 con 0x5641af952ed0 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.669+0000 7f1b14ff9700 10 client.5454 handle_command_reply: tid=0 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.669+0000 7f1b480bcb80 1 client.5454 shutdown 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.669+0000 7f1b480bcb80 1 -- 172.21.15.179:0/3245030190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 msgr2=0x5641af967360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.669+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af967360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1b3415e650 tx=0x7f1b30000f20 comp rx=0 tx=0).stop 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 1 -- 172.21.15.179:0/3245030190 shutdown_connections 2023-12-07T00:15:34.673 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] conn(0x5641af952ed0 0x5641af956330 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af93eed0 0x5641af96c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af926490 0x5641af97cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b14ff9700 0 client.5454 ms_handle_reset on v2:172.21.15.179:6834/3161235437 2023-12-07T00:15:34.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/3245030190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af967360 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 1 -- 172.21.15.179:0/3245030190 >> 172.21.15.179:0/3245030190 conn(0x5641af857310 msgr2=0x5641af971c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:34.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 1 -- 172.21.15.179:0/3245030190 shutdown_connections 2023-12-07T00:15:34.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 1 -- 172.21.15.179:0/3245030190 wait complete. 2023-12-07T00:15:34.674 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.670+0000 7f1b480bcb80 20 client.5454 trim_cache size 0 max 16384 2023-12-07T00:15:34.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.688+0000 7f1b480bcb80 1 Processor -- start 2023-12-07T00:15:34.687 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.688+0000 7f1b480bcb80 1 -- start start 2023-12-07T00:15:34.689 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af9234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af929080 0x5641af9706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af93eed0 0x5641af970be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641af6fb8d0 con 0x5641af93eed0 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641af952530 con 0x5641af926490 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641af964c80 con 0x5641af929080 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af93eed0 0x5641af970be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af93eed0 0x5641af970be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41528/0 (socket says 172.21.15.179:41528) 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 -- 172.21.15.179:0/387182772 learned_addr learned my addr 172.21.15.179:0/387182772 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af9234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 -- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af929080 msgr2=0x5641af9706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3945e700 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af929080 0x5641af9706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af929080 0x5641af9706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 -- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 msgr2=0x5641af9234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.690 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af9234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 -- 172.21.15.179:0/387182772 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641af68ec10 con 0x5641af93eed0 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af9234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b3a460700 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af93eed0 0x5641af970be0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c001f00 tx=0x7f1b2c0122c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea9109a2092f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b17fff700 1 -- 172.21.15.179:0/387182772 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c012c00 con 0x5641af93eed0 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b17fff700 1 -- 172.21.15.179:0/387182772 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c00d070 con 0x5641af93eed0 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.689+0000 7f1b17fff700 1 -- 172.21.15.179:0/387182772 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c015440 con 0x5641af93eed0 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 -- 172.21.15.179:0/387182772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af93eed0 msgr2=0x5641af970be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af93eed0 0x5641af970be0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c001f00 tx=0x7f1b2c0122c0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 -- 172.21.15.179:0/387182772 shutdown_connections 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af93eed0 0x5641af970be0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af9234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/387182772 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af929080 0x5641af9706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 -- 172.21.15.179:0/387182772 >> 172.21.15.179:0/387182772 conn(0x5641af857310 msgr2=0x5641af968c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 -- 172.21.15.179:0/387182772 shutdown_connections 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.690+0000 7f1b480bcb80 1 -- 172.21.15.179:0/387182772 wait complete. 2023-12-07T00:15:34.691 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.691+0000 7f1b480bcb80 1 -- start start 2023-12-07T00:15:34.692 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.691+0000 7f1b480bcb80 1 Processor -- start 2023-12-07T00:15:34.695 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af963800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.695 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af9689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.695 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af968f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641af96b180 con 0x5641af929080 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641af924ea0 con 0x5641af926490 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641af925180 con 0x5641af93eed0 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 10 client.0 _ll_register_callbacks cb 0x5641af761a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af9689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af9689f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41532/0 (socket says 172.21.15.179:41532) 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 -- 172.21.15.179:0/826734381 learned_addr learned my addr 172.21.15.179:0/826734381 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af963800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3a460700 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af968f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 -- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 msgr2=0x5641af968f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af968f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 -- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 msgr2=0x5641af963800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af963800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 -- 172.21.15.179:0/826734381 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200035b0 con 0x5641af929080 2023-12-07T00:15:34.696 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3a460700 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af968f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b3945e700 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af9689f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1b30003fd0 tx=0x7f1b30005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a527d27e9e3c4aaa server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b14ff9700 10 client.0 ms_handle_connect on v2:172.21.15.179:3300/0 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b14ff9700 1 -- 172.21.15.179:0/826734381 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b300036d0 con 0x5641af929080 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b14ff9700 1 -- 172.21.15.179:0/826734381 <== mon.0 v2:172.21.15.179:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1b30021420 con 0x5641af929080 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 1 -- 172.21.15.179:0/826734381 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b2405d5f0 con 0x5641af929080 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b14ff9700 1 -- 172.21.15.179:0/826734381 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b30022430 con 0x5641af929080 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 10 client.5460 fetch_fsmap learned FSMap version 18 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.692+0000 7f1b480bcb80 1 -- 172.21.15.179:0/826734381 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5641af6cc200 con 0x5641af929080 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b14ff9700 1 -- 172.21.15.179:0/826734381 <== mon.0 v2:172.21.15.179:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2405d5f0 con 0x5641af929080 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b14ff9700 1 -- 172.21.15.179:0/826734381 <== mon.0 v2:172.21.15.179:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1b30022590 con 0x5641af929080 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 10 client.5460 fetch_fsmap finished waiting for FSMap version 18 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 10 client.5460 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 20 client.5460 populate_metadata read hostname 'smithi179' 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] conn(0x5641af9672e0 0x5641af9713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 4 client.5460 mds_command: new command op to 5289 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-07T00:15:34.697 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 -- 172.21.15.179:0/826734381 --> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5641af842f80 con 0x5641af9672e0 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] conn(0x5641af9672e0 0x5641af9713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b14ff9700 10 client.5460 ms_handle_connect on v2:172.21.15.179:6834/3161235437 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b39c5f700 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] conn(0x5641af9672e0 0x5641af9713f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dda10fc8fba5deed server_cookie=70f4ded1f4cf9ad0 in_seq=0 out_seq=0 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b14ff9700 1 -- 172.21.15.179:0/826734381 <== mds.0 v2:172.21.15.179:6834/3161235437 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5641af842f80 con 0x5641af9672e0 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b14ff9700 10 client.5460 handle_command_reply: tid=0 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 client.5460 shutdown 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 -- 172.21.15.179:0/826734381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 msgr2=0x5641af9689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af9689f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1b30003fd0 tx=0x7f1b30005000 comp rx=0 tx=0).stop 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 -- 172.21.15.179:0/826734381 shutdown_connections 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5641af93eed0 0x5641af968f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.179:6834/3161235437,v1:172.21.15.179:6837/3161235437] conn(0x5641af9672e0 0x5641af9713f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5641af926490 0x5641af963800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b14ff9700 0 client.5460 ms_handle_reset on v2:172.21.15.179:6834/3161235437 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 --2- 172.21.15.179:0/826734381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5641af929080 0x5641af9689f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.698 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.693+0000 7f1b480bcb80 1 -- 172.21.15.179:0/826734381 >> 172.21.15.179:0/826734381 conn(0x5641af857310 msgr2=0x5641af9706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b480bcb80 1 -- 172.21.15.179:0/826734381 shutdown_connections 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b480bcb80 1 -- 172.21.15.179:0/826734381 wait complete. 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b480bcb80 20 client.5460 trim_cache size 0 max 16384 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout:{ 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout: "cluster_fsid": "4803447b-a0af-4501-a3c6-e46974a67250", 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout: "whoami": 0, 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout: "id": 5289, 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout: "want_state": "up:active", 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout: "state": "up:active", 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout: "fs_name": "cephfs", 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout: "rank_uptime": 5.9189966429999998, 2023-12-07T00:15:34.699 INFO:teuthology.orchestra.run.smithi179.stdout: "mdsmap_epoch": 18, 2023-12-07T00:15:34.700 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_epoch": 41, 2023-12-07T00:15:34.700 INFO:teuthology.orchestra.run.smithi179.stdout: "osdmap_epoch_barrier": 41, 2023-12-07T00:15:34.700 INFO:teuthology.orchestra.run.smithi179.stdout: "uptime": 13.797859849 2023-12-07T00:15:34.700 INFO:teuthology.orchestra.run.smithi179.stdout:} 2023-12-07T00:15:34.700 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 -- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b1806aed0 msgr2=0x7f1b1806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b1806aed0 0x7f1b1806d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b34157660 tx=0x7f1b30009040 comp rx=0 tx=0).stop 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 -- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b340b2c70 msgr2=0x7f1b3414e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b340b2c70 0x7f1b3414e4c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009b90 tx=0x7f1b24004750 comp rx=0 tx=0).stop 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 -- 172.21.15.179:0/3967533920 shutdown_connections 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f1b1806aed0 0x7f1b1806d390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1b3415e220 0x7f1b3406c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1b340b2c70 0x7f1b3414e4c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 --2- 172.21.15.179:0/3967533920 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1b3415de40 0x7f1b3406be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 -- 172.21.15.179:0/3967533920 >> 172.21.15.179:0/3967533920 conn(0x7f1b34072970 msgr2=0x7f1b340ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 -- 172.21.15.179:0/3967533920 shutdown_connections 2023-12-07T00:15:34.701 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.694+0000 7f1b3bec3700 1 -- 172.21.15.179:0/3967533920 wait complete. 2023-12-07T00:15:34.706 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-07T00:15:34.827 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.828+0000 7f4e05f34700 1 Processor -- start 2023-12-07T00:15:34.827 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.828+0000 7f4e05f34700 1 -- start start 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4e05f34700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4e0015de40 0x7f4e000b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4e05f34700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e0015e220 0x7f4e000b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4e05f34700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0015f330 con 0x7f4e000b4c20 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4e05f34700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e000d1820 con 0x7f4e0015e220 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4e05f34700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0015e720 con 0x7f4e0015de40 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfeffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e0015e220 0x7f4e000b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfeffd700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4e0015e220 0x7f4e000b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41538/0 (socket says 172.21.15.179:41538) 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfeffd700 1 -- 172.21.15.179:0/285912562 learned_addr learned my addr 172.21.15.179:0/285912562 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dff7fe700 1 --2- 172.21.15.179:0/285912562 >> v2:172.21.15.190:3300/0 conn(0x7f4e0015de40 0x7f4e000b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfeffd700 1 -- 172.21.15.179:0/285912562 >> v2:172.21.15.190:3300/0 conn(0x7f4e0015de40 msgr2=0x7f4e000b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.830 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfeffd700 1 --2- 172.21.15.179:0/285912562 >> v2:172.21.15.190:3300/0 conn(0x7f4e0015de40 0x7f4e000b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfeffd700 1 -- 172.21.15.179:0/285912562 >> v1:172.21.15.190:6789/0 conn(0x7f4e000b4c20 legacy=0x7f4e0006af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfeffd700 1 -- 172.21.15.179:0/285912562 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0015ea00 con 0x7f4e0015e220 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfeffd700 1 --2- 172.21.15.179:0/285912562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000b2560 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e0006bfd0 tx=0x7f4df0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab1c0c72d082d34 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.829+0000 7f4dfe7fc700 1 -- 172.21.15.179:0/285912562 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0005e30 con 0x7f4e0015e220 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4dfe7fc700 1 -- 172.21.15.179:0/285912562 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0006030 con 0x7f4e0015e220 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4dfe7fc700 1 -- 172.21.15.179:0/285912562 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df00063e0 con 0x7f4e0015e220 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4e05f34700 1 -- 172.21.15.179:0/285912562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 msgr2=0x7f4e000b2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4e05f34700 1 --2- 172.21.15.179:0/285912562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000b2560 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e0006bfd0 tx=0x7f4df0009bd0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4e05f34700 1 -- 172.21.15.179:0/285912562 shutdown_connections 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4e05f34700 1 --2- 172.21.15.179:0/285912562 >> v2:172.21.15.190:3300/0 conn(0x7f4e0015de40 0x7f4e000b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4e05f34700 1 --2- 172.21.15.179:0/285912562 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000b2560 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4e05f34700 1 -- 172.21.15.179:0/285912562 >> 172.21.15.179:0/285912562 conn(0x7f4e00072970 msgr2=0x7f4e00072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:34.831 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4e05f34700 1 -- 172.21.15.179:0/285912562 shutdown_connections 2023-12-07T00:15:34.832 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.830+0000 7f4e05f34700 1 -- 172.21.15.179:0/285912562 wait complete. 2023-12-07T00:15:34.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.831+0000 7f4e05f34700 1 Processor -- start 2023-12-07T00:15:34.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.831+0000 7f4e05f34700 1 -- start start 2023-12-07T00:15:34.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4e05f34700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e000b4c20 0x7f4e001513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.834 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4e05f34700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e0015de40 0x7f4e000d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4e05f34700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000a9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4e05f34700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e00151930 con 0x7f4e0015e220 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4e05f34700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000d0860 con 0x7f4e000b4c20 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4e05f34700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e000d1090 con 0x7f4e0015de40 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4dfffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000a9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4dfffff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000a9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41548/0 (socket says 172.21.15.179:41548) 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.832+0000 7f4dfffff700 1 -- 172.21.15.179:0/1010397893 learned_addr learned my addr 172.21.15.179:0/1010397893 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4dfeffd700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e0015de40 0x7f4e000d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4dfffff700 1 -- 172.21.15.179:0/1010397893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e0015de40 msgr2=0x7f4e000d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4dfffff700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e0015de40 0x7f4e000d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4dfffff700 1 -- 172.21.15.179:0/1010397893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e000b4c20 msgr2=0x7f4e001513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4dff7fe700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e000b4c20 0x7f4e001513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4dfffff700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e000b4c20 0x7f4e001513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:34.835 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4dfffff700 1 -- 172.21.15.179:0/1010397893 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df0009500 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4dfffff700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000a9cc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4df800b990 tx=0x7f4df800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4de7fff700 1 -- 172.21.15.179:0/1010397893 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800c9d0 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4de7fff700 1 -- 172.21.15.179:0/1010397893 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800cb30 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4de7fff700 1 -- 172.21.15.179:0/1010397893 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8014440 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e000a9050 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.833+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0015a8c0 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.834+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0004f290 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.834+0000 7f4de7fff700 1 -- 172.21.15.179:0/1010397893 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4df8006d50 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.835+0000 7f4de7fff700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4dec06aed0 0x7f4dec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.835+0000 7f4de7fff700 1 -- 172.21.15.179:0/1010397893 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4df8089240 con 0x7f4e0015e220 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.835+0000 7f4dff7fe700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4dec06aed0 0x7f4dec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:15:34.836 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.835+0000 7f4dff7fe700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4dec06aed0 0x7f4dec06d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4df4008850 tx=0x7f4df4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:15:34.838 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:34.839+0000 7f4de7fff700 1 -- 172.21.15.179:0/1010397893 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4df80541b0 con 0x7f4e0015e220 2023-12-07T00:15:35.071 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.072+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e000a8e90 con 0x7f4e0015e220 2023-12-07T00:15:35.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.073+0000 7f4de7fff700 1 -- 172.21.15.179:0/1010397893 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4df80577d0 con 0x7f4e0015e220 2023-12-07T00:15:35.072 INFO:teuthology.orchestra.run.smithi179.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.074+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4dec06aed0 msgr2=0x7f4dec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.074+0000 7f4e05f34700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4dec06aed0 0x7f4dec06d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4df4008850 tx=0x7f4df4008040 comp rx=0 tx=0).stop 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.074+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 msgr2=0x7f4e000a9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.074+0000 7f4e05f34700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000a9cc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4df800b990 tx=0x7f4df800bd50 comp rx=0 tx=0).stop 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.075+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 shutdown_connections 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.075+0000 7f4e05f34700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f4dec06aed0 0x7f4dec06d390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.075+0000 7f4e05f34700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4e0015e220 0x7f4e000a9cc0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.075+0000 7f4e05f34700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4e000b4c20 0x7f4e001513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:35.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.075+0000 7f4e05f34700 1 --2- 172.21.15.179:0/1010397893 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4e0015de40 0x7f4e000d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:15:35.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.075+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 >> 172.21.15.179:0/1010397893 conn(0x7f4e00072970 msgr2=0x7f4e000b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:15:35.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.075+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 shutdown_connections 2023-12-07T00:15:35.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:15:35.075+0000 7f4e05f34700 1 -- 172.21.15.179:0/1010397893 wait complete. 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi179.front.sepia.ceph.com 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-07T00:15:35.086 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T00:15:35.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.087 DEBUG:teuthology.orchestra.run.smithi179:> ip addr 2023-12-07T00:15:35.104 INFO:teuthology.orchestra.run.smithi179.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-07T00:15:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-07T00:15:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: inet 127.0.0.1/8 scope host lo 2023-12-07T00:15:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:15:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 ::1/128 scope host 2023-12-07T00:15:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:15:35.105 INFO:teuthology.orchestra.run.smithi179.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:15:35.105 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:34 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:15:35.106 INFO:teuthology.orchestra.run.smithi179.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:15:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:d9:3b:35 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:15:35.106 INFO:teuthology.orchestra.run.smithi179.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-07T00:15:35.106 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5a brd ff:ff:ff:ff:ff:ff 2023-12-07T00:15:35.106 INFO:teuthology.orchestra.run.smithi179.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-07T00:15:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 0c:c4:7a:88:72:5b brd ff:ff:ff:ff:ff:ff 2023-12-07T00:15:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: inet 172.21.15.179/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-07T00:15:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft 42273sec preferred_lft 42273sec 2023-12-07T00:15:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::3535:d433:7794:9e23/64 scope link noprefixroute 2023-12-07T00:15:35.107 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:15:35.107 INFO:teuthology.orchestra.run.smithi179.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-07T00:15:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 32:02:2e:e0:66:62 brd ff:ff:ff:ff:ff:ff 2023-12-07T00:15:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-07T00:15:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:15:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::b831:a8ff:fe91:569/64 scope link 2023-12-07T00:15:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:15:35.108 INFO:teuthology.orchestra.run.smithi179.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T00:15:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether f6:e4:1a:8f:23:1f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-07T00:15:35.108 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::f4e4:1aff:fe8f:231f/64 scope link 2023-12-07T00:15:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:15:35.109 INFO:teuthology.orchestra.run.smithi179.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-07T00:15:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: link/ether 32:02:2e:e0:66:62 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-07T00:15:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: inet6 fe80::3002:2eff:fee0:6662/64 scope link 2023-12-07T00:15:35.109 INFO:teuthology.orchestra.run.smithi179.stdout: valid_lft forever preferred_lft forever 2023-12-07T00:15:35.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.110 DEBUG:teuthology.orchestra.run.smithi179:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-07T00:15:35.170 INFO:teuthology.orchestra.run.smithi179.stdout:1 2023-12-07T00:15:35.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.172 DEBUG:teuthology.orchestra.run.smithi179:> route 2023-12-07T00:15:35.231 INFO:teuthology.orchestra.run.smithi179.stdout:Kernel IP routing table 2023-12-07T00:15:35.231 INFO:teuthology.orchestra.run.smithi179.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-07T00:15:35.231 INFO:teuthology.orchestra.run.smithi179.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-07T00:15:35.231 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-07T00:15:35.231 INFO:teuthology.orchestra.run.smithi179.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-07T00:15:35.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.231 DEBUG:teuthology.orchestra.run.smithi179:> (cd / && exec bash -c ' 2023-12-07T00:15:35.232 DEBUG:teuthology.orchestra.run.smithi179:> set -e 2023-12-07T00:15:35.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-07T00:15:35.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-07T00:15:35.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-07T00:15:35.232 DEBUG:teuthology.orchestra.run.smithi179:> ') 2023-12-07T00:15:35.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.335 DEBUG:teuthology.orchestra.run.smithi179:> ip netns list 2023-12-07T00:15:35.352 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-07T00:15:35.353 INFO:teuthology.orchestra.run.smithi179.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-07T00:15:35.353 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-07T00:15:35.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.353 DEBUG:teuthology.orchestra.run.smithi179:> sudo ip link set brx.0 up 2023-12-07T00:15:35.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:15:35.421 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-07T00:15:35.478 INFO:teuthology.orchestra.run.smithi179.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-07T00:15:35.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-07T00:15:35.479 DEBUG:teuthology.orchestra.run.smithi179:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-07T00:15:35.536 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-07T00:15:35.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.536 DEBUG:teuthology.orchestra.run.smithi179:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:15:35.621 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:15:35.622 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:15:35.648 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:15:35.648 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:15:35.648 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:15:35.649 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 0@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:15:35.649 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:15:35.649 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:15:35.649 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:15:35.649 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:15:35.726 INFO:teuthology.orchestra.run.smithi179.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-07T00:15:35.726 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-07T00:15:35.726 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:3300,172.21.15.190:3300,172.21.15.190:3301" 2023-12-07T00:15:35.727 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with new device syntax: 0@4803447b-a0af-4501-a3c6-e46974a67250.cephfs=/ 2023-12-07T00:15:35.727 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.179:3300/172.21.15.190:3300/172.21.15.190:3301" will pass to kernel 2023-12-07T00:15:35.727 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: v2 mount support check returned 2 2023-12-07T00:15:35.727 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: kernel does not support v2 syntax 2023-12-07T00:15:35.727 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-07T00:15:35.727 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: resolved to: "172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790" 2023-12-07T00:15:35.727 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.179:6789,172.21.15.190:6789,172.21.15.190:6790:/ 2023-12-07T00:15:35.727 INFO:teuthology.orchestra.run.smithi179.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=4803447b-a0af-4501-a3c6-e46974a67250" will pass to kernel 2023-12-07T00:15:35.729 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-07T00:15:35.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-07T00:15:35.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.756 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-07T00:15:35.839 INFO:teuthology.orchestra.run.smithi179.stdout:client5236 2023-12-07T00:15:35.839 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:15:35.839 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T00:15:35.898 DEBUG:teuthology.orchestra.run.smithi179:> mktemp -d --suffix=xfstests-dev 2023-12-07T00:15:35.954 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.poL8GbUio4xfstests-dev 2023-12-07T00:15:35.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:35.955 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.poL8GbUio4xfstests-dev) 2023-12-07T00:15:36.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:36.025 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.poL8GbUio4xfstests-dev) 2023-12-07T00:15:36.082 INFO:teuthology.orchestra.run.smithi179.stderr:Cloning into '/tmp/tmp.poL8GbUio4xfstests-dev'... 2023-12-07T00:15:36.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:36.837 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-07T00:15:36.898 DEBUG:teuthology.orchestra.run.smithi179:> mktemp -d --suffix=test 2023-12-07T00:15:36.955 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.YGf8tKAzkhtest 2023-12-07T00:15:36.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:15:36.956 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-07T00:15:37.013 DEBUG:teuthology.orchestra.run.smithi179:> mktemp -d --suffix=scratch 2023-12-07T00:15:37.070 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:15:37.070 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-12-07T00:15:37.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-12-07T00:15:37.467 INFO:teuthology.orchestra.run.smithi179.stdout:Updating Subscription Management repositories. 2023-12-07T00:15:38.115 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 155 kB/s | 4.5 kB 00:00 2023-12-07T00:15:38.430 INFO:teuthology.orchestra.run.smithi179.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 116 kB/s | 4.1 kB 00:00 2023-12-07T00:15:39.878 INFO:teuthology.orchestra.run.smithi179.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-12-07T00:15:39.879 INFO:teuthology.orchestra.run.smithi179.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-12-07T00:15:39.880 INFO:teuthology.orchestra.run.smithi179.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-12-07T00:15:39.881 INFO:teuthology.orchestra.run.smithi179.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-12-07T00:15:39.882 INFO:teuthology.orchestra.run.smithi179.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-12-07T00:15:39.885 INFO:teuthology.orchestra.run.smithi179.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-12-07T00:15:39.887 INFO:teuthology.orchestra.run.smithi179.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-12-07T00:15:39.888 INFO:teuthology.orchestra.run.smithi179.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-12-07T00:15:39.890 INFO:teuthology.orchestra.run.smithi179.stdout:Package git-2.31.1-2.el8.x86_64 is already installed. 2023-12-07T00:15:39.893 INFO:teuthology.orchestra.run.smithi179.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-07T00:15:39.894 INFO:teuthology.orchestra.run.smithi179.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-12-07T00:15:39.897 INFO:teuthology.orchestra.run.smithi179.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-12-07T00:15:39.898 INFO:teuthology.orchestra.run.smithi179.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-12-07T00:15:39.899 INFO:teuthology.orchestra.run.smithi179.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-12-07T00:15:39.900 INFO:teuthology.orchestra.run.smithi179.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-12-07T00:15:39.901 INFO:teuthology.orchestra.run.smithi179.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-12-07T00:15:39.905 INFO:teuthology.orchestra.run.smithi179.stdout:Package python36-3.6.8-38.module+el8.5.0+12207+5c5719bc.x86_64 is already installed. 2023-12-07T00:15:39.906 INFO:teuthology.orchestra.run.smithi179.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-12-07T00:15:39.908 INFO:teuthology.orchestra.run.smithi179.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-12-07T00:15:39.909 INFO:teuthology.orchestra.run.smithi179.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-12-07T00:15:39.911 INFO:teuthology.orchestra.run.smithi179.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-07T00:15:40.025 INFO:teuthology.orchestra.run.smithi179.stdout:Dependencies resolved. 2023-12-07T00:15:40.026 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2023-12-07T00:15:40.026 INFO:teuthology.orchestra.run.smithi179.stdout: Package Arch Version Repository Size 2023-12-07T00:15:40.026 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2023-12-07T00:15:40.027 INFO:teuthology.orchestra.run.smithi179.stdout:Installing: 2023-12-07T00:15:40.027 INFO:teuthology.orchestra.run.smithi179.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-12-07T00:15:40.027 INFO:teuthology.orchestra.run.smithi179.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-07T00:15:40.028 INFO:teuthology.orchestra.run.smithi179.stdout: gdbm-devel x86_64 1:1.18-1.el8 rhel-8-for-x86_64-baseos-rpms 66 k 2023-12-07T00:15:40.028 INFO:teuthology.orchestra.run.smithi179.stdout: indent x86_64 2.2.13-4.el8 epel 187 k 2023-12-07T00:15:40.028 INFO:teuthology.orchestra.run.smithi179.stdout: kernel-devel x86_64 4.18.0-372.32.1.el8_6 2023-12-07T00:15:40.028 INFO:teuthology.orchestra.run.smithi179.stdout: rhel-8-for-x86_64-baseos-rpms 21 M 2023-12-07T00:15:40.029 INFO:teuthology.orchestra.run.smithi179.stdout: libcap-devel x86_64 2.48-2.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-12-07T00:15:40.029 INFO:teuthology.orchestra.run.smithi179.stdout: udftools x86_64 2.3-2.el8 rhel-8-for-x86_64-appstream-rpms 160 k 2023-12-07T00:15:40.029 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrading: 2023-12-07T00:15:40.029 INFO:teuthology.orchestra.run.smithi179.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-12-07T00:15:40.029 INFO:teuthology.orchestra.run.smithi179.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-12-07T00:15:40.030 INFO:teuthology.orchestra.run.smithi179.stdout:Installing dependencies: 2023-12-07T00:15:40.030 INFO:teuthology.orchestra.run.smithi179.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-12-07T00:15:40.030 INFO:teuthology.orchestra.run.smithi179.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-12-07T00:15:40.030 INFO:teuthology.orchestra.run.smithi179.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-12-07T00:15:40.030 INFO:teuthology.orchestra.run.smithi179.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-12-07T00:15:40.031 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:40.031 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction Summary 2023-12-07T00:15:40.031 INFO:teuthology.orchestra.run.smithi179.stdout:================================================================================ 2023-12-07T00:15:40.031 INFO:teuthology.orchestra.run.smithi179.stdout:Install 11 Packages 2023-12-07T00:15:40.031 INFO:teuthology.orchestra.run.smithi179.stdout:Upgrade 2 Packages 2023-12-07T00:15:40.031 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:15:40.032 INFO:teuthology.orchestra.run.smithi179.stdout:Total download size: 24 M 2023-12-07T00:15:40.033 INFO:teuthology.orchestra.run.smithi179.stdout:Downloading Packages: 2023-12-07T00:15:40.211 INFO:teuthology.orchestra.run.smithi179.stdout:(1/13): fio-3.19-3.el8.x86_64.rpm 5.6 MB/s | 538 kB 00:00 2023-12-07T00:15:40.237 INFO:teuthology.orchestra.run.smithi179.stdout:(2/13): udftools-2.3-2.el8.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2023-12-07T00:15:40.262 INFO:teuthology.orchestra.run.smithi179.stdout:(3/13): indent-2.2.13-4.el8.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2023-12-07T00:15:40.287 INFO:teuthology.orchestra.run.smithi179.stdout:(4/13): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.2 MB/s | 92 kB 00:00 2023-12-07T00:15:40.321 INFO:teuthology.orchestra.run.smithi179.stdout:(5/13): gdbm-devel-1.18-1.el8.x86_64.rpm 784 kB/s | 66 kB 00:00 2023-12-07T00:15:40.346 INFO:teuthology.orchestra.run.smithi179.stdout:(6/13): rmt-1.5.3-13.el8.x86_64.rpm 969 kB/s | 51 kB 00:00 2023-12-07T00:15:40.371 INFO:teuthology.orchestra.run.smithi179.stdout:(7/13): dump-0.4-0.36.b46.el8.x86_64.rpm 1.5 MB/s | 164 kB 00:00 2023-12-07T00:15:40.388 INFO:teuthology.orchestra.run.smithi179.stdout:(8/13): daxctl-libs-71.1-3.el8.x86_64.rpm 619 kB/s | 42 kB 00:00 2023-12-07T00:15:40.405 INFO:teuthology.orchestra.run.smithi179.stdout:(9/13): libcap-devel-2.48-2.el8.x86_64.rpm 707 kB/s | 42 kB 00:00 2023-12-07T00:15:40.431 INFO:teuthology.orchestra.run.smithi179.stdout:(10/13): ndctl-libs-71.1-3.el8.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-12-07T00:15:40.473 INFO:teuthology.orchestra.run.smithi179.stdout:(11/13): sqlite-3.26.0-16.el8_6.x86_64.rpm 9.7 MB/s | 668 kB 00:00 2023-12-07T00:15:40.506 INFO:teuthology.orchestra.run.smithi179.stdout:(12/13): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2023-12-07T00:15:40.815 INFO:teuthology.orchestra.run.smithi179.stdout:(13/13): kernel-devel-4.18.0-372.32.1.el8_6.x86 50 MB/s | 21 MB 00:00 2023-12-07T00:15:40.815 INFO:teuthology.orchestra.run.smithi179.stdout:-------------------------------------------------------------------------------- 2023-12-07T00:15:40.816 INFO:teuthology.orchestra.run.smithi179.stdout:Total 30 MB/s | 24 MB 00:00 2023-12-07T00:15:41.104 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction check 2023-12-07T00:15:41.169 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction check succeeded. 2023-12-07T00:15:41.169 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction test 2023-12-07T00:15:41.583 INFO:teuthology.orchestra.run.smithi179.stdout:Transaction test succeeded. 2023-12-07T00:15:41.587 INFO:teuthology.orchestra.run.smithi179.stdout:Running transaction 2023-12-07T00:15:42.369 INFO:teuthology.orchestra.run.smithi179.stdout: Preparing : 1/1 2023-12-07T00:15:42.487 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 1/15 2023-12-07T00:15:42.559 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 1/15 2023-12-07T00:15:42.604 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:15:42.606 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:15:42.803 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 2/15 2023-12-07T00:15:42.879 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 2/15 2023-12-07T00:15:43.037 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 3/15 2023-12-07T00:15:43.189 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 3/15 2023-12-07T00:15:43.342 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 4/15 2023-12-07T00:15:43.513 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/15 2023-12-07T00:15:43.760 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 6/15 2023-12-07T00:15:44.020 INFO:teuthology.orchestra.run.smithi179.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 7/15 2023-12-07T00:15:52.164 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : fio-3.19-3.el8.x86_64 8/15 2023-12-07T00:15:52.669 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : kernel-devel-4.18.0-372.32.1.el8_6.x86_64 9/15 2023-12-07T00:16:01.244 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: kernel-devel-4.18.0-372.32.1.el8_6.x86_64 9/15 2023-12-07T00:16:01.407 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : libcap-devel-2.48-2.el8.x86_64 10/15 2023-12-07T00:16:01.517 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : gdbm-devel-1:1.18-1.el8.x86_64 11/15 2023-12-07T00:16:01.548 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: gdbm-devel-1:1.18-1.el8.x86_64 11/15 2023-12-07T00:16:01.898 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : udftools-2.3-2.el8.x86_64 12/15 2023-12-07T00:16:02.077 INFO:teuthology.orchestra.run.smithi179.stdout: Installing : indent-2.2.13-4.el8.x86_64 13/15 2023-12-07T00:16:02.235 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 14/15 2023-12-07T00:16:02.383 INFO:teuthology.orchestra.run.smithi179.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 15/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 15/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : indent-2.2.13-4.el8.x86_64 1/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : fio-3.19-3.el8.x86_64 2/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : udftools-2.3-2.el8.x86_64 3/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 4/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : gdbm-devel-1:1.18-1.el8.x86_64 5/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 6/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 7/15 2023-12-07T00:16:02.754 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 8/15 2023-12-07T00:16:02.755 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : libcap-devel-2.48-2.el8.x86_64 9/15 2023-12-07T00:16:02.755 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 10/15 2023-12-07T00:16:02.755 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : kernel-devel-4.18.0-372.32.1.el8_6.x86_64 11/15 2023-12-07T00:16:02.755 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 12/15 2023-12-07T00:16:02.755 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 13/15 2023-12-07T00:16:02.755 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 14/15 2023-12-07T00:16:06.594 INFO:teuthology.orchestra.run.smithi179.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 15/15 2023-12-07T00:16:06.594 INFO:teuthology.orchestra.run.smithi179.stdout:Installed products updated. 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout:Upgraded: 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout:Installed: 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout: daxctl-libs-71.1-3.el8.x86_64 dump-1:0.4-0.36.b46.el8.x86_64 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout: fio-3.19-3.el8.x86_64 gdbm-devel-1:1.18-1.el8.x86_64 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout: indent-2.2.13-4.el8.x86_64 kernel-devel-4.18.0-372.32.1.el8_6.x86_64 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout: libcap-devel-2.48-2.el8.x86_64 libpmemblk-1.6.1-1.el8.x86_64 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout: ndctl-libs-71.1-3.el8.x86_64 rmt-2:1.5.3-13.el8.x86_64 2023-12-07T00:16:06.789 INFO:teuthology.orchestra.run.smithi179.stdout: udftools-2.3-2.el8.x86_64 2023-12-07T00:16:06.790 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:16:06.790 INFO:teuthology.orchestra.run.smithi179.stdout:Complete! 2023-12-07T00:16:07.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo useradd -m fsgqa 2023-12-07T00:16:07.250 INFO:teuthology.orchestra.run.smithi179.stderr:useradd: user 'fsgqa' already exists 2023-12-07T00:16:07.251 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-07T00:16:07.251 DEBUG:teuthology.orchestra.run.smithi179:> sudo groupadd fsgqa 2023-12-07T00:16:07.322 INFO:teuthology.orchestra.run.smithi179.stderr:groupadd: group 'fsgqa' already exists 2023-12-07T00:16:07.323 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-07T00:16:07.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo useradd fsgqa2 2023-12-07T00:16:08.387 DEBUG:teuthology.orchestra.run.smithi179:> sudo useradd 123456-fsgqa 2023-12-07T00:16:11.069 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-07T00:16:11.201 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.202+0000 7fc812231700 1 Processor -- start 2023-12-07T00:16:11.201 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.202+0000 7fc812231700 1 -- start start 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc812231700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c15a170 0x7fc80c0ce410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc812231700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc80c06e070 0x7fc80c06e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc812231700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c0cc9c0 con 0x7fc80c0ce950 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc812231700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c0ccf80 con 0x7fc80c06e070 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc812231700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0ccca0 con 0x7fc80c15a170 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80affd700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fc80c0ce950 0x7fc80c0ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48492/0 (socket says 172.21.15.179:48492) 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80affd700 1 -- 172.21.15.179:0/1371794848 learned_addr learned my addr 172.21.15.179:0/1371794848 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80b7fe700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c15a170 0x7fc80c0ce410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548351669 0 0) 0x7fc80c0cc9c0 con 0x7fc80c0ce950 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80bfff700 1 --2- 172.21.15.179:0/1371794848 >> v2:172.21.15.190:3300/0 conn(0x7fc80c06e070 0x7fc80c06e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.205 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f80035b0 con 0x7fc80c0ce950 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612190659 0 0) 0x7fc7f80035b0 con 0x7fc80c0ce950 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c15a170 msgr2=0x7fc80c0ce410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c15a170 0x7fc80c0ce410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 >> v2:172.21.15.190:3300/0 conn(0x7fc80c06e070 msgr2=0x7fc80c06e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 --2- 172.21.15.179:0/1371794848 >> v2:172.21.15.190:3300/0 conn(0x7fc80c06e070 0x7fc80c06e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c06d870 con 0x7fc80c0ce950 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7fc7fc001670 con 0x7fc80c0ce950 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 >> v1:172.21.15.179:6789/0 conn(0x7fc80c0ce950 legacy=0x7fc80c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.203+0000 7fc80a7fc700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc7f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80a7fc700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7f8004850 0x7fc7f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80a7fc700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c15a170 0x7fc7f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0ccf80 con 0x7fc7f8003a00 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0ccca0 con 0x7fc7f8004850 2023-12-07T00:16:11.206 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f800ba10 con 0x7fc80c15a170 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80b7fe700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc7f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80affd700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7f8004850 0x7fc7f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80bfff700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c15a170 0x7fc7f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80b7fe700 1 -- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c15a170 msgr2=0x7fc7f8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80b7fe700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c15a170 0x7fc7f8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80b7fe700 1 -- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7f8004850 msgr2=0x7fc7f8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80b7fe700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc7f8004850 0x7fc7f8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80b7fe700 1 -- 172.21.15.179:0/1371794848 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80035b0 con 0x7fc7f8003a00 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80b7fe700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc7f8003e20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc804009fc0 tx=0x7fc7f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605c843cb26ada13 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80400ec30 con 0x7fc7f8003a00 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80400f040 con 0x7fc7f8003a00 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.204+0000 7fc80a7fc700 1 -- 172.21.15.179:0/1371794848 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804012430 con 0x7fc7f8003a00 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.205+0000 7fc812231700 1 -- 172.21.15.179:0/1371794848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 msgr2=0x7fc7f8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.205+0000 7fc812231700 1 --2- 172.21.15.179:0/1371794848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc7f8003e20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fc804009fc0 tx=0x7fc7f8005880 comp rx=0 tx=0).stop 2023-12-07T00:16:11.207 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.205+0000 7fc80bfff700 1 -- 172.21.15.179:0/1371794848 reap_dead start 2023-12-07T00:16:11.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.205+0000 7fc812231700 1 -- 172.21.15.179:0/1371794848 shutdown_connections 2023-12-07T00:16:11.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.205+0000 7fc812231700 1 -- 172.21.15.179:0/1371794848 >> 172.21.15.179:0/1371794848 conn(0x7fc80c06b150 msgr2=0x7fc80c06b560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:16:11.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.205+0000 7fc812231700 1 -- 172.21.15.179:0/1371794848 shutdown_connections 2023-12-07T00:16:11.208 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.205+0000 7fc812231700 1 -- 172.21.15.179:0/1371794848 wait complete. 2023-12-07T00:16:11.210 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.206+0000 7fc812231700 1 Processor -- start 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.206+0000 7fc812231700 1 -- start start 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc812231700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc80c1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc812231700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c13b730 0x7fc80c13a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc812231700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc80c13adb0 0x7fc80c15cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc812231700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c13b230 con 0x7fc7f8003a00 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc812231700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c155c20 con 0x7fc80c13adb0 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc812231700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c13b430 con 0x7fc80c13b730 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc80c1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc80c1551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41598/0 (socket says 172.21.15.179:41598) 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80b7fe700 1 -- 172.21.15.179:0/1807559905 learned_addr learned my addr 172.21.15.179:0/1807559905 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80bfff700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc80c13adb0 0x7fc80c15cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80affd700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c13b730 0x7fc80c13a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80b7fe700 1 -- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c13b730 msgr2=0x7fc80c13a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.211 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80b7fe700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c13b730 0x7fc80c13a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80b7fe700 1 -- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc80c13adb0 msgr2=0x7fc80c15cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.207+0000 7fc80b7fe700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc80c13adb0 0x7fc80c15cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.208+0000 7fc80b7fe700 1 -- 172.21.15.179:0/1807559905 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c15aac0 con 0x7fc7f8003a00 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.208+0000 7fc80bfff700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc80c13adb0 0x7fc80c15cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.208+0000 7fc80b7fe700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc80c1551b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc8040126e0 tx=0x7fc804009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.208+0000 7fc803fff700 1 -- 172.21.15.179:0/1807559905 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804007000 con 0x7fc7f8003a00 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.208+0000 7fc803fff700 1 -- 172.21.15.179:0/1807559905 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804003a20 con 0x7fc7f8003a00 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.208+0000 7fc803fff700 1 -- 172.21.15.179:0/1807559905 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804003e10 con 0x7fc7f8003a00 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.208+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c15ada0 con 0x7fc7f8003a00 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.208+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c15b360 con 0x7fc7f8003a00 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.209+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c15b4f0 con 0x7fc7f8003a00 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.210+0000 7fc803fff700 1 -- 172.21.15.179:0/1807559905 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc804004030 con 0x7fc7f8003a00 2023-12-07T00:16:11.212 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.210+0000 7fc803fff700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc7ec06aed0 0x7fc7ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.210+0000 7fc803fff700 1 -- 172.21.15.179:0/1807559905 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc804016070 con 0x7fc7f8003a00 2023-12-07T00:16:11.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.210+0000 7fc80affd700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc7ec06aed0 0x7fc7ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.210+0000 7fc80affd700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc7ec06aed0 0x7fc7ec06d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc000fb0 tx=0x7fc7fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:16:11.213 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.214+0000 7fc803fff700 1 -- 172.21.15.179:0/1807559905 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc804059130 con 0x7fc7f8003a00 2023-12-07T00:16:11.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.483+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc80c0b4ee0 con 0x7fc7f8003a00 2023-12-07T00:16:11.483 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.484+0000 7fc803fff700 1 -- 172.21.15.179:0/1807559905 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7fc80405c750 con 0x7fc7f8003a00 2023-12-07T00:16:11.484 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:16:11.484 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":1,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","modified":"2023-12-07T00:13:14.205363Z","created":"2023-12-07T00:13:14.205363Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:3300","nonce":0},{"type":"v1","addr":"172.21.15.179:6789","nonce":0}]},"addr":"172.21.15.179:6789/0","public_addr":"172.21.15.179:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3300","nonce":0},{"type":"v1","addr":"172.21.15.190:6789","nonce":0}]},"addr":"172.21.15.190:6789/0","public_addr":"172.21.15.190:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:3301","nonce":0},{"type":"v1","addr":"172.21.15.190:6790","nonce":0}]},"addr":"172.21.15.190:6790/0","public_addr":"172.21.15.190:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc7ec06aed0 msgr2=0x7fc7ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc7ec06aed0 0x7fc7ec06d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc000fb0 tx=0x7fc7fc009040 comp rx=0 tx=0).stop 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 msgr2=0x7fc80c1551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc80c1551b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc8040126e0 tx=0x7fc804009750 comp rx=0 tx=0).stop 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 shutdown_connections 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc7ec06aed0 0x7fc7ec06d390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc80c13adb0 0x7fc80c15cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc7f8003a00 0x7fc80c1551b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 --2- 172.21.15.179:0/1807559905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc80c13b730 0x7fc80c13a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 >> 172.21.15.179:0/1807559905 conn(0x7fc80c06b150 msgr2=0x7fc80c13f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:16:11.486 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 shutdown_connections 2023-12-07T00:16:11.487 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.486+0000 7fc812231700 1 -- 172.21.15.179:0/1807559905 wait complete. 2023-12-07T00:16:11.487 INFO:teuthology.orchestra.run.smithi179.stderr:dumped monmap epoch 1 2023-12-07T00:16:11.498 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-07T00:16:11.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.620+0000 7f4879085700 1 Processor -- start 2023-12-07T00:16:11.620 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.620+0000 7f4879085700 1 -- start start 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.621+0000 7f4879085700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4874158560 0x7f48740b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.621+0000 7f4879085700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f487415b010 0x7f48740b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.621+0000 7f4879085700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48740b2ef0 con 0x7f48740b2aa0 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.621+0000 7f4879085700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487415b8d0 con 0x7f4874158560 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.621+0000 7f4879085700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f487415bbb0 con 0x7f487415b010 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.621+0000 7f4872d9d700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4874158560 0x7f48740b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.621+0000 7f487359e700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f48740b2aa0 0x7f487406e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:48512/0 (socket says 172.21.15.179:48512) 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.621+0000 7f487359e700 1 -- 172.21.15.179:0/2497108959 learned_addr learned my addr 172.21.15.179:0/2497108959 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f487259c700 1 --2- 172.21.15.179:0/2497108959 >> v2:172.21.15.190:3300/0 conn(0x7f487415b010 0x7f48740b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4872d9d700 1 -- 172.21.15.179:0/2497108959 >> v2:172.21.15.190:3300/0 conn(0x7f487415b010 msgr2=0x7f48740b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T00:16:11.622 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4872d9d700 1 --2- 172.21.15.179:0/2497108959 >> v2:172.21.15.190:3300/0 conn(0x7f487415b010 0x7f48740b2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4872d9d700 1 -- 172.21.15.179:0/2497108959 >> v1:172.21.15.179:6789/0 conn(0x7f48740b2aa0 legacy=0x7f487406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4872d9d700 1 -- 172.21.15.179:0/2497108959 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487415be90 con 0x7f4874158560 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4872d9d700 1 --2- 172.21.15.179:0/2497108959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f48740b4470 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f48740b49b0 tx=0x7f4868009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6fd5d2eebeeb511 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4871d9b700 1 -- 172.21.15.179:0/2497108959 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868011830 con 0x7f4874158560 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4871d9b700 1 -- 172.21.15.179:0/2497108959 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4868011990 con 0x7f4874158560 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4871d9b700 1 -- 172.21.15.179:0/2497108959 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868011d20 con 0x7f4874158560 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4879085700 1 -- 172.21.15.179:0/2497108959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 msgr2=0x7f48740b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.622+0000 7f4879085700 1 --2- 172.21.15.179:0/2497108959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f48740b4470 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f48740b49b0 tx=0x7f4868009b20 comp rx=0 tx=0).stop 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.623+0000 7f4879085700 1 -- 172.21.15.179:0/2497108959 shutdown_connections 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.623+0000 7f4879085700 1 --2- 172.21.15.179:0/2497108959 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f48740b4470 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.623+0000 7f4879085700 1 --2- 172.21.15.179:0/2497108959 >> v2:172.21.15.190:3300/0 conn(0x7f487415b010 0x7f48740b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.623+0000 7f4879085700 1 -- 172.21.15.179:0/2497108959 >> 172.21.15.179:0/2497108959 conn(0x7f4874072970 msgr2=0x7f4874072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.623+0000 7f4879085700 1 -- 172.21.15.179:0/2497108959 shutdown_connections 2023-12-07T00:16:11.623 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.623+0000 7f4879085700 1 -- 172.21.15.179:0/2497108959 wait complete. 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.624+0000 7f4879085700 1 Processor -- start 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.624+0000 7f4879085700 1 -- start start 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f4879085700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48740b2aa0 0x7f48741444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f4879085700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f4874150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f4879085700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f487415b010 0x7f4874155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f4879085700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741449e0 con 0x7f4874158560 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f4879085700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4874151dc0 con 0x7f487415b010 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f4879085700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48741520a0 con 0x7f48740b2aa0 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f4874150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.626 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f4874150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:41614/0 (socket says 172.21.15.179:41614) 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 -- 172.21.15.179:0/2693981843 learned_addr learned my addr 172.21.15.179:0/2693981843 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487359e700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f487415b010 0x7f4874155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f4872d9d700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48740b2aa0 0x7f48741444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 -- 172.21.15.179:0/2693981843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48740b2aa0 msgr2=0x7f48741444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48740b2aa0 0x7f48741444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 -- 172.21.15.179:0/2693981843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f487415b010 msgr2=0x7f4874155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f487415b010 0x7f4874155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 -- 172.21.15.179:0/2693981843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48680094a0 con 0x7f4874158560 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.625+0000 7f487259c700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f4874150fd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f486400c7f0 tx=0x7f486400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.626+0000 7f485b7fe700 1 -- 172.21.15.179:0/2693981843 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864011800 con 0x7f4874158560 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.626+0000 7f485b7fe700 1 -- 172.21.15.179:0/2693981843 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4864011960 con 0x7f4874158560 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.626+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4874152380 con 0x7f4874158560 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.626+0000 7f485b7fe700 1 -- 172.21.15.179:0/2693981843 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864011cf0 con 0x7f4874158560 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.626+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4874152940 con 0x7f4874158560 2023-12-07T00:16:11.627 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.626+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487404f290 con 0x7f4874158560 2023-12-07T00:16:11.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.627+0000 7f485b7fe700 1 -- 172.21.15.179:0/2693981843 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4864018360 con 0x7f4874158560 2023-12-07T00:16:11.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.627+0000 7f485b7fe700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f486006aed0 0x7f486006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T00:16:11.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.627+0000 7f485b7fe700 1 -- 172.21.15.179:0/2693981843 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f48640895c0 con 0x7f4874158560 2023-12-07T00:16:11.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.627+0000 7f4872d9d700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f486006aed0 0x7f486006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T00:16:11.628 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.628+0000 7f4872d9d700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f486006aed0 0x7f486006d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f48680090b0 tx=0x7f4868008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T00:16:11.631 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.632+0000 7f485b7fe700 1 -- 172.21.15.179:0/2693981843 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4864054510 con 0x7f4874158560 2023-12-07T00:16:11.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.900+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f4874152b60 con 0x7f4874158560 2023-12-07T00:16:11.899 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.900+0000 7f485b7fe700 1 -- 172.21.15.179:0/2693981843 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f4864057b30 con 0x7f4874158560 2023-12-07T00:16:11.899 INFO:teuthology.orchestra.run.smithi179.stdout:[client.admin] 2023-12-07T00:16:11.900 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f486006aed0 msgr2=0x7f486006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f486006aed0 0x7f486006d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f48680090b0 tx=0x7f4868008030 comp rx=0 tx=0).stop 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 msgr2=0x7f4874150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f4874150fd0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f486400c7f0 tx=0x7f486400cb00 comp rx=0 tx=0).stop 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 shutdown_connections 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f486006aed0 0x7f486006d390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f487415b010 0x7f4874155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f48740b2aa0 0x7f48741444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 --2- 172.21.15.179:0/2693981843 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4874158560 0x7f4874150fd0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.902+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 >> 172.21.15.179:0/2693981843 conn(0x7f4874072970 msgr2=0x7f4874159140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.903+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 shutdown_connections 2023-12-07T00:16:11.902 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T00:16:11.903+0000 7f4879085700 1 -- 172.21.15.179:0/2693981843 wait complete. 2023-12-07T00:16:11.919 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:16:11.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/tmp/tmp.poL8GbUio4xfstests-dev/local.config 2023-12-07T00:16:11.947 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.179:6789:/test export TEST_DIR=/tmp/tmp.YGf8tKAzkhtest export SCRATCH_DEV=172.21.15.179:6789:/scratch export SCRATCH_MNT=/tmp/tmp.0W7YXWNQIHscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA==" 2023-12-07T00:16:11.947 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T00:16:11.947 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/tmp/tmp.poL8GbUio4xfstests-dev/ceph.exclude 2023-12-07T00:16:12.013 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo make) 2023-12-07T00:16:12.091 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize -cfi 2023-12-07T00:16:12.444 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-07T00:16:12.444 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file './config.guess' 2023-12-07T00:16:12.447 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file './config.sub' 2023-12-07T00:16:12.450 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file './install-sh' 2023-12-07T00:16:12.454 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file './ltmain.sh' 2023-12-07T00:16:12.474 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-07T00:16:12.474 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-07T00:16:12.478 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-07T00:16:12.483 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-07T00:16:12.487 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-07T00:16:12.491 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-07T00:16:12.497 INFO:teuthology.orchestra.run.smithi179.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-07T00:16:12.498 INFO:teuthology.orchestra.run.smithi179.stdout:cp include/install-sh . 2023-12-07T00:16:12.501 INFO:teuthology.orchestra.run.smithi179.stdout:aclocal -I m4 2023-12-07T00:16:12.703 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:16:12.705 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:16:13.645 INFO:teuthology.orchestra.run.smithi179.stdout:autoheader 2023-12-07T00:16:13.943 INFO:teuthology.orchestra.run.smithi179.stdout:autoconf 2023-12-07T00:16:14.101 INFO:teuthology.orchestra.run.smithi179.stdout:./configure \ 2023-12-07T00:16:14.101 INFO:teuthology.orchestra.run.smithi179.stdout: --libexecdir=/usr/lib \ 2023-12-07T00:16:14.101 INFO:teuthology.orchestra.run.smithi179.stdout: --exec_prefix=/var/lib 2023-12-07T00:16:14.565 INFO:teuthology.orchestra.run.smithi179.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-07T00:16:14.565 INFO:teuthology.orchestra.run.smithi179.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-07T00:16:14.567 INFO:teuthology.orchestra.run.smithi179.stdout:checking how to print strings... printf 2023-12-07T00:16:14.567 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gcc... gcc 2023-12-07T00:16:14.698 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether the C compiler works... yes 2023-12-07T00:16:14.698 INFO:teuthology.orchestra.run.smithi179.stdout:checking for C compiler default output file name... a.out 2023-12-07T00:16:14.727 INFO:teuthology.orchestra.run.smithi179.stdout:checking for suffix of executables... 2023-12-07T00:16:14.802 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether we are cross compiling... no 2023-12-07T00:16:14.820 INFO:teuthology.orchestra.run.smithi179.stdout:checking for suffix of object files... o 2023-12-07T00:16:14.836 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether we are using the GNU C compiler... yes 2023-12-07T00:16:14.852 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether gcc accepts -g... yes 2023-12-07T00:16:14.878 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-07T00:16:14.881 INFO:teuthology.orchestra.run.smithi179.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-07T00:16:14.883 INFO:teuthology.orchestra.run.smithi179.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-07T00:16:14.884 INFO:teuthology.orchestra.run.smithi179.stdout:checking for egrep... /bin/grep -E 2023-12-07T00:16:14.885 INFO:teuthology.orchestra.run.smithi179.stdout:checking for fgrep... /bin/grep -F 2023-12-07T00:16:14.888 INFO:teuthology.orchestra.run.smithi179.stdout:checking for ld used by gcc... /bin/ld 2023-12-07T00:16:14.890 INFO:teuthology.orchestra.run.smithi179.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-07T00:16:14.895 INFO:teuthology.orchestra.run.smithi179.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-07T00:16:14.912 INFO:teuthology.orchestra.run.smithi179.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-07T00:16:14.912 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether ln -s works... yes 2023-12-07T00:16:14.922 INFO:teuthology.orchestra.run.smithi179.stdout:checking the maximum length of command line arguments... 1572864 2023-12-07T00:16:14.929 INFO:teuthology.orchestra.run.smithi179.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-07T00:16:14.929 INFO:teuthology.orchestra.run.smithi179.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-07T00:16:14.929 INFO:teuthology.orchestra.run.smithi179.stdout:checking for /bin/ld option to reload object files... -r 2023-12-07T00:16:14.929 INFO:teuthology.orchestra.run.smithi179.stdout:checking for objdump... objdump 2023-12-07T00:16:14.929 INFO:teuthology.orchestra.run.smithi179.stdout:checking how to recognize dependent libraries... pass_all 2023-12-07T00:16:14.930 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dlltool... no 2023-12-07T00:16:14.930 INFO:teuthology.orchestra.run.smithi179.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-07T00:16:14.930 INFO:teuthology.orchestra.run.smithi179.stdout:checking for ar... ar 2023-12-07T00:16:14.956 INFO:teuthology.orchestra.run.smithi179.stdout:checking for archiver @FILE support... @ 2023-12-07T00:16:14.956 INFO:teuthology.orchestra.run.smithi179.stdout:checking for strip... strip 2023-12-07T00:16:14.956 INFO:teuthology.orchestra.run.smithi179.stdout:checking for ranlib... ranlib 2023-12-07T00:16:14.957 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gawk... gawk 2023-12-07T00:16:15.007 INFO:teuthology.orchestra.run.smithi179.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-07T00:16:15.009 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sysroot... no 2023-12-07T00:16:15.011 INFO:teuthology.orchestra.run.smithi179.stdout:checking for a working dd... /bin/dd 2023-12-07T00:16:15.013 INFO:teuthology.orchestra.run.smithi179.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-07T00:16:15.026 INFO:teuthology.orchestra.run.smithi179.stdout:checking for mt... no 2023-12-07T00:16:15.028 INFO:teuthology.orchestra.run.smithi179.stdout:checking if : is a manifest tool... no 2023-12-07T00:16:15.062 INFO:teuthology.orchestra.run.smithi179.stdout:checking how to run the C preprocessor... gcc -E 2023-12-07T00:16:15.187 INFO:teuthology.orchestra.run.smithi179.stdout:checking for ANSI C header files... yes 2023-12-07T00:16:15.207 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/types.h... yes 2023-12-07T00:16:15.230 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/stat.h... yes 2023-12-07T00:16:15.252 INFO:teuthology.orchestra.run.smithi179.stdout:checking for stdlib.h... yes 2023-12-07T00:16:15.276 INFO:teuthology.orchestra.run.smithi179.stdout:checking for string.h... yes 2023-12-07T00:16:15.301 INFO:teuthology.orchestra.run.smithi179.stdout:checking for memory.h... yes 2023-12-07T00:16:15.324 INFO:teuthology.orchestra.run.smithi179.stdout:checking for strings.h... yes 2023-12-07T00:16:15.350 INFO:teuthology.orchestra.run.smithi179.stdout:checking for inttypes.h... yes 2023-12-07T00:16:15.374 INFO:teuthology.orchestra.run.smithi179.stdout:checking for stdint.h... yes 2023-12-07T00:16:15.402 INFO:teuthology.orchestra.run.smithi179.stdout:checking for unistd.h... yes 2023-12-07T00:16:15.427 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dlfcn.h... yes 2023-12-07T00:16:15.430 INFO:teuthology.orchestra.run.smithi179.stdout:checking for objdir... .libs 2023-12-07T00:16:15.494 INFO:teuthology.orchestra.run.smithi179.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-07T00:16:15.494 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-07T00:16:15.509 INFO:teuthology.orchestra.run.smithi179.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-07T00:16:15.529 INFO:teuthology.orchestra.run.smithi179.stdout:checking if gcc static flag -static works... no 2023-12-07T00:16:15.550 INFO:teuthology.orchestra.run.smithi179.stdout:checking if gcc supports -c -o file.o... yes 2023-12-07T00:16:15.550 INFO:teuthology.orchestra.run.smithi179.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-07T00:16:15.555 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-07T00:16:15.579 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether -lc should be explicitly linked in... no 2023-12-07T00:16:15.622 INFO:teuthology.orchestra.run.smithi179.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-07T00:16:15.622 INFO:teuthology.orchestra.run.smithi179.stdout:checking how to hardcode library paths into programs... immediate 2023-12-07T00:16:15.631 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether stripping libraries is possible... yes 2023-12-07T00:16:15.631 INFO:teuthology.orchestra.run.smithi179.stdout:checking if libtool supports shared libraries... yes 2023-12-07T00:16:15.631 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether to build shared libraries... yes 2023-12-07T00:16:15.631 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether to build static libraries... yes 2023-12-07T00:16:15.636 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gcc... (cached) gcc 2023-12-07T00:16:15.651 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-07T00:16:15.651 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-07T00:16:15.651 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-07T00:16:15.651 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gmake... /usr/bin/gmake 2023-12-07T00:16:15.652 INFO:teuthology.orchestra.run.smithi179.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-12-07T00:16:15.652 INFO:teuthology.orchestra.run.smithi179.stdout:checking for tar... /bin/tar 2023-12-07T00:16:15.652 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gzip... /bin/gzip 2023-12-07T00:16:15.658 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether gcc -MM is supported... yes 2023-12-07T00:16:15.659 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sort... /bin/sort 2023-12-07T00:16:15.659 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether ln -s works... yes 2023-12-07T00:16:15.659 INFO:teuthology.orchestra.run.smithi179.stdout:checking for rpm... /bin/rpm 2023-12-07T00:16:15.663 INFO:teuthology.orchestra.run.smithi179.stdout:checking for rpmbuild... no 2023-12-07T00:16:15.687 INFO:teuthology.orchestra.run.smithi179.stdout:checking assert.h usability... yes 2023-12-07T00:16:15.694 INFO:teuthology.orchestra.run.smithi179.stdout:checking assert.h presence... yes 2023-12-07T00:16:15.694 INFO:teuthology.orchestra.run.smithi179.stdout:checking for assert.h... yes 2023-12-07T00:16:15.719 INFO:teuthology.orchestra.run.smithi179.stdout:checking bstring.h usability... no 2023-12-07T00:16:15.728 INFO:teuthology.orchestra.run.smithi179.stdout:checking bstring.h presence... no 2023-12-07T00:16:15.728 INFO:teuthology.orchestra.run.smithi179.stdout:checking for bstring.h... no 2023-12-07T00:16:15.753 INFO:teuthology.orchestra.run.smithi179.stdout:checking libgen.h usability... yes 2023-12-07T00:16:15.759 INFO:teuthology.orchestra.run.smithi179.stdout:checking libgen.h presence... yes 2023-12-07T00:16:15.759 INFO:teuthology.orchestra.run.smithi179.stdout:checking for libgen.h... yes 2023-12-07T00:16:15.786 INFO:teuthology.orchestra.run.smithi179.stdout:checking dirent.h usability... yes 2023-12-07T00:16:15.794 INFO:teuthology.orchestra.run.smithi179.stdout:checking dirent.h presence... yes 2023-12-07T00:16:15.794 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dirent.h... yes 2023-12-07T00:16:15.844 INFO:teuthology.orchestra.run.smithi179.stdout:checking errno.h usability... yes 2023-12-07T00:16:15.851 INFO:teuthology.orchestra.run.smithi179.stdout:checking errno.h presence... yes 2023-12-07T00:16:15.851 INFO:teuthology.orchestra.run.smithi179.stdout:checking for errno.h... yes 2023-12-07T00:16:15.879 INFO:teuthology.orchestra.run.smithi179.stdout:checking malloc.h usability... yes 2023-12-07T00:16:15.886 INFO:teuthology.orchestra.run.smithi179.stdout:checking malloc.h presence... yes 2023-12-07T00:16:15.887 INFO:teuthology.orchestra.run.smithi179.stdout:checking for malloc.h... yes 2023-12-07T00:16:15.912 INFO:teuthology.orchestra.run.smithi179.stdout:checking uuid.h usability... no 2023-12-07T00:16:15.921 INFO:teuthology.orchestra.run.smithi179.stdout:checking uuid.h presence... no 2023-12-07T00:16:15.922 INFO:teuthology.orchestra.run.smithi179.stdout:checking for uuid.h... no 2023-12-07T00:16:15.949 INFO:teuthology.orchestra.run.smithi179.stdout:checking uuid/uuid.h usability... yes 2023-12-07T00:16:15.957 INFO:teuthology.orchestra.run.smithi179.stdout:checking uuid/uuid.h presence... yes 2023-12-07T00:16:15.957 INFO:teuthology.orchestra.run.smithi179.stdout:checking for uuid/uuid.h... yes 2023-12-07T00:16:15.982 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/uuid.h usability... no 2023-12-07T00:16:15.991 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/uuid.h presence... no 2023-12-07T00:16:15.991 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/uuid.h... no 2023-12-07T00:16:16.016 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/file.h usability... yes 2023-12-07T00:16:16.024 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/file.h presence... yes 2023-12-07T00:16:16.024 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/file.h... yes 2023-12-07T00:16:16.051 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/fcntl.h usability... yes 2023-12-07T00:16:16.058 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/fcntl.h presence... yes 2023-12-07T00:16:16.058 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/fcntl.h... yes 2023-12-07T00:16:16.083 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/syssgi.h usability... no 2023-12-07T00:16:16.092 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/syssgi.h presence... no 2023-12-07T00:16:16.092 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/syssgi.h... no 2023-12-07T00:16:16.133 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/param.h usability... yes 2023-12-07T00:16:16.142 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/param.h presence... yes 2023-12-07T00:16:16.142 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/param.h... yes 2023-12-07T00:16:16.147 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/stat.h... (cached) yes 2023-12-07T00:16:16.174 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/statvfs.h usability... yes 2023-12-07T00:16:16.181 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/statvfs.h presence... yes 2023-12-07T00:16:16.181 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/statvfs.h... yes 2023-12-07T00:16:16.207 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/time.h usability... yes 2023-12-07T00:16:16.214 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/time.h presence... yes 2023-12-07T00:16:16.214 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/time.h... yes 2023-12-07T00:16:16.243 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/ioctl.h usability... yes 2023-12-07T00:16:16.250 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/ioctl.h presence... yes 2023-12-07T00:16:16.250 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/ioctl.h... yes 2023-12-07T00:16:16.278 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/wait.h usability... yes 2023-12-07T00:16:16.287 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/wait.h presence... yes 2023-12-07T00:16:16.287 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/wait.h... yes 2023-12-07T00:16:16.291 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/types.h... (cached) yes 2023-12-07T00:16:16.296 INFO:teuthology.orchestra.run.smithi179.stdout:checking for strings.h... (cached) yes 2023-12-07T00:16:16.325 INFO:teuthology.orchestra.run.smithi179.stdout:checking err.h usability... yes 2023-12-07T00:16:16.332 INFO:teuthology.orchestra.run.smithi179.stdout:checking err.h presence... yes 2023-12-07T00:16:16.332 INFO:teuthology.orchestra.run.smithi179.stdout:checking for err.h... yes 2023-12-07T00:16:16.358 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/falloc.h usability... yes 2023-12-07T00:16:16.365 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/falloc.h presence... yes 2023-12-07T00:16:16.366 INFO:teuthology.orchestra.run.smithi179.stdout:checking for linux/falloc.h... yes 2023-12-07T00:16:16.390 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-07T00:16:16.399 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-07T00:16:16.399 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-07T00:16:16.422 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-07T00:16:16.431 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-07T00:16:16.431 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-07T00:16:16.454 INFO:teuthology.orchestra.run.smithi179.stdout:checking xfs/platform_defs.h usability... no 2023-12-07T00:16:16.464 INFO:teuthology.orchestra.run.smithi179.stdout:checking xfs/platform_defs.h presence... no 2023-12-07T00:16:16.464 INFO:teuthology.orchestra.run.smithi179.stdout:checking for xfs/platform_defs.h... no 2023-12-07T00:16:16.486 INFO:teuthology.orchestra.run.smithi179.stdout:checking btrfs/ioctl.h usability... no 2023-12-07T00:16:16.496 INFO:teuthology.orchestra.run.smithi179.stdout:checking btrfs/ioctl.h presence... no 2023-12-07T00:16:16.496 INFO:teuthology.orchestra.run.smithi179.stdout:checking for btrfs/ioctl.h... no 2023-12-07T00:16:16.519 INFO:teuthology.orchestra.run.smithi179.stdout:checking cifs/ioctl.h usability... no 2023-12-07T00:16:16.528 INFO:teuthology.orchestra.run.smithi179.stdout:checking cifs/ioctl.h presence... no 2023-12-07T00:16:16.528 INFO:teuthology.orchestra.run.smithi179.stdout:checking for cifs/ioctl.h... no 2023-12-07T00:16:16.554 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/mman.h usability... yes 2023-12-07T00:16:16.561 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/mman.h presence... yes 2023-12-07T00:16:16.561 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/mman.h... yes 2023-12-07T00:16:16.575 INFO:teuthology.orchestra.run.smithi179.stdout:checking for xfs/xfs_log_format.h... no 2023-12-07T00:16:16.609 INFO:teuthology.orchestra.run.smithi179.stdout:checking for uuid_compare... no 2023-12-07T00:16:16.639 INFO:teuthology.orchestra.run.smithi179.stdout:checking for uuid_compare in -luuid... yes 2023-12-07T00:16:16.692 INFO:teuthology.orchestra.run.smithi179.stdout:checking for xfs/xfs.h... yes 2023-12-07T00:16:16.704 INFO:teuthology.orchestra.run.smithi179.stdout:checking for xfs/libxfs.h... no 2023-12-07T00:16:16.719 INFO:teuthology.orchestra.run.smithi179.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-07T00:16:16.745 INFO:teuthology.orchestra.run.smithi179.stdout:checking for xfs/xqm.h... yes 2023-12-07T00:16:16.790 INFO:teuthology.orchestra.run.smithi179.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-07T00:16:16.812 INFO:teuthology.orchestra.run.smithi179.stdout:checking xfs/handle.h usability... yes 2023-12-07T00:16:16.818 INFO:teuthology.orchestra.run.smithi179.stdout:checking xfs/handle.h presence... yes 2023-12-07T00:16:16.818 INFO:teuthology.orchestra.run.smithi179.stdout:checking for xfs/handle.h... yes 2023-12-07T00:16:16.856 INFO:teuthology.orchestra.run.smithi179.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-07T00:16:16.889 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/acl.h usability... yes 2023-12-07T00:16:16.897 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/acl.h presence... yes 2023-12-07T00:16:16.897 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/acl.h... yes 2023-12-07T00:16:16.926 INFO:teuthology.orchestra.run.smithi179.stdout:checking acl/libacl.h usability... yes 2023-12-07T00:16:16.934 INFO:teuthology.orchestra.run.smithi179.stdout:checking acl/libacl.h presence... yes 2023-12-07T00:16:16.934 INFO:teuthology.orchestra.run.smithi179.stdout:checking for acl/libacl.h... yes 2023-12-07T00:16:16.965 INFO:teuthology.orchestra.run.smithi179.stdout:checking for acl_init in -lacl... yes 2023-12-07T00:16:16.989 INFO:teuthology.orchestra.run.smithi179.stdout:checking gdbm-ndbm.h usability... no 2023-12-07T00:16:16.997 INFO:teuthology.orchestra.run.smithi179.stdout:checking gdbm-ndbm.h presence... no 2023-12-07T00:16:16.997 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gdbm-ndbm.h... no 2023-12-07T00:16:17.018 INFO:teuthology.orchestra.run.smithi179.stdout:checking gdbm/ndbm.h usability... yes 2023-12-07T00:16:17.026 INFO:teuthology.orchestra.run.smithi179.stdout:checking gdbm/ndbm.h presence... yes 2023-12-07T00:16:17.026 INFO:teuthology.orchestra.run.smithi179.stdout:checking for gdbm/ndbm.h... yes 2023-12-07T00:16:17.059 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dbm_open in -lgdbm... no 2023-12-07T00:16:17.092 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dbm_fetch in -lgdbm... no 2023-12-07T00:16:17.125 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dbm_store in -lgdbm... no 2023-12-07T00:16:17.158 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dbm_close in -lgdbm... no 2023-12-07T00:16:17.195 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-12-07T00:16:17.225 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-12-07T00:16:17.256 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-12-07T00:16:17.286 INFO:teuthology.orchestra.run.smithi179.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-12-07T00:16:17.311 INFO:teuthology.orchestra.run.smithi179.stdout:checking libaio.h usability... yes 2023-12-07T00:16:17.321 INFO:teuthology.orchestra.run.smithi179.stdout:checking libaio.h presence... yes 2023-12-07T00:16:17.321 INFO:teuthology.orchestra.run.smithi179.stdout:checking for libaio.h... yes 2023-12-07T00:16:17.343 INFO:teuthology.orchestra.run.smithi179.stdout:checking liburing.h usability... no 2023-12-07T00:16:17.352 INFO:teuthology.orchestra.run.smithi179.stdout:checking liburing.h presence... no 2023-12-07T00:16:17.353 INFO:teuthology.orchestra.run.smithi179.stdout:checking for liburing.h... no 2023-12-07T00:16:17.379 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/capability.h usability... yes 2023-12-07T00:16:17.388 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/capability.h presence... yes 2023-12-07T00:16:17.388 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/capability.h... yes 2023-12-07T00:16:17.412 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/fiemap.h usability... yes 2023-12-07T00:16:17.418 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/fiemap.h presence... yes 2023-12-07T00:16:17.418 INFO:teuthology.orchestra.run.smithi179.stdout:checking for linux/fiemap.h... yes 2023-12-07T00:16:17.450 INFO:teuthology.orchestra.run.smithi179.stdout:checking for fallocate... yes 2023-12-07T00:16:17.482 INFO:teuthology.orchestra.run.smithi179.stdout:checking for open_by_handle_at... yes 2023-12-07T00:16:17.506 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/prctl.h usability... yes 2023-12-07T00:16:17.513 INFO:teuthology.orchestra.run.smithi179.stdout:checking sys/prctl.h presence... yes 2023-12-07T00:16:17.513 INFO:teuthology.orchestra.run.smithi179.stdout:checking for sys/prctl.h... yes 2023-12-07T00:16:17.536 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/fs.h usability... yes 2023-12-07T00:16:17.543 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/fs.h presence... yes 2023-12-07T00:16:17.543 INFO:teuthology.orchestra.run.smithi179.stdout:checking for linux/fs.h... yes 2023-12-07T00:16:17.564 INFO:teuthology.orchestra.run.smithi179.stdout:checking btrfsutil.h usability... no 2023-12-07T00:16:17.573 INFO:teuthology.orchestra.run.smithi179.stdout:checking btrfsutil.h presence... no 2023-12-07T00:16:17.573 INFO:teuthology.orchestra.run.smithi179.stdout:checking for btrfsutil.h... no 2023-12-07T00:16:17.619 INFO:teuthology.orchestra.run.smithi179.stdout:checking for copy_file_range... yes 2023-12-07T00:16:17.659 INFO:teuthology.orchestra.run.smithi179.stdout:checking for SEEK_DATA... yes 2023-12-07T00:16:17.709 INFO:teuthology.orchestra.run.smithi179.stdout:checking for BMV_OF_SHARED... yes 2023-12-07T00:16:17.748 INFO:teuthology.orchestra.run.smithi179.stdout:checking for nftw... yes 2023-12-07T00:16:18.038 INFO:teuthology.orchestra.run.smithi179.stdout:checking for RLIMIT_NOFILE... yes 2023-12-07T00:16:18.055 INFO:teuthology.orchestra.run.smithi179.stdout:checking for FIEXCHANGE_RANGE... no 2023-12-07T00:16:18.086 INFO:teuthology.orchestra.run.smithi179.stdout:checking for renameat2... yes 2023-12-07T00:16:18.119 INFO:teuthology.orchestra.run.smithi179.stdout:checking for reallocarray... yes 2023-12-07T00:16:18.132 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct mount_attr... no 2023-12-07T00:16:18.180 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-07T00:16:18.214 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-07T00:16:18.247 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-07T00:16:18.280 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-07T00:16:18.313 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-07T00:16:18.346 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-07T00:16:18.379 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-07T00:16:18.405 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/btrfs.h usability... yes 2023-12-07T00:16:18.412 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/btrfs.h presence... yes 2023-12-07T00:16:18.412 INFO:teuthology.orchestra.run.smithi179.stdout:checking for linux/btrfs.h... yes 2023-12-07T00:16:18.441 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-07T00:16:18.448 INFO:teuthology.orchestra.run.smithi179.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-07T00:16:18.448 INFO:teuthology.orchestra.run.smithi179.stdout:checking for linux/btrfs_tree.h... yes 2023-12-07T00:16:18.478 INFO:teuthology.orchestra.run.smithi179.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-12-07T00:16:18.493 INFO:teuthology.orchestra.run.smithi179.stdout:configure: creating ./config.status 2023-12-07T00:16:18.786 INFO:teuthology.orchestra.run.smithi179.stdout:config.status: creating include/builddefs 2023-12-07T00:16:18.796 INFO:teuthology.orchestra.run.smithi179.stdout:config.status: creating include/config.h 2023-12-07T00:16:18.804 INFO:teuthology.orchestra.run.smithi179.stdout:config.status: executing libtool commands 2023-12-07T00:16:18.841 INFO:teuthology.orchestra.run.smithi179.stdout:Building include 2023-12-07T00:16:18.844 INFO:teuthology.orchestra.run.smithi179.stdout:Building lib 2023-12-07T00:16:18.847 INFO:teuthology.orchestra.run.smithi179.stdout: [LTDEP] 2023-12-07T00:16:18.957 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] dataascii.lo 2023-12-07T00:16:19.068 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] databin.lo 2023-12-07T00:16:19.204 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] datapid.lo 2023-12-07T00:16:19.299 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] file_lock.lo 2023-12-07T00:16:19.438 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] forker.lo 2023-12-07T00:16:19.560 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] pattern.lo 2023-12-07T00:16:19.674 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] open_flags.lo 2023-12-07T00:16:19.804 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] random_range.lo 2023-12-07T00:16:20.010 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] string_to_tokens.lo 2023-12-07T00:16:20.109 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] str_to_bytes.lo 2023-12-07T00:16:20.228 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] tlibio.lo 2023-12-07T00:16:20.438 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] write_log.lo 2023-12-07T00:16:20.655 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] random.lo 2023-12-07T00:16:20.771 INFO:teuthology.orchestra.run.smithi179.stdout: [LD] 2023-12-07T00:16:20.848 INFO:teuthology.orchestra.run.smithi179.stdout:Building ltp 2023-12-07T00:16:20.851 INFO:teuthology.orchestra.run.smithi179.stdout: [DEP] 2023-12-07T00:16:21.000 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] doio 2023-12-07T00:16:21.585 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fsstress 2023-12-07T00:16:22.769 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fsx 2023-12-07T00:16:23.583 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] growfiles 2023-12-07T00:16:24.041 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] iogen 2023-12-07T00:16:24.357 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-stress 2023-12-07T00:16:24.735 INFO:teuthology.orchestra.run.smithi179.stdout:Building src 2023-12-07T00:16:24.740 INFO:teuthology.orchestra.run.smithi179.stdout: [DEP] 2023-12-07T00:16:26.198 INFO:teuthology.orchestra.run.smithi179.stdout: [DEP] 2023-12-07T00:16:26.219 INFO:teuthology.orchestra.run.smithi179.stdout: [DEP] 2023-12-07T00:16:26.227 INFO:teuthology.orchestra.run.smithi179.stdout: [DEP] 2023-12-07T00:16:26.405 INFO:teuthology.orchestra.run.smithi179.stdout: [DEP] 2023-12-07T00:16:26.425 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] dirstress 2023-12-07T00:16:26.642 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fill 2023-12-07T00:16:26.787 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fill2 2023-12-07T00:16:26.995 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] getpagesize 2023-12-07T00:16:27.124 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] holes 2023-12-07T00:16:27.302 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] lstat64 2023-12-07T00:16:27.473 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] nametest 2023-12-07T00:16:27.691 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] permname 2023-12-07T00:16:27.875 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] randholes 2023-12-07T00:16:28.101 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] runas 2023-12-07T00:16:28.263 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] truncfile 2023-12-07T00:16:28.429 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] usemem 2023-12-07T00:16:28.569 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] mmapcat 2023-12-07T00:16:28.709 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] append_reader 2023-12-07T00:16:28.850 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] append_writer 2023-12-07T00:16:28.991 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] dirperf 2023-12-07T00:16:29.192 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] metaperf 2023-12-07T00:16:29.423 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] devzero 2023-12-07T00:16:29.586 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] feature 2023-12-07T00:16:29.782 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] alloc 2023-12-07T00:16:29.976 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fault 2023-12-07T00:16:30.128 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fstest 2023-12-07T00:16:30.342 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_access_root 2023-12-07T00:16:30.486 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] godown 2023-12-07T00:16:30.643 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] resvtest 2023-12-07T00:16:30.813 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] writemod 2023-12-07T00:16:30.949 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] writev_on_pagefault 2023-12-07T00:16:31.098 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] makeextents 2023-12-07T00:16:31.261 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] itrash 2023-12-07T00:16:31.407 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] rename 2023-12-07T00:16:31.539 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] multi_open_unlink 2023-12-07T00:16:31.692 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] unwritten_sync 2023-12-07T00:16:31.859 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] genhashnames 2023-12-07T00:16:32.033 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_holes 2023-12-07T00:16:32.171 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_writev 2023-12-07T00:16:32.310 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_truncate_cmtime 2023-12-07T00:16:32.458 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] dirhash_collide 2023-12-07T00:16:32.626 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_rename_overwrite 2023-12-07T00:16:32.766 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] holetest 2023-12-07T00:16:32.968 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_truncate_self 2023-12-07T00:16:33.100 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] af_unix 2023-12-07T00:16:33.244 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_stale_pmd 2023-12-07T00:16:33.386 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_cow_race 2023-12-07T00:16:33.540 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_fallocate 2023-12-07T00:16:33.681 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fsync-err 2023-12-07T00:16:33.853 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_write_ro 2023-12-07T00:16:34.003 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-07T00:16:34.150 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-07T00:16:34.296 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_ofd_locks 2023-12-07T00:16:34.475 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_collision 2023-12-07T00:16:34.659 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] mmap-write-concurrent 2023-12-07T00:16:34.817 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_get_file_time 2023-12-07T00:16:34.956 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_create_short_dirs 2023-12-07T00:16:35.111 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_create_long_dirs 2023-12-07T00:16:35.264 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_enospc 2023-12-07T00:16:35.435 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_writev_overlap 2023-12-07T00:16:35.594 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] checkpoint_journal 2023-12-07T00:16:35.738 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] mmap-rw-fault 2023-12-07T00:16:35.910 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] allocstale 2023-12-07T00:16:36.067 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_cow_memory_failure 2023-12-07T00:16:36.224 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fake-dump-rootino 2023-12-07T00:16:36.365 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] dio-buf-fault 2023-12-07T00:16:36.510 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] rewinddir-test 2023-12-07T00:16:36.670 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] xfsctl 2023-12-07T00:16:36.841 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] bstat 2023-12-07T00:16:37.028 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mtab 2023-12-07T00:16:37.198 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] getdevicesize 2023-12-07T00:16:37.332 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] preallo_rw_pattern_reader 2023-12-07T00:16:37.481 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] preallo_rw_pattern_writer 2023-12-07T00:16:37.629 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] ftrunc 2023-12-07T00:16:37.769 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] trunc 2023-12-07T00:16:37.920 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fs_perms 2023-12-07T00:16:38.073 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] testx 2023-12-07T00:16:38.199 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] looptest 2023-12-07T00:16:38.378 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] locktest 2023-12-07T00:16:38.658 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] unwritten_mmap 2023-12-07T00:16:38.809 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] bulkstat_unlink_test 2023-12-07T00:16:38.994 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] deduperace 2023-12-07T00:16:39.248 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] bulkstat_unlink_test_modified 2023-12-07T00:16:39.430 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_dir_offset 2023-12-07T00:16:39.570 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_futimens 2023-12-07T00:16:39.705 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_immutable 2023-12-07T00:16:40.250 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] stale_handle 2023-12-07T00:16:40.407 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] pwrite_mmap_blocked 2023-12-07T00:16:40.550 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_dir_offset2 2023-12-07T00:16:40.730 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] seek_sanity_test 2023-12-07T00:16:41.107 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] seek_copy_test 2023-12-07T00:16:41.272 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_readdir_1 2023-12-07T00:16:41.411 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_readdir_2 2023-12-07T00:16:41.554 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fsync-tester 2023-12-07T00:16:41.781 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] nsexec 2023-12-07T00:16:41.945 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] cloner 2023-12-07T00:16:42.111 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] renameat2 2023-12-07T00:16:42.265 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_getcwd 2023-12-07T00:16:42.414 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] e4compact 2023-12-07T00:16:42.599 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] test-nextquota 2023-12-07T00:16:42.757 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] punch-alternating 2023-12-07T00:16:42.812 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:16:42.815 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:16:42.918 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-07T00:16:43.073 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] listxattr 2023-12-07T00:16:43.212 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] dio-interleaved 2023-12-07T00:16:43.362 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_dir_type 2023-12-07T00:16:43.508 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] dio-invalidate-cache 2023-12-07T00:16:43.697 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] stat_test 2023-12-07T00:16:43.967 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_encrypted_d_revalidate 2023-12-07T00:16:44.122 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] attr_replace_test 2023-12-07T00:16:44.274 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] swapon 2023-12-07T00:16:44.428 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] mkswap 2023-12-07T00:16:44.571 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_attr_corruption 2023-12-07T00:16:44.713 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_open_tmpfiles 2023-12-07T00:16:44.910 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fscrypt-crypt-util 2023-12-07T00:16:45.483 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] bulkstat_null_ocount 2023-12-07T00:16:45.631 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] splice-test 2023-12-07T00:16:45.799 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] chprojid_fail 2023-12-07T00:16:45.951 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] detached_mounts_propagation 2023-12-07T00:16:46.121 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] ext4_resize 2023-12-07T00:16:46.261 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_readdir_3 2023-12-07T00:16:46.441 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] splice2pipe 2023-12-07T00:16:46.594 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] uuid_ioctl 2023-12-07T00:16:46.740 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fiemap-tester 2023-12-07T00:16:46.983 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_stripealign 2023-12-07T00:16:47.128 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] open_by_handle 2023-12-07T00:16:47.362 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] dbtest 2023-12-07T00:16:47.587 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] t_mmap_dio 2023-12-07T00:16:47.741 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] xfsfind 2023-12-07T00:16:47.920 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] fssum 2023-12-07T00:16:48.312 INFO:teuthology.orchestra.run.smithi179.stdout:Building log-writes 2023-12-07T00:16:48.315 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] replay-log 2023-12-07T00:16:48.593 INFO:teuthology.orchestra.run.smithi179.stdout:Building perf 2023-12-07T00:16:48.597 INFO:teuthology.orchestra.run.smithi179.stdout:Building aio-dio-regress 2023-12-07T00:16:48.603 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-07T00:16:48.762 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-fcntl-race 2023-12-07T00:16:48.915 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-subblock-eof-read 2023-12-07T00:16:49.049 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-append-write-read-race 2023-12-07T00:16:49.212 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-invalidate-readahead 2023-12-07T00:16:49.363 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-write-verify 2023-12-07T00:16:49.543 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-07T00:16:49.671 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-last-ref-held-by-io 2023-12-07T00:16:49.831 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-cycle-write 2023-12-07T00:16:50.002 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-extend-stat 2023-12-07T00:16:50.155 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-07T00:16:50.280 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-hole-filling-race 2023-12-07T00:16:50.421 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-invalidate-failure 2023-12-07T00:16:50.568 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aiodio_sparse2 2023-12-07T00:16:50.765 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aiocp 2023-12-07T00:16:50.970 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-cow-race 2023-12-07T00:16:51.114 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] aio-dio-eof-race 2023-12-07T00:16:51.285 INFO:teuthology.orchestra.run.smithi179.stdout:Building vfs 2023-12-07T00:16:51.290 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] vfstest 2023-12-07T00:16:54.378 INFO:teuthology.orchestra.run.smithi179.stdout: [CC] mount-idmapped 2023-12-07T00:16:54.729 INFO:teuthology.orchestra.run.smithi179.stdout:Building m4 2023-12-07T00:16:54.732 INFO:teuthology.orchestra.run.smithi179.stdout:Building common 2023-12-07T00:16:54.736 INFO:teuthology.orchestra.run.smithi179.stdout:Building tests 2023-12-07T00:16:54.740 INFO:teuthology.orchestra.run.smithi179.stdout:Building perf 2023-12-07T00:16:54.745 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/perf/group.list 2023-12-07T00:16:54.755 INFO:teuthology.orchestra.run.smithi179.stdout:Building ext4 2023-12-07T00:16:54.760 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/ext4/group.list 2023-12-07T00:16:54.794 INFO:teuthology.orchestra.run.smithi179.stdout:Building ocfs2 2023-12-07T00:16:54.798 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/ocfs2/group.list 2023-12-07T00:16:54.810 INFO:teuthology.orchestra.run.smithi179.stdout:Building overlay 2023-12-07T00:16:54.815 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/overlay/group.list 2023-12-07T00:16:54.851 INFO:teuthology.orchestra.run.smithi179.stdout:Building cifs 2023-12-07T00:16:54.855 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/cifs/group.list 2023-12-07T00:16:54.866 INFO:teuthology.orchestra.run.smithi179.stdout:Building generic 2023-12-07T00:16:54.873 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/generic/group.list 2023-12-07T00:16:54.961 INFO:teuthology.orchestra.run.smithi179.stdout:Building shared 2023-12-07T00:16:54.966 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/shared/group.list 2023-12-07T00:16:54.981 INFO:teuthology.orchestra.run.smithi179.stdout:Building nfs 2023-12-07T00:16:54.986 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/nfs/group.list 2023-12-07T00:16:54.999 INFO:teuthology.orchestra.run.smithi179.stdout:Building f2fs 2023-12-07T00:16:55.004 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/f2fs/group.list 2023-12-07T00:16:55.018 INFO:teuthology.orchestra.run.smithi179.stdout:Building udf 2023-12-07T00:16:55.023 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/udf/group.list 2023-12-07T00:16:55.033 INFO:teuthology.orchestra.run.smithi179.stdout:Building ceph 2023-12-07T00:16:55.038 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/ceph/group.list 2023-12-07T00:16:55.051 INFO:teuthology.orchestra.run.smithi179.stdout:Building xfs 2023-12-07T00:16:55.057 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/xfs/group.list 2023-12-07T00:16:55.146 INFO:teuthology.orchestra.run.smithi179.stdout:Building btrfs 2023-12-07T00:16:55.151 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/btrfs/group.list 2023-12-07T00:16:55.204 INFO:teuthology.orchestra.run.smithi179.stdout:Building tmpfs 2023-12-07T00:16:55.208 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/tmpfs/group.list 2023-12-07T00:16:55.220 INFO:teuthology.orchestra.run.smithi179.stdout:Building selftest 2023-12-07T00:16:55.225 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/selftest/group.list 2023-12-07T00:16:55.238 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo make install) 2023-12-07T00:16:55.274 INFO:teuthology.orchestra.run.smithi179.stdout:Building include 2023-12-07T00:16:55.277 INFO:teuthology.orchestra.run.smithi179.stdout:Building lib 2023-12-07T00:16:55.281 INFO:teuthology.orchestra.run.smithi179.stdout:Building ltp 2023-12-07T00:16:55.285 INFO:teuthology.orchestra.run.smithi179.stdout:Building src 2023-12-07T00:16:55.317 INFO:teuthology.orchestra.run.smithi179.stdout:Building log-writes 2023-12-07T00:16:55.320 INFO:teuthology.orchestra.run.smithi179.stdout:Building perf 2023-12-07T00:16:55.324 INFO:teuthology.orchestra.run.smithi179.stdout:Building aio-dio-regress 2023-12-07T00:16:55.327 INFO:teuthology.orchestra.run.smithi179.stdout:Building vfs 2023-12-07T00:16:55.331 INFO:teuthology.orchestra.run.smithi179.stdout:Building m4 2023-12-07T00:16:55.335 INFO:teuthology.orchestra.run.smithi179.stdout:Building common 2023-12-07T00:16:55.337 INFO:teuthology.orchestra.run.smithi179.stdout:Building tests 2023-12-07T00:16:55.343 INFO:teuthology.orchestra.run.smithi179.stdout:Building perf 2023-12-07T00:16:55.347 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/perf/group.list 2023-12-07T00:16:55.357 INFO:teuthology.orchestra.run.smithi179.stdout:Building ext4 2023-12-07T00:16:55.362 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/ext4/group.list 2023-12-07T00:16:55.395 INFO:teuthology.orchestra.run.smithi179.stdout:Building ocfs2 2023-12-07T00:16:55.400 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/ocfs2/group.list 2023-12-07T00:16:55.412 INFO:teuthology.orchestra.run.smithi179.stdout:Building overlay 2023-12-07T00:16:55.416 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/overlay/group.list 2023-12-07T00:16:55.452 INFO:teuthology.orchestra.run.smithi179.stdout:Building cifs 2023-12-07T00:16:55.456 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/cifs/group.list 2023-12-07T00:16:55.467 INFO:teuthology.orchestra.run.smithi179.stdout:Building generic 2023-12-07T00:16:55.474 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/generic/group.list 2023-12-07T00:16:55.560 INFO:teuthology.orchestra.run.smithi179.stdout:Building shared 2023-12-07T00:16:55.565 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/shared/group.list 2023-12-07T00:16:55.580 INFO:teuthology.orchestra.run.smithi179.stdout:Building nfs 2023-12-07T00:16:55.585 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/nfs/group.list 2023-12-07T00:16:55.597 INFO:teuthology.orchestra.run.smithi179.stdout:Building f2fs 2023-12-07T00:16:55.602 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/f2fs/group.list 2023-12-07T00:16:55.617 INFO:teuthology.orchestra.run.smithi179.stdout:Building udf 2023-12-07T00:16:55.622 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/udf/group.list 2023-12-07T00:16:55.632 INFO:teuthology.orchestra.run.smithi179.stdout:Building ceph 2023-12-07T00:16:55.637 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/ceph/group.list 2023-12-07T00:16:55.650 INFO:teuthology.orchestra.run.smithi179.stdout:Building xfs 2023-12-07T00:16:55.656 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/xfs/group.list 2023-12-07T00:16:55.745 INFO:teuthology.orchestra.run.smithi179.stdout:Building btrfs 2023-12-07T00:16:55.749 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/btrfs/group.list 2023-12-07T00:16:55.801 INFO:teuthology.orchestra.run.smithi179.stdout:Building tmpfs 2023-12-07T00:16:55.806 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/tmpfs/group.list 2023-12-07T00:16:55.818 INFO:teuthology.orchestra.run.smithi179.stdout:Building selftest 2023-12-07T00:16:55.823 INFO:teuthology.orchestra.run.smithi179.stdout: [GROUP] /tmp/tmp.poL8GbUio4xfstests-dev/tests/selftest/group.list 2023-12-07T00:16:55.833 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-07T00:16:55.835 INFO:teuthology.orchestra.run.smithi179.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-07T00:16:55.835 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-07T00:16:55.837 INFO:teuthology.orchestra.run.smithi179.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-07T00:16:55.837 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-07T00:16:55.839 INFO:teuthology.orchestra.run.smithi179.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-07T00:16:55.848 INFO:teuthology.orchestra.run.smithi179.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-07T00:16:55.924 INFO:teuthology.orchestra.run.smithi179.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-07T00:16:55.933 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-07T00:16:55.949 INFO:teuthology.orchestra.run.smithi179.stdout:Building log-writes 2023-12-07T00:16:55.952 INFO:teuthology.orchestra.run.smithi179.stdout:Building perf 2023-12-07T00:16:55.955 INFO:teuthology.orchestra.run.smithi179.stdout:Building aio-dio-regress 2023-12-07T00:16:55.959 INFO:teuthology.orchestra.run.smithi179.stdout:Building vfs 2023-12-07T00:16:55.963 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake -C log-writes install 2023-12-07T00:16:55.964 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-07T00:16:55.972 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-07T00:16:55.980 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake -C perf install 2023-12-07T00:16:55.982 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-07T00:16:55.990 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-07T00:16:56.012 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-07T00:16:56.014 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-07T00:16:56.023 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-12-07T00:16:56.075 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake -C vfs install 2023-12-07T00:16:56.076 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-07T00:16:56.085 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-07T00:16:56.097 INFO:teuthology.orchestra.run.smithi179.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-07T00:16:56.105 INFO:teuthology.orchestra.run.smithi179.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-12-07T00:16:57.305 INFO:teuthology.orchestra.run.smithi179.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-07T00:16:57.406 INFO:teuthology.orchestra.run.smithi179.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-07T00:16:57.436 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-07T00:16:57.438 INFO:teuthology.orchestra.run.smithi179.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-07T00:16:57.438 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-07T00:16:57.439 INFO:teuthology.orchestra.run.smithi179.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-07T00:16:57.447 INFO:teuthology.orchestra.run.smithi179.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-07T00:16:57.581 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-07T00:16:57.585 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/btrfs/ install 2023-12-07T00:16:57.586 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-07T00:16:57.593 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-12-07T00:16:58.411 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-07T00:16:58.419 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 240.out 092.out 077.out 280.out 140.out 265.out 108.out 121.out 204.out 233.out 194.out 055.out 295.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 102.out 034.out 125.out 165.out 181.out 152.out 103.out 024.out 243.out 192.out 148.out 282.out 267.out 178.out 052.out 256.out 228.out 183.out 273.out 251.out 043.out 069.out 027.out 087.out 151.out 206.out 195.out 274.out 215.out 115.out 275.out 250.out 191.out 281.out 051.out 131.out 244.out 219.out 119.out 019.out 128.out 232.out 302.out 020.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 111.out 011.out 234.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 056.out 216.out 116.out 016.out 155.out 296.out 118.out 287.out 067.out 010.out 238.out 141.out 276.out 114.out 138.out 095.out 297.out 160.out 091.out 081.out 071.out 061.out 037.out 300.out 200.out 100.out 025.out 258.out 185.out 269.out 208.out 039.out 046.out 173.out 222.out 035.out 298.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 236.out 211.out 158.out 182.out 146.out 188.out 293.out 104.out 089.out 086.out 254.out 177.out 225.out 174.out 268.out 135.out 124.out 172.out 063.out 058.out 113.out 262.out 042.out 047.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 015.out 007.out 209.out 053.out 279.out 164.out 154.out 239.out 241.out 002.out 190.out 214.out 074.out 036.out 041.out 057.out 175.out 186.out 005.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 096.out 198.out 008.out 050.out 105.out 257.out 291.out 187.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 028.out 213.out 142.out 013.out 031.out 272.out 078.out 184.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 292.out 130.out 023.out 073.out 030.out 203.out 003.out 245.out 014.out 145.out 159.out 249.out 122.out 076.out 022.out 289.out 006.out 284.out 299.out 224.out 156.out 110.out 149.out 064.out 264.out 218.out 018.out 168.out 021.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 026.out 180.out 253.out 255.out 139.out 090.out 221.out 085.out 294.out 212.out 112.out 094.out 012.out 247.out 107.out 248.out 162.out 147.out 288.out 197.out 196.out 242.out 004.out 189.out 220.out 301.out 120.out /var/lib/xfstests/tests/btrfs 2023-12-07T00:16:59.231 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/ceph/ install 2023-12-07T00:16:59.233 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-07T00:16:59.242 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-07T00:16:59.260 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-07T00:16:59.269 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-12-07T00:16:59.288 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/cifs/ install 2023-12-07T00:16:59.290 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-07T00:16:59.298 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-07T00:16:59.307 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-07T00:16:59.315 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-07T00:16:59.324 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/ext4/ install 2023-12-07T00:16:59.326 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-07T00:16:59.334 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-07T00:16:59.521 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-07T00:16:59.529 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-12-07T00:16:59.726 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/f2fs/ install 2023-12-07T00:16:59.727 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-07T00:16:59.736 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-07T00:16:59.747 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-07T00:16:59.755 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-07T00:16:59.767 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/generic/ install 2023-12-07T00:16:59.771 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-07T00:16:59.780 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-12-07T00:17:01.756 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-07T00:17:01.764 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 220.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 732.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 155.out 118.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 426.out 290.out 573.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 485.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 641.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 612.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 016.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 208.out 433.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 053.out 279.out 276.out 711.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 193.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 089.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 551.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 057.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 158.out 237.out 151.out 227.out 163.out 332.out 661.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 448.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 547.out 150.out 326.out 082.out 480.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 145.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 729.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 686.out 312.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 731.out 374.out 631.out 256.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 730.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 184.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 667.out 512.out 494.out 221.out 212.out 112.out 342.out 012.out 029.out 195.out 554.out 397.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 491.out 081.out 148.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 075.out 582.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 425.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out 476.out /var/lib/xfstests/tests/generic 2023-12-07T00:17:03.765 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/nfs/ install 2023-12-07T00:17:03.767 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-07T00:17:03.775 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-07T00:17:03.784 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-07T00:17:03.793 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-07T00:17:03.802 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/ocfs2/ install 2023-12-07T00:17:03.803 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-07T00:17:03.812 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-07T00:17:03.820 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-07T00:17:03.829 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-07T00:17:03.837 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/overlay/ install 2023-12-07T00:17:03.839 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-07T00:17:03.848 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-07T00:17:04.123 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-07T00:17:04.132 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 018.out 024.out 077.out 069.out 020.out 102.out 014.out 023.out 013.out 031.out 015.out 117.out 082.out 072.out 068.out 063.out 048.out 062.out 038.out 052.out 042.out 075.out 110.out 067.out 029.out 111.out 055.out 112.out 066.out 073.out 078.out 030.out 058.out 104.out 017.out 002.out 043.out 053.out 079.out 036.out 116.out 016.out 101.out 010.out 001.out 022.out 074.out 004.out 103.out 115.out 057.out 113.out 114.out 081.out 026.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 007.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 046.out 021.out 105.out 005.out 107.out 065.out 108.out 080.out 070.out 060.out 050.out 027.out 106.out 009.out 006.out 037.out 044.out 012.out 109.out 033.out 083.out 045.out 040.out 056.out 035.out 019.out 034.out 003.out /var/lib/xfstests/tests/overlay 2023-12-07T00:17:04.410 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/perf/ install 2023-12-07T00:17:04.411 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-07T00:17:04.420 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-07T00:17:04.428 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-07T00:17:04.437 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-07T00:17:04.446 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/selftest/ install 2023-12-07T00:17:04.447 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-07T00:17:04.456 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-07T00:17:04.477 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-07T00:17:04.486 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-12-07T00:17:04.508 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/shared/ install 2023-12-07T00:17:04.510 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-07T00:17:04.518 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-07T00:17:04.532 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-07T00:17:04.540 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-12-07T00:17:04.555 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/tmpfs/ install 2023-12-07T00:17:04.556 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-07T00:17:04.565 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-07T00:17:04.574 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-07T00:17:04.582 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-07T00:17:04.591 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/udf/ install 2023-12-07T00:17:04.592 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-07T00:17:04.601 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-07T00:17:04.609 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-07T00:17:04.618 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-07T00:17:04.627 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.poL8GbUio4xfstests-dev/tests/xfs/ install 2023-12-07T00:17:04.631 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-07T00:17:04.640 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-07T00:17:06.520 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-07T00:17:06.529 INFO:teuthology.orchestra.run.smithi179.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 018.out 593.out 571.out 243.out 592.out 282.out 267.out 728.out 468.out 799.out 284.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 273.out 017.out 492.out 109.out 559.out 506.out 195.out 732.out 268.out 275.out 600.out 113.out 532.out 591.out 281.out 471.out 723.out 255.out 013.out 371.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 165.out 229.out 103.out 003.out 129.out 131.out 383.out 738.out 260.out 718.out 143.out 716.out 161.out 516.out 518.out 416.out 026.out 116.out 043.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 184.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 430.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 542.out 211.out 442.out 188.out 099.out 177.out 721.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 278.out 058.out 741.out 384.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 247.out 568.out 364.out 209.out 441.out 440.out 009.out 740.out 356.out 197.out 341.out 094.out 241.out 501.out 089.out 540.out 514.out 414.out 314.out 214.out 381.out 147.out 041.out 340.out 793.out 358.out 572.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 766.out 508.out 408.out 308.out 208.out 737.out 040.out 304.out 349.out 254.out 537.out 059.out 086.out 249.out 335.out 142.out 235.out 436.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 036.out 316.out 169.out 035.out 579.out 457.out 297.out 393.out 333.out 599.out 476.out 087.out 199.out 739.out 233.out 752.out 736.out 443.out 773.out 053.out 749.out 279.out 133.out 711.out 458.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 484.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 097.out 175.out 186.out 452.out 069.out 252.out 751.out 376.out 724.out 206.out 778.out 190.out 794.out 348.out 466.out 248.out 725.out 785.out 750.out 525.out 496.out 325.out 257.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 015.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 276.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 395.out 515.out 415.out 315.out 215.out 115.out 597.out 027.out 250.out 344.out 051.out 536.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 598.out 005.out 176.out 198.out 008.out 390.out 178.out 405.out 305.out 205.out 105.out 367.out 291.out 437.out 044.out 719.out 323.out 519.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 582.out 232.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 465.out 014.out 758.out 387.out 594.out 438.out 265.out 289.out 574.out 755.out 548.out 299.out 419.out 521.out 581.out 595.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 747.out 126.out 025.out 121.out 447.out 761.out 580.out 021.out 485.out 347.out 077.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 002.out 585.out 162.out 288.out 050.out 396.out 446.out 350.out 354.out 429.out 187.out 360.out 543.out 261.out 734.out 045.out 292.out 482.out 729.out 104.out 048.out 062.out 529.out 231.out 343.out 503.out 526.out 329.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 277.out 373.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 491.out 767.out 016.out 046.out 488.out 731.out 782.out 374.out 583.out 285.out 127.out 328.out 359.out 531.out 301.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 081.out 024.out 513.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 576.out 569.out 454.out 259.out 449.out 327.out 330.out 067.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 345.out 355.out 386.out 560.out 055.out 334.out 245.out 522.out 787.out 745.out 422.out 394.out 539.out 524.out 122.out 234.out 022.out 424.out 779.out 490.out 435.out 353.out 423.out 134.out 154.out 271.out 064.out 418.out 318.out 218.out 118.out 757.out 377.out 172.out 079.out 469.out 054.out 049.out 765.out 776.out 456.out 180.out 378.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 764.out 283.out 554.out 397.out 185.out 596.out 720.out 481.out 196.out 520.out 242.out 420.out 478.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 417.out 317.out 365.out 217.out 117.out 475.out 072.out 068.out 474.out 038.out 084.out 056.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 783.out 194.out 170.out 286.out 756.out 545.out 714.out 157.out 710.out 510.out 413.out 410.out 310.out 601.out 210.out 401.out 201.out 001.out 495.out 362.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 746.out 083.out 800.out 777.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 298.out 567.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 346.out 391.out 004.out 557.out 453.out 236.out 078.out 159.out 566.out 735.out 085.out 588.out 504.out 404.out 558.out 204.out 535.out 795.out 733.out 544.out /var/lib/xfstests/tests/xfs 2023-12-07T00:17:08.420 INFO:teuthology.orchestra.run.smithi179.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-07T00:17:08.428 INFO:teuthology.orchestra.run.smithi179.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-07T00:17:08.436 INFO:teuthology.orchestra.run.smithi179.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-07T00:17:08.445 INFO:teuthology.orchestra.run.smithi179.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-07T00:17:08.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T00:17:08.456 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec ls tests/generic) 2023-12-07T00:17:08.515 INFO:teuthology.orchestra.run.smithi179.stdout:001 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:001.out 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:002 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:002.out 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:003 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:003.out 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:004 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:004.out 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:005 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:005.out 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:006 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:006.out 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:007 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:007.out 2023-12-07T00:17:08.516 INFO:teuthology.orchestra.run.smithi179.stdout:008 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:008.out 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:009 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:009.out 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:010 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:010.out 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:011 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:011.out 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:012 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:012.out 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:013 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:013.out 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:014 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:014.out 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:015 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:015.out 2023-12-07T00:17:08.517 INFO:teuthology.orchestra.run.smithi179.stdout:016 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:016.out 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:017 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:017.out 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:018 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:018.out 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:019 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:019.out 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:020 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:020.out 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:021 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:021.out 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:022 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:022.out 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:023 2023-12-07T00:17:08.518 INFO:teuthology.orchestra.run.smithi179.stdout:023.out 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:024 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:024.out 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:025 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:025.out 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:026 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:026.out 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:027 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:027.out 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:028 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:028.out 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:029 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:029.out 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:030 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:030.out 2023-12-07T00:17:08.519 INFO:teuthology.orchestra.run.smithi179.stdout:031 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:031.out 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:032 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:032.out 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:033 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:033.out 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:034 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:034.out 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:035 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:035.cfg 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:035.out.default 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:035.out.nfs 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:036 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:036.out 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:037 2023-12-07T00:17:08.520 INFO:teuthology.orchestra.run.smithi179.stdout:037.out 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:038 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:038.out 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:039 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:039.out 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:040 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:040.out 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:041 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:041.out 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:042 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:042.out 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:043 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:043.out 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:044 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:044.out 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:045 2023-12-07T00:17:08.521 INFO:teuthology.orchestra.run.smithi179.stdout:045.out 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:046 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:046.out 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:047 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:047.out 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:048 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:048.out 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:049 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:049.out 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:050 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:050.cfg 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:050.out.default 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:050.out.nojournal 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:050.out.xfsquota 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:051 2023-12-07T00:17:08.522 INFO:teuthology.orchestra.run.smithi179.stdout:051.out 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:052 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:052.out 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:053 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:053.out 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:054 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:054.out 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:055 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:055.out 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:056 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:056.out 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:057 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:057.out 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:058 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:058.out 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:059 2023-12-07T00:17:08.523 INFO:teuthology.orchestra.run.smithi179.stdout:059.out 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:060 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:060.out 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:061 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:061.out 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:062 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:062.out 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:063 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:063.out 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:064 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:064.out 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:065 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:065.out 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:066 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:066.out 2023-12-07T00:17:08.524 INFO:teuthology.orchestra.run.smithi179.stdout:067 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:067.out 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:068 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:068.out 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:069 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:069.out 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:070 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:070.out 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:071 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:071.out 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:072 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:072.out 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:073 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:073.out 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:074 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:074.out 2023-12-07T00:17:08.525 INFO:teuthology.orchestra.run.smithi179.stdout:075 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:075.out 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:076 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:076.out 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:077 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:077.out 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:078 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:078.out 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:079 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:079.out 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:080 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:080.out 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:081 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:081.out 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:082 2023-12-07T00:17:08.526 INFO:teuthology.orchestra.run.smithi179.stdout:082.out 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:083 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:083.out 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:084 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:084.out 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:085 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:085.out 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:086 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:086.out 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:087 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:087.out 2023-12-07T00:17:08.527 INFO:teuthology.orchestra.run.smithi179.stdout:088 2023-12-07T00:17:08.528 INFO:teuthology.orchestra.run.smithi179.stdout:088.out 2023-12-07T00:17:08.528 INFO:teuthology.orchestra.run.smithi179.stdout:089 2023-12-07T00:17:08.528 INFO:teuthology.orchestra.run.smithi179.stdout:089.out 2023-12-07T00:17:08.528 INFO:teuthology.orchestra.run.smithi179.stdout:090 2023-12-07T00:17:08.528 INFO:teuthology.orchestra.run.smithi179.stdout:090.out 2023-12-07T00:17:08.528 INFO:teuthology.orchestra.run.smithi179.stdout:091 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:091.out 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:092 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:092.out 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:093 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:093.out 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:094 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:094.out 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:095 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:095.out 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:096 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:096.out 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:097 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:097.out 2023-12-07T00:17:08.529 INFO:teuthology.orchestra.run.smithi179.stdout:098 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:098.out 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:099 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:099.out 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:100 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:100.out 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:101 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:101.out 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:102 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:102.out 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:103 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:103.out 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:104 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:104.out 2023-12-07T00:17:08.530 INFO:teuthology.orchestra.run.smithi179.stdout:105 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:105.out 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:106 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:106.out 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:107 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:107.out 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:108 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:108.out 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:109 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:109.out 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:110 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:110.out 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:111 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:111.out 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:112 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:112.out 2023-12-07T00:17:08.531 INFO:teuthology.orchestra.run.smithi179.stdout:113 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:113.out 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:114 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:114.out 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:115 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:115.out 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:116 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:116.out 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:117 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:117.out 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:118 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:118.out 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:119 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:119.out 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:120 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:120.out 2023-12-07T00:17:08.532 INFO:teuthology.orchestra.run.smithi179.stdout:121 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:121.out 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:122 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:122.out 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:123 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:123.out 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:124 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:124.out 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:125 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:125.out 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:126 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:126.out 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:127 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:127.out 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:128 2023-12-07T00:17:08.533 INFO:teuthology.orchestra.run.smithi179.stdout:128.out 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:129 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:129.out 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:130 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:130.out 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:131 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:131.out 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:132 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:132.out 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:133 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:133.out 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:134 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:134.out 2023-12-07T00:17:08.534 INFO:teuthology.orchestra.run.smithi179.stdout:135 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:135.out 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:136 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:136.out 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:137 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:137.out 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:138 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:138.out 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:139 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:139.out 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:140 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:140.out 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:141 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:141.out 2023-12-07T00:17:08.535 INFO:teuthology.orchestra.run.smithi179.stdout:142 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:142.out 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:143 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:143.out 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:144 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:144.out 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:145 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:145.out 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:146 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:146.out 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:147 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:147.out 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:148 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:148.out 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:149 2023-12-07T00:17:08.536 INFO:teuthology.orchestra.run.smithi179.stdout:149.out 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:150 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:150.out 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:151 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:151.out 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:152 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:152.out 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:153 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:153.out 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:154 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:154.out 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:155 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:155.out 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:156 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:156.out 2023-12-07T00:17:08.537 INFO:teuthology.orchestra.run.smithi179.stdout:157 2023-12-07T00:17:08.538 INFO:teuthology.orchestra.run.smithi179.stdout:157.out 2023-12-07T00:17:08.538 INFO:teuthology.orchestra.run.smithi179.stdout:158 2023-12-07T00:17:08.538 INFO:teuthology.orchestra.run.smithi179.stdout:158.out 2023-12-07T00:17:08.538 INFO:teuthology.orchestra.run.smithi179.stdout:159 2023-12-07T00:17:08.538 INFO:teuthology.orchestra.run.smithi179.stdout:159.out 2023-12-07T00:17:08.538 INFO:teuthology.orchestra.run.smithi179.stdout:160 2023-12-07T00:17:08.538 INFO:teuthology.orchestra.run.smithi179.stdout:160.out 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:161 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:161.out 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:162 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:162.out 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:163 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:163.out 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:164 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:164.out 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:165 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:165.out 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:166 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:166.out 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:167 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:167.out 2023-12-07T00:17:08.539 INFO:teuthology.orchestra.run.smithi179.stdout:168 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:168.out 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:169 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:169.out 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:170 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:170.out 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:171 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:171.out 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:172 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:172.out 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:173 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:173.out 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:174 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:174.out 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:175 2023-12-07T00:17:08.540 INFO:teuthology.orchestra.run.smithi179.stdout:175.out 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:176 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:176.out 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:177 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:177.out 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:178 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:178.out 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:179 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:179.out 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:180 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:180.out 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:181 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:181.out 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:182 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:182.out 2023-12-07T00:17:08.541 INFO:teuthology.orchestra.run.smithi179.stdout:183 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:183.out 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:184 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:184.out 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:185 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:185.out 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:186 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:186.out 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:187 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:187.out 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:188 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:188.out 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:189 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:189.out 2023-12-07T00:17:08.542 INFO:teuthology.orchestra.run.smithi179.stdout:190 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:190.out 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:191 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:191.out 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:192 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:192.out 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:193 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:193.out 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:194 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:194.out 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:195 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:195.out 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:196 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:196.out 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:197 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:197.out 2023-12-07T00:17:08.543 INFO:teuthology.orchestra.run.smithi179.stdout:198 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:198.out 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:199 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:199.out 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:200 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:200.out 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:201 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:201.out 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:202 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:202.out 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:203 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:203.out 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:204 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:204.out 2023-12-07T00:17:08.544 INFO:teuthology.orchestra.run.smithi179.stdout:205 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:205.out 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:206 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:206.out 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:207 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:207.out 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:208 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:208.out 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:209 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:209.out 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:210 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:210.out 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:211 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:211.out 2023-12-07T00:17:08.545 INFO:teuthology.orchestra.run.smithi179.stdout:212 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:212.out 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:213 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:213.out 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:214 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:214.out 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:215 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:215.out 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:216 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:216.out 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:217 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:217.out 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:218 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:218.out 2023-12-07T00:17:08.546 INFO:teuthology.orchestra.run.smithi179.stdout:219 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:219.out 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:220 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:220.out 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:221 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:221.out 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:222 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:222.out 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:223 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:223.out 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:224 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:224.out 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:225 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:225.out 2023-12-07T00:17:08.547 INFO:teuthology.orchestra.run.smithi179.stdout:226 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:226.out 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:227 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:227.out 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:228 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:228.out 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:229 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:229.out 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:230 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:230.out 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:231 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:231.out 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:232 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:232.out 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:233 2023-12-07T00:17:08.548 INFO:teuthology.orchestra.run.smithi179.stdout:233.out 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:234 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:234.out 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:235 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:235.out 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:236 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:236.out 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:237 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:237.out 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:238 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:238.out 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:239 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:239.out 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:240 2023-12-07T00:17:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:240.out 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:241 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:241.out 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:242 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:242.out 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:243 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:243.out 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:244 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:244.out 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:245 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:245.out 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:246 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:246.out 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:247 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:247.out 2023-12-07T00:17:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:248 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:248.out 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:249 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:249.out 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:250 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:250.out 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:251 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:251.out 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:252 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:252.out 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:253 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:253.out 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:254 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:254.out 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:255 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:255.out 2023-12-07T00:17:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:256 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:256.out 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:257 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:257.out 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:258 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:258.out 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:259 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:259.out 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:260 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:260.out 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:261 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:261.out 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:262 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:262.out 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:263 2023-12-07T00:17:08.552 INFO:teuthology.orchestra.run.smithi179.stdout:263.out 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:264 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:264.out 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:265 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:265.out 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:266 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:266.out 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:267 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:267.out 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:268 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:268.out 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:269 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:269.out 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:270 2023-12-07T00:17:08.553 INFO:teuthology.orchestra.run.smithi179.stdout:270.out 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:271 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:271.out 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:272 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:272.out 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:273 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:273.out 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:274 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:274.out 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:275 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:275.out 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:276 2023-12-07T00:17:08.554 INFO:teuthology.orchestra.run.smithi179.stdout:276.out 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:277 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:277.out 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:278 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:278.out 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:279 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:279.out 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:280 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:280.out 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:281 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:281.out 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:282 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:282.out 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:283 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:283.out 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:284 2023-12-07T00:17:08.555 INFO:teuthology.orchestra.run.smithi179.stdout:284.out 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:285 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:285.out 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:286 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:286.out 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:287 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:287.out 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:288 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:288.out 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:289 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:289.out 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:290 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:290.out 2023-12-07T00:17:08.556 INFO:teuthology.orchestra.run.smithi179.stdout:291 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:291.out 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:292 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:292.out 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:293 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:293.out 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:294 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:294.out 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:295 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:295.out 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:296 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:296.out 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:297 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:297.out 2023-12-07T00:17:08.557 INFO:teuthology.orchestra.run.smithi179.stdout:298 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:298.out 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:299 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:299.out 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:300 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:300.out 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:301 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:301.out 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:302 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:302.out 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:303 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:303.out 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:304 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:304.out 2023-12-07T00:17:08.558 INFO:teuthology.orchestra.run.smithi179.stdout:305 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:305.out 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:306 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:306.out 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:307 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:307.out 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:308 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:308.out 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:309 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:309.out 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:310 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:310.out 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:311 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:311.out 2023-12-07T00:17:08.559 INFO:teuthology.orchestra.run.smithi179.stdout:312 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:312.out 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:313 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:313.out 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:314 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:314.out 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:315 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:315.out 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:316 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:316.out 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:317 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:317.out 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:318 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:318.out 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:319 2023-12-07T00:17:08.560 INFO:teuthology.orchestra.run.smithi179.stdout:319.out 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:320 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:320.out 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:321 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:321.out 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:322 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:322.out 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:323 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:323.out 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:324 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:324.out 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:325 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:325.out 2023-12-07T00:17:08.561 INFO:teuthology.orchestra.run.smithi179.stdout:326 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:326.out 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:327 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:327.out 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:328 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:328.out 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:329 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:329.out 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:330 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:330.out 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:331 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:331.out 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:332 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:332.out 2023-12-07T00:17:08.562 INFO:teuthology.orchestra.run.smithi179.stdout:333 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:333.out 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:334 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:334.out 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:335 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:335.out 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:336 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:336.out 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:337 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:337.out 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:338 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:338.out 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:339 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:339.out 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:340 2023-12-07T00:17:08.563 INFO:teuthology.orchestra.run.smithi179.stdout:340.out 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:341 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:341.out 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:342 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:342.out 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:343 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:343.out 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:344 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:344.out 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:345 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:345.out 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:346 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:346.out 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:347 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:347.out 2023-12-07T00:17:08.564 INFO:teuthology.orchestra.run.smithi179.stdout:348 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:348.out 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:349 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:349.out 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:350 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:350.out 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:351 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:351.out 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:352 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:352.out 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:353 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:353.out 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:354 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:354.out 2023-12-07T00:17:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:355 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:355.out 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:356 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:356.out 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:357 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:357.out 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:358 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:358.out 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:359 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:359.out 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:360 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:360.out 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:361 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:361.out 2023-12-07T00:17:08.566 INFO:teuthology.orchestra.run.smithi179.stdout:362 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:362.out 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:363 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:363.out 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:364 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:364.out 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:365 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:365.out 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:366 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:366.out 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:367 2023-12-07T00:17:08.567 INFO:teuthology.orchestra.run.smithi179.stdout:367.out 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:368 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:368.out 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:369 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:369.out 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:370 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:370.out 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:371 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:371.out 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:372 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:372.out 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:373 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:373.out 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:374 2023-12-07T00:17:08.568 INFO:teuthology.orchestra.run.smithi179.stdout:374.out 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:375 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:375.out 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:376 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:376.out 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:377 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:377.out 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:378 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:378.out 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:379 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:379.out 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:380 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:380.out 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:381 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:381.out 2023-12-07T00:17:08.569 INFO:teuthology.orchestra.run.smithi179.stdout:382 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:382.out 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:383 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:383.out 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:384 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:384.out 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:385 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:385.out 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:386 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:386.out 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:387 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:387.out 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:388 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:388.out 2023-12-07T00:17:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:389 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:389.out 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:390 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:390.out 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:391 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:391.out 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:392 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:392.out 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:393 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:393.out 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:394 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:394.out 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:395 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:395.out 2023-12-07T00:17:08.571 INFO:teuthology.orchestra.run.smithi179.stdout:396 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:396.out 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:397 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:397.out 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:398 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:398.out 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:399 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:399.out 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:400 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:400.out 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:401 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:401.out 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:402 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:402.out 2023-12-07T00:17:08.572 INFO:teuthology.orchestra.run.smithi179.stdout:403 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:403.out 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:404 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:404.out 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:405 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:405.out 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:406 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:406.out 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:407 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:407.out 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:408 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:408.out 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:409 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:409.out 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:410 2023-12-07T00:17:08.573 INFO:teuthology.orchestra.run.smithi179.stdout:410.out 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:411 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:411.out 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:412 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:412.out 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:413 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:413.out 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:414 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:414.out 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:415 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:415.out 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:416 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:416.out 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:417 2023-12-07T00:17:08.574 INFO:teuthology.orchestra.run.smithi179.stdout:417.out 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:418 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:418.out 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:419 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:419.out 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:420 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:420.out 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:421 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:421.out 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:422 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:422.out 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:423 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:423.out 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:424 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:424.out 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:425 2023-12-07T00:17:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:425.out 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:426 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:426.out 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:427 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:427.out 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:428 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:428.out 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:429 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:429.out 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:430 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:430.out 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:431 2023-12-07T00:17:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:431.out 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:432 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:432.out 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:433 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:433.out 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:434 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:434.out 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:435 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:435.out 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:436 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:436.out 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:437 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:437.out 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:438 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:438.out 2023-12-07T00:17:08.577 INFO:teuthology.orchestra.run.smithi179.stdout:439 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:439.out 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:440 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:440.out 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:441 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:441.out 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:442 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:442.out 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:443 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:443.out 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:444 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:444.out 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:445 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:445.out 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:446 2023-12-07T00:17:08.578 INFO:teuthology.orchestra.run.smithi179.stdout:446.out 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:447 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:447.out 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:448 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:448.out 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:449 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:449.out 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:450 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:450.out 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:451 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:451.out 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:452 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:452.out 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:453 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:453.out 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:454 2023-12-07T00:17:08.579 INFO:teuthology.orchestra.run.smithi179.stdout:454.out 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:455 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:455.out 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:456 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:456.out 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:457 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:457.out 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:458 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:458.out 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:459 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:459.out 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:460 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:460.out 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:461 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:461.out 2023-12-07T00:17:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:462 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:462.out 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:463 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:463.out 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:464 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:464.out 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:465 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:465.out 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:466 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:466.out 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:467 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:467.out 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:468 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:468.out 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:469 2023-12-07T00:17:08.581 INFO:teuthology.orchestra.run.smithi179.stdout:469.out 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:470 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:470.out 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:471 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:471.out 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:472 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:472.out 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:473 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:473.out 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:474 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:474.out 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:475 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:475.out 2023-12-07T00:17:08.582 INFO:teuthology.orchestra.run.smithi179.stdout:476 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:476.out 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:477 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:477.out 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:478 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:478.out 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:479 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:479.out 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:480 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:480.out 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:481 2023-12-07T00:17:08.583 INFO:teuthology.orchestra.run.smithi179.stdout:481.out 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:482 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:482.out 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:483 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:483.out 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:484 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:484.out 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:485 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:485.out 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:486 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:486.out 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:487 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:487.out 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:488 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:488.out 2023-12-07T00:17:08.584 INFO:teuthology.orchestra.run.smithi179.stdout:489 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:489.out 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:490 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:490.out 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:491 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:491.out 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:492 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:492.out 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:493 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:493.out 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:494 2023-12-07T00:17:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:494.out 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:495 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:495.out 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:496 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:496.out 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:497 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:497.out 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:498 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:498.out 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:499 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:499.out 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:500 2023-12-07T00:17:08.586 INFO:teuthology.orchestra.run.smithi179.stdout:500.out 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:501 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:501.out 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:502 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:502.out 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:503 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:503.out 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:504 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:504.out 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:505 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:505.out 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:506 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:506.out 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:507 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:507.out 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:508 2023-12-07T00:17:08.587 INFO:teuthology.orchestra.run.smithi179.stdout:508.out 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:509 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:509.out 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:510 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:510.out 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:511 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:511.out 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:512 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:512.out 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:513 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:513.out 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:514 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:514.out 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:515 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:515.out 2023-12-07T00:17:08.588 INFO:teuthology.orchestra.run.smithi179.stdout:516 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:516.out 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:517 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:517.out 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:518 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:518.out 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:519 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:519.out 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:520 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:520.out 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:521 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:521.out 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:522 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:522.out 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:523 2023-12-07T00:17:08.589 INFO:teuthology.orchestra.run.smithi179.stdout:523.out 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:524 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:524.out 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:525 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:525.out 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:526 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:526.out 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:527 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:527.out 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:528 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:528.out 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:529 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:529.out 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:530 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:530.out 2023-12-07T00:17:08.590 INFO:teuthology.orchestra.run.smithi179.stdout:531 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:531.out 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:532 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:532.out 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:533 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:533.out 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:534 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:534.out 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:535 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:535.out 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:536 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:536.out 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:537 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:537.out 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:538 2023-12-07T00:17:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:538.out 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:539 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:539.out 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:540 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:540.out 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:541 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:541.out 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:542 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:542.out 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:543 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:543.out 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:544 2023-12-07T00:17:08.592 INFO:teuthology.orchestra.run.smithi179.stdout:544.out 2023-12-07T00:17:08.593 INFO:teuthology.orchestra.run.smithi179.stdout:545 2023-12-07T00:17:08.593 INFO:teuthology.orchestra.run.smithi179.stdout:545.out 2023-12-07T00:17:08.593 INFO:teuthology.orchestra.run.smithi179.stdout:546 2023-12-07T00:17:08.594 INFO:teuthology.orchestra.run.smithi179.stdout:546.out 2023-12-07T00:17:08.594 INFO:teuthology.orchestra.run.smithi179.stdout:547 2023-12-07T00:17:08.594 INFO:teuthology.orchestra.run.smithi179.stdout:547.out 2023-12-07T00:17:08.594 INFO:teuthology.orchestra.run.smithi179.stdout:548 2023-12-07T00:17:08.594 INFO:teuthology.orchestra.run.smithi179.stdout:548.out 2023-12-07T00:17:08.594 INFO:teuthology.orchestra.run.smithi179.stdout:549 2023-12-07T00:17:08.594 INFO:teuthology.orchestra.run.smithi179.stdout:549.out 2023-12-07T00:17:08.594 INFO:teuthology.orchestra.run.smithi179.stdout:550 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:550.out 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:551 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:551.out 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:552 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:552.out 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:553 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:553.out 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:554 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:554.out 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:555 2023-12-07T00:17:08.595 INFO:teuthology.orchestra.run.smithi179.stdout:555.out 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:556 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:556.out 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:557 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:557.out 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:558 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:558.out 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:559 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:559.out 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:560 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:560.out 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:561 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:561.out 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:562 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:562.out 2023-12-07T00:17:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:563 2023-12-07T00:17:08.597 INFO:teuthology.orchestra.run.smithi179.stdout:563.out 2023-12-07T00:17:08.597 INFO:teuthology.orchestra.run.smithi179.stdout:564 2023-12-07T00:17:08.597 INFO:teuthology.orchestra.run.smithi179.stdout:564.out 2023-12-07T00:17:08.597 INFO:teuthology.orchestra.run.smithi179.stdout:565 2023-12-07T00:17:08.597 INFO:teuthology.orchestra.run.smithi179.stdout:565.out 2023-12-07T00:17:08.597 INFO:teuthology.orchestra.run.smithi179.stdout:566 2023-12-07T00:17:08.597 INFO:teuthology.orchestra.run.smithi179.stdout:566.out 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:567 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:567.out 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:568 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:568.out 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:569 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:569.out 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:570 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:570.out 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:571 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:571.out 2023-12-07T00:17:08.598 INFO:teuthology.orchestra.run.smithi179.stdout:572 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:572.out 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:573 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:573.out 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:574 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:574.out 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:575 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:575.out 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:576 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:576.out 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:577 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:577.out 2023-12-07T00:17:08.599 INFO:teuthology.orchestra.run.smithi179.stdout:578 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:578.out 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:579 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:579.out 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:580 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:580.out 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:581 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:581.out 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:582 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:582.out 2023-12-07T00:17:08.600 INFO:teuthology.orchestra.run.smithi179.stdout:583 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:583.out 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:584 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:584.out 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:585 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:585.out 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:586 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:586.out 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:587 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:587.out 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:588 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:588.out 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:589 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:589.out 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:590 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:590.out 2023-12-07T00:17:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:591 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:591.out 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:592 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:592.out 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:593 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:593.out 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:594 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:594.out 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:595 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:595.out 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:596 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:596.out 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:597 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:597.out 2023-12-07T00:17:08.602 INFO:teuthology.orchestra.run.smithi179.stdout:598 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:598.out 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:599 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:599.out 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:600 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:600.out 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:601 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:601.out 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:602 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:602.out 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:603 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:603.out 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:604 2023-12-07T00:17:08.603 INFO:teuthology.orchestra.run.smithi179.stdout:604.out 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:605 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:605.out 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:606 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:606.out 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:607 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:607.out 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:608 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:608.out 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:609 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:609.out 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:610 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:610.out 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:611 2023-12-07T00:17:08.604 INFO:teuthology.orchestra.run.smithi179.stdout:611.out 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:612 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:612.out 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:613 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:613.out 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:614 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:614.out 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:615 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:615.out 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:616 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:616.out 2023-12-07T00:17:08.605 INFO:teuthology.orchestra.run.smithi179.stdout:617 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:617.out 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:618 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:618.out 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:619 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:619.out 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:620 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:620.out 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:621 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:621.out 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:622 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:622.out 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:623 2023-12-07T00:17:08.606 INFO:teuthology.orchestra.run.smithi179.stdout:623.out 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:624 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:624.out 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:625 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:625.out 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:626 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:626.out 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:627 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:627.out 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:628 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:628.out 2023-12-07T00:17:08.607 INFO:teuthology.orchestra.run.smithi179.stdout:629 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:629.out 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:630 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:630.out 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:631 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:631.out 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:632 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:632.out 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:633 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:633.out 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:634 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:634.out 2023-12-07T00:17:08.608 INFO:teuthology.orchestra.run.smithi179.stdout:635 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:635.out 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:636 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:636.out 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:637 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:637.out 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:638 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:638.out 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:639 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:639.out 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:640 2023-12-07T00:17:08.609 INFO:teuthology.orchestra.run.smithi179.stdout:640.out 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:641 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:641.out 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:642 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:642.out 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:643 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:643.out 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:644 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:644.out 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:645 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:645.out 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:646 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:646.out 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:647 2023-12-07T00:17:08.610 INFO:teuthology.orchestra.run.smithi179.stdout:647.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:648 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:648.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:649 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:649.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:650 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:650.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:651 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:651.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:652 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:652.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:653 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:653.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:654 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:654.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:655 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:655.out 2023-12-07T00:17:08.611 INFO:teuthology.orchestra.run.smithi179.stdout:656 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:656.out 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:657 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:657.out 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:658 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:658.out 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:659 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:659.out 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:660 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:660.out 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:661 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:661.out 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:662 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:662.out 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:663 2023-12-07T00:17:08.612 INFO:teuthology.orchestra.run.smithi179.stdout:663.out 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:664 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:664.out 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:665 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:665.out 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:666 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:666.out 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:667 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:667.out 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:668 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:668.out 2023-12-07T00:17:08.613 INFO:teuthology.orchestra.run.smithi179.stdout:669 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:669.out 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:670 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:670.out 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:671 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:671.out 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:672 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:672.out 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:673 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:673.out 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:674 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:674.out 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:675 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:675.out 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:676 2023-12-07T00:17:08.614 INFO:teuthology.orchestra.run.smithi179.stdout:676.out 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:677 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:677.out 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:678 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:678.out 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:679 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:679.out 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:680 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:680.out 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:681 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:681.out 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:682 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:682.out 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:683 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:683.out 2023-12-07T00:17:08.615 INFO:teuthology.orchestra.run.smithi179.stdout:684 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:684.out 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:685 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:685.out 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:686 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:686.out 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:687 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:687.out 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:688 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:688.out 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:689 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:689.out 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:690 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:690.out 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:691 2023-12-07T00:17:08.616 INFO:teuthology.orchestra.run.smithi179.stdout:691.out 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:692 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:692.out 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:693 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:693.out 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:694 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:694.out 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:695 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:695.out 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:696 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:696.out 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:697 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:697.out 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:698 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:698.out 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:699 2023-12-07T00:17:08.617 INFO:teuthology.orchestra.run.smithi179.stdout:699.out 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:700 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:700.out 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:701 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:701.out 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:702 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:702.out 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:703 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:703.out 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:704 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:704.out 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:705 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:705.out 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:706 2023-12-07T00:17:08.618 INFO:teuthology.orchestra.run.smithi179.stdout:706.out 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:707 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:707.out 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:708 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:708.out 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:709 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:709.out 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:710 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:710.out 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:711 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:711.out 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:712 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:712.out 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:713 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:713.out 2023-12-07T00:17:08.619 INFO:teuthology.orchestra.run.smithi179.stdout:714 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:714.out 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:715 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:715.out 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:716 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:716.out 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:717 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:717.out 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:718 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:718.out 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:719 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:719.out 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:720 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:720.out 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:721 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:721.out 2023-12-07T00:17:08.620 INFO:teuthology.orchestra.run.smithi179.stdout:722 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:722.out 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:723 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:723.out 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:724 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:724.out 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:725 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:725.out 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:726 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:726.out 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:727 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:727.out 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:728 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:728.out 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:729 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:729.out 2023-12-07T00:17:08.621 INFO:teuthology.orchestra.run.smithi179.stdout:730 2023-12-07T00:17:08.622 INFO:teuthology.orchestra.run.smithi179.stdout:730.out 2023-12-07T00:17:08.622 INFO:teuthology.orchestra.run.smithi179.stdout:731 2023-12-07T00:17:08.622 INFO:teuthology.orchestra.run.smithi179.stdout:731.out 2023-12-07T00:17:08.622 INFO:teuthology.orchestra.run.smithi179.stdout:732 2023-12-07T00:17:08.622 INFO:teuthology.orchestra.run.smithi179.stdout:732.out 2023-12-07T00:17:08.622 INFO:teuthology.orchestra.run.smithi179.stdout:group.list 2023-12-07T00:17:08.622 INFO:teuthology.orchestra.run.smithi179.stdout:Makefile 2023-12-07T00:17:08.622 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-12-07T00:17:08.843 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:17:08.847 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:17:08.847 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:17:08.848 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:17:08.848 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:12.885 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:17:12.888 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:17:13.504 INFO:teuthology.orchestra.run.smithi179.stdout:generic/001 4s 2023-12-07T00:17:13.509 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/001 2023-12-07T00:17:13.509 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:17:13.511 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:14.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:17:14.217 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-12-07T00:17:14.429 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:17:14.433 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:17:14.433 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:17:14.434 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:17:14.434 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:14.924 INFO:teuthology.orchestra.run.smithi179.stdout:generic/002 0s 2023-12-07T00:17:14.929 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/002 2023-12-07T00:17:14.929 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:17:14.931 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:15.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:17:15.065 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-12-07T00:17:15.339 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:17:15.344 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:17:15.344 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:17:15.344 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:17:15.345 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:15.639 INFO:teuthology.orchestra.run.smithi179.stdout:generic/003 [not run] atime not maintained by ceph 2023-12-07T00:17:15.643 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/003 2023-12-07T00:17:15.643 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/003 2023-12-07T00:17:15.643 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:17:15.645 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:15.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:17:15.672 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-12-07T00:17:15.876 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:17:15.881 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:17:15.881 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:17:15.882 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:17:15.882 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:16.191 INFO:teuthology.orchestra.run.smithi179.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-07T00:17:16.195 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/004 2023-12-07T00:17:16.195 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/004 2023-12-07T00:17:16.195 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:17:16.197 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:16.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:17:16.220 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-12-07T00:17:16.437 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:17:16.441 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:17:16.441 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:17:16.442 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:17:16.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:16.887 INFO:teuthology.orchestra.run.smithi179.stdout:generic/005 0s 2023-12-07T00:17:16.892 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/005 2023-12-07T00:17:16.892 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:17:16.894 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:16.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:17:16.975 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-12-07T00:17:17.198 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:17:17.202 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:17:17.202 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:17:17.203 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:17:17.203 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:41.027 INFO:teuthology.orchestra.run.smithi179.stdout:generic/006 24s 2023-12-07T00:17:41.031 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/006 2023-12-07T00:17:41.031 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:17:41.033 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:41.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:17:41.104 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-12-07T00:17:41.498 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:17:41.502 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:17:41.503 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:17:41.504 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:17:41.504 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:17:42.957 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:17:42.959 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:18:13.022 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:18:13.025 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:18:29.756 INFO:teuthology.orchestra.run.smithi179.stdout:generic/007 48s 2023-12-07T00:18:29.761 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/007 2023-12-07T00:18:29.761 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:18:29.763 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:18:29.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:18:29.857 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-12-07T00:18:30.166 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:18:30.170 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:18:30.171 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:18:30.172 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:18:30.172 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:18:30.545 INFO:teuthology.orchestra.run.smithi179.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-07T00:18:30.549 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/008 2023-12-07T00:18:30.549 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/008 2023-12-07T00:18:30.549 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:18:30.551 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:18:30.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:18:30.574 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-12-07T00:18:30.779 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:18:30.783 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:18:30.783 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:18:30.784 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:18:30.784 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:18:31.185 INFO:teuthology.orchestra.run.smithi179.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-07T00:18:31.189 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/009 2023-12-07T00:18:31.190 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/009 2023-12-07T00:18:31.190 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:18:31.192 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:18:31.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:18:31.228 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-12-07T00:18:31.434 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:18:31.439 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:18:31.439 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:18:31.441 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:18:31.441 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:18:32.063 INFO:teuthology.orchestra.run.smithi179.stdout:generic/010 1s 2023-12-07T00:18:32.067 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/010 2023-12-07T00:18:32.067 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:18:32.069 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:18:32.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:18:32.116 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-12-07T00:18:32.339 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:18:32.342 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:18:32.343 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:18:32.344 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:18:32.344 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:18:43.410 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:18:43.420 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:19:02.097 INFO:teuthology.orchestra.run.smithi179.stdout:generic/011 30s 2023-12-07T00:19:02.172 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/011 2023-12-07T00:19:02.172 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:19:02.176 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:19:02.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:19:02.429 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-12-07T00:19:02.641 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:19:02.645 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:19:02.646 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:19:02.646 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:19:02.647 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:19:03.048 INFO:teuthology.orchestra.run.smithi179.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:19:03.052 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/012 2023-12-07T00:19:03.052 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/012 2023-12-07T00:19:03.052 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:19:03.054 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:19:03.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:19:03.107 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-12-07T00:19:03.405 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:19:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:19:03.409 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:19:03.410 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:19:03.410 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:19:13.473 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:19:13.476 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:19:43.904 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:19:43.907 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:20:08.337 INFO:teuthology.orchestra.run.smithi179.stdout:generic/013 65s 2023-12-07T00:20:08.342 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/013 2023-12-07T00:20:08.342 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:20:08.345 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:20:08.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:20:08.381 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-12-07T00:20:08.704 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:20:08.711 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:20:08.711 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:20:08.712 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:20:08.713 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:20:14.241 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:20:14.245 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:20:44.618 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:20:44.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:21:14.714 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:21:14.717 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:21:45.138 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:21:45.147 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:22:15.467 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:22:15.471 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:22:45.560 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:22:45.572 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:23:15.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:23:15.979 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:23:46.101 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:23:46.104 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:24:16.180 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:24:16.184 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:24:31.808 INFO:teuthology.orchestra.run.smithi179.stdout:generic/014 263s 2023-12-07T00:24:31.872 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/014 2023-12-07T00:24:31.872 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:31.874 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:31.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:31.912 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-12-07T00:24:32.239 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:32.243 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:32.243 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:32.245 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:32.245 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:32.694 INFO:teuthology.orchestra.run.smithi179.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T00:24:32.703 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/015 2023-12-07T00:24:32.703 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/015 2023-12-07T00:24:32.703 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:32.705 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:32.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:32.733 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-12-07T00:24:33.012 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:33.018 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:33.018 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:33.020 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:33.020 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:33.616 INFO:teuthology.orchestra.run.smithi179.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:24:33.625 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/016 2023-12-07T00:24:33.625 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/016 2023-12-07T00:24:33.625 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:33.627 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:33.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:33.900 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-12-07T00:24:34.289 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:34.293 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:34.294 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:34.295 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:34.295 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:34.762 INFO:teuthology.orchestra.run.smithi179.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-07T00:24:34.770 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/017 2023-12-07T00:24:34.770 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/017 2023-12-07T00:24:34.771 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:34.773 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:34.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:34.805 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-12-07T00:24:35.136 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:35.144 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:35.144 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:35.145 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:35.145 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:35.806 INFO:teuthology.orchestra.run.smithi179.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-12-07T00:24:35.832 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/018 2023-12-07T00:24:35.832 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/018 2023-12-07T00:24:35.832 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:35.837 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:35.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:35.867 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-12-07T00:24:36.230 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:36.237 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:36.238 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:36.240 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:36.240 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:36.650 INFO:teuthology.orchestra.run.smithi179.stdout:generic/019 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:24:36.654 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/019 2023-12-07T00:24:36.654 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/019 2023-12-07T00:24:36.654 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:36.659 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:36.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:36.691 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-12-07T00:24:37.013 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:37.017 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:37.017 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:37.018 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:37.019 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:40.305 INFO:teuthology.orchestra.run.smithi179.stdout:generic/020 3s 2023-12-07T00:24:40.312 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/020 2023-12-07T00:24:40.312 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:40.315 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:40.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:40.619 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-12-07T00:24:40.973 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:40.979 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:40.979 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:40.980 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:40.980 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:41.550 INFO:teuthology.orchestra.run.smithi179.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:24:41.555 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/021 2023-12-07T00:24:41.555 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/021 2023-12-07T00:24:41.555 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:41.557 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:41.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:41.801 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-12-07T00:24:42.267 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:42.281 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:42.282 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:42.283 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:42.283 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:42.884 INFO:teuthology.orchestra.run.smithi179.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:24:42.888 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/022 2023-12-07T00:24:42.888 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/022 2023-12-07T00:24:42.888 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:42.890 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:43.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:43.060 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-12-07T00:24:43.511 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:43.515 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:43.516 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:43.517 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:43.517 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:45.178 INFO:teuthology.orchestra.run.smithi179.stdout:generic/023 2s 2023-12-07T00:24:45.185 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/023 2023-12-07T00:24:45.185 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:45.187 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:45.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:45.388 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-12-07T00:24:45.887 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:45.900 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:45.900 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:45.901 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:45.901 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:46.294 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:24:46.297 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:24:46.399 INFO:teuthology.orchestra.run.smithi179.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-07T00:24:46.403 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/024 2023-12-07T00:24:46.404 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/024 2023-12-07T00:24:46.404 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:46.406 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:46.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:46.730 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-12-07T00:24:47.135 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:47.139 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:47.139 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:47.141 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:47.141 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:47.612 INFO:teuthology.orchestra.run.smithi179.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-07T00:24:47.617 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/025 2023-12-07T00:24:47.617 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/025 2023-12-07T00:24:47.617 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:47.623 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:47.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:47.830 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-12-07T00:24:48.274 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:48.281 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:48.281 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:48.282 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:48.282 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:48.754 INFO:teuthology.orchestra.run.smithi179.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-12-07T00:24:48.766 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/026 2023-12-07T00:24:48.766 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/026 2023-12-07T00:24:48.766 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:48.768 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:48.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:48.809 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-12-07T00:24:49.132 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:49.136 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:49.137 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:49.138 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:49.138 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:49.563 INFO:teuthology.orchestra.run.smithi179.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T00:24:49.568 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/027 2023-12-07T00:24:49.568 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/027 2023-12-07T00:24:49.568 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:49.570 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:49.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:49.602 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-12-07T00:24:49.893 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:49.900 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:49.900 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:49.902 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:49.902 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:55.359 INFO:teuthology.orchestra.run.smithi179.stdout:generic/028 5s 2023-12-07T00:24:55.365 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/028 2023-12-07T00:24:55.365 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:24:55.368 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:24:55.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:24:55.403 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-12-07T00:24:55.747 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:24:55.752 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:24:55.756 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:24:55.757 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:24:55.757 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:02.288 INFO:teuthology.orchestra.run.smithi179.stdout:generic/029 6s 2023-12-07T00:25:02.294 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/029 2023-12-07T00:25:02.294 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:02.296 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:02.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:02.307 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-12-07T00:25:02.618 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:02.624 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:02.625 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:02.626 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:02.626 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:06.733 INFO:teuthology.orchestra.run.smithi179.stdout:generic/030 4s 2023-12-07T00:25:06.745 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/030 2023-12-07T00:25:06.745 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:06.749 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:06.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:06.777 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-12-07T00:25:07.133 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:07.137 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:07.137 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:07.138 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:07.138 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:07.654 INFO:teuthology.orchestra.run.smithi179.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-07T00:25:07.659 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/031 2023-12-07T00:25:07.659 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/031 2023-12-07T00:25:07.659 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:07.661 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:07.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:07.695 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-12-07T00:25:07.981 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:07.986 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:07.986 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:07.987 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:07.987 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:08.448 INFO:teuthology.orchestra.run.smithi179.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:25:08.453 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/032 2023-12-07T00:25:08.453 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/032 2023-12-07T00:25:08.453 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:08.455 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:08.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:08.496 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-12-07T00:25:08.822 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:08.828 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:08.828 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:08.829 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:08.829 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:09.465 INFO:teuthology.orchestra.run.smithi179.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-07T00:25:09.472 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/033 2023-12-07T00:25:09.472 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/033 2023-12-07T00:25:09.473 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:09.475 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:09.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:09.506 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-12-07T00:25:09.829 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:09.833 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:09.834 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:09.835 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:09.835 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:10.283 INFO:teuthology.orchestra.run.smithi179.stdout:generic/034 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:25:10.287 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/034 2023-12-07T00:25:10.287 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/034 2023-12-07T00:25:10.287 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:10.289 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:10.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:10.322 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-12-07T00:25:10.677 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:10.681 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:10.681 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:10.682 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:10.682 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:11.217 INFO:teuthology.orchestra.run.smithi179.stdout:generic/035 1s 2023-12-07T00:25:11.224 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/035 2023-12-07T00:25:11.224 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:11.234 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:11.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:11.541 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-12-07T00:25:11.888 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:11.893 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:11.893 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:11.894 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:11.894 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:16.383 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:25:16.389 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:25:22.498 INFO:teuthology.orchestra.run.smithi179.stdout:generic/036 10s 2023-12-07T00:25:22.503 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/036 2023-12-07T00:25:22.503 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:22.505 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:22.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:22.795 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-12-07T00:25:23.190 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:23.194 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:23.195 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:23.196 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:23.196 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:29.025 INFO:teuthology.orchestra.run.smithi179.stdout:generic/037 6s 2023-12-07T00:25:29.030 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/037 2023-12-07T00:25:29.030 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:29.032 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:29.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:29.042 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-12-07T00:25:29.390 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:29.395 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:29.395 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:29.396 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:29.396 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:29.893 INFO:teuthology.orchestra.run.smithi179.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:25:29.902 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/038 2023-12-07T00:25:29.903 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/038 2023-12-07T00:25:29.903 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:29.905 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:29.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:29.933 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-12-07T00:25:30.280 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:30.287 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:30.288 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:30.289 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:30.289 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:30.766 INFO:teuthology.orchestra.run.smithi179.stdout:generic/039 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:25:30.771 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/039 2023-12-07T00:25:30.771 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/039 2023-12-07T00:25:30.771 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:30.773 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:30.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:30.807 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-12-07T00:25:31.132 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:31.137 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:31.137 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:31.141 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:31.141 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:31.596 INFO:teuthology.orchestra.run.smithi179.stdout:generic/040 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:25:31.600 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/040 2023-12-07T00:25:31.601 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/040 2023-12-07T00:25:31.601 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:31.603 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:31.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:31.634 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-12-07T00:25:31.976 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:31.980 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:31.981 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:31.982 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:31.982 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:32.450 INFO:teuthology.orchestra.run.smithi179.stdout:generic/041 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:25:32.455 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/041 2023-12-07T00:25:32.455 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/041 2023-12-07T00:25:32.455 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:32.457 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:32.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:32.489 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-12-07T00:25:32.807 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:32.813 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:32.814 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:32.815 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:32.815 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:33.478 INFO:teuthology.orchestra.run.smithi179.stdout:generic/042 [not run] ceph does not support shutdown 2023-12-07T00:25:33.492 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/042 2023-12-07T00:25:33.492 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/042 2023-12-07T00:25:33.493 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:33.494 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:33.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:33.517 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-12-07T00:25:33.887 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:33.892 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:33.893 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:33.894 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:33.894 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:34.520 INFO:teuthology.orchestra.run.smithi179.stdout:generic/043 [not run] ceph does not support shutdown 2023-12-07T00:25:34.552 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/043 2023-12-07T00:25:34.553 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/043 2023-12-07T00:25:34.553 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:34.556 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:34.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:34.581 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-12-07T00:25:34.891 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:34.896 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:34.898 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:34.899 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:34.899 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:35.531 INFO:teuthology.orchestra.run.smithi179.stdout:generic/044 [not run] ceph does not support shutdown 2023-12-07T00:25:35.548 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/044 2023-12-07T00:25:35.548 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/044 2023-12-07T00:25:35.548 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:35.550 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:35.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:35.572 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-12-07T00:25:35.920 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:35.924 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:35.926 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:35.927 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:35.927 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:36.561 INFO:teuthology.orchestra.run.smithi179.stdout:generic/045 [not run] ceph does not support shutdown 2023-12-07T00:25:36.580 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/045 2023-12-07T00:25:36.580 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/045 2023-12-07T00:25:36.580 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:36.583 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:36.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:36.613 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-12-07T00:25:36.927 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:36.931 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:36.932 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:36.933 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:36.933 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:generic/046 [not run] ceph does not support shutdown 2023-12-07T00:25:37.578 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/046 2023-12-07T00:25:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/046 2023-12-07T00:25:37.579 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:37.581 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:37.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:37.612 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-12-07T00:25:37.913 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:37.919 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:37.920 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:37.921 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:37.921 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:38.552 INFO:teuthology.orchestra.run.smithi179.stdout:generic/047 [not run] ceph does not support shutdown 2023-12-07T00:25:38.573 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/047 2023-12-07T00:25:38.573 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/047 2023-12-07T00:25:38.574 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:38.575 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:38.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:38.596 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-12-07T00:25:38.942 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:38.948 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:38.949 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:38.950 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:38.950 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:39.598 INFO:teuthology.orchestra.run.smithi179.stdout:generic/048 [not run] ceph does not support shutdown 2023-12-07T00:25:39.618 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/048 2023-12-07T00:25:39.618 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/048 2023-12-07T00:25:39.618 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:39.623 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:39.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:39.645 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-12-07T00:25:39.963 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:39.968 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:39.969 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:39.970 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:39.970 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:40.611 INFO:teuthology.orchestra.run.smithi179.stdout:generic/049 [not run] ceph does not support shutdown 2023-12-07T00:25:40.633 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/049 2023-12-07T00:25:40.633 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/049 2023-12-07T00:25:40.633 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:40.636 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:40.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:40.661 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-12-07T00:25:40.994 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:41.000 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:41.000 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:41.001 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:41.001 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:41.614 INFO:teuthology.orchestra.run.smithi179.stdout:generic/050 [not run] ceph does not support shutdown 2023-12-07T00:25:41.641 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/050 2023-12-07T00:25:41.641 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/050 2023-12-07T00:25:41.641 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:41.645 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:41.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:41.677 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-12-07T00:25:42.016 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:42.020 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:42.021 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:42.022 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:42.022 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:42.692 INFO:teuthology.orchestra.run.smithi179.stdout:generic/051 [not run] ceph does not support shutdown 2023-12-07T00:25:42.697 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/051 2023-12-07T00:25:42.697 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/051 2023-12-07T00:25:42.697 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:42.699 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:42.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:42.727 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-12-07T00:25:43.027 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:43.041 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:43.041 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:43.042 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:43.042 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:43.666 INFO:teuthology.orchestra.run.smithi179.stdout:generic/052 [not run] ceph does not support shutdown 2023-12-07T00:25:43.686 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/052 2023-12-07T00:25:43.686 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/052 2023-12-07T00:25:43.686 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:43.688 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:43.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:43.713 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-12-07T00:25:44.071 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:44.076 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:44.077 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:44.078 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:44.078 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:45.196 INFO:teuthology.orchestra.run.smithi179.stdout:generic/053 1s 2023-12-07T00:25:45.214 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/053 2023-12-07T00:25:45.214 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:45.216 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:45.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:45.226 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-12-07T00:25:45.536 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:45.540 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:45.541 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:45.543 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:45.543 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:46.223 INFO:teuthology.orchestra.run.smithi179.stdout:generic/054 [not run] ceph does not support shutdown 2023-12-07T00:25:46.240 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/054 2023-12-07T00:25:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/054 2023-12-07T00:25:46.241 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:46.242 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:46.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:46.263 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-12-07T00:25:46.511 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:25:46.514 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:25:46.614 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:46.619 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:46.619 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:46.620 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:46.620 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:47.304 INFO:teuthology.orchestra.run.smithi179.stdout:generic/055 [not run] ceph does not support shutdown 2023-12-07T00:25:47.327 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/055 2023-12-07T00:25:47.327 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/055 2023-12-07T00:25:47.327 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:47.333 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:47.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:47.356 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-12-07T00:25:47.753 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:47.766 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:47.767 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:47.768 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:47.768 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:48.241 INFO:teuthology.orchestra.run.smithi179.stdout:generic/056 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:25:48.246 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/056 2023-12-07T00:25:48.247 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/056 2023-12-07T00:25:48.247 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:48.252 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:48.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:48.301 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-12-07T00:25:48.627 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:48.635 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:48.636 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:48.638 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:48.638 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:49.126 INFO:teuthology.orchestra.run.smithi179.stdout:generic/057 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:25:49.133 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/057 2023-12-07T00:25:49.134 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/057 2023-12-07T00:25:49.134 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:49.136 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:49.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:49.172 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-12-07T00:25:49.502 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:49.510 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:49.511 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:49.512 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:49.512 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:50.069 INFO:teuthology.orchestra.run.smithi179.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:25:50.074 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/058 2023-12-07T00:25:50.074 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/058 2023-12-07T00:25:50.074 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:50.076 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:50.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:50.434 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-12-07T00:25:50.802 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:50.810 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:50.811 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:50.811 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:50.812 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:51.251 INFO:teuthology.orchestra.run.smithi179.stdout:generic/059 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:25:51.258 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/059 2023-12-07T00:25:51.258 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/059 2023-12-07T00:25:51.258 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:51.260 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:51.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:51.284 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-12-07T00:25:51.632 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:51.641 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:51.641 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:51.642 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:51.642 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:52.257 INFO:teuthology.orchestra.run.smithi179.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:25:52.262 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/060 2023-12-07T00:25:52.262 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/060 2023-12-07T00:25:52.263 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:52.266 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:52.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:52.552 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-12-07T00:25:52.932 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:52.937 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:52.938 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:52.939 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:52.939 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:53.508 INFO:teuthology.orchestra.run.smithi179.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:25:53.513 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/061 2023-12-07T00:25:53.513 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/061 2023-12-07T00:25:53.513 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:53.515 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:53.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:53.701 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-12-07T00:25:54.160 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:54.172 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:54.172 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:54.173 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:54.173 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:56.709 INFO:teuthology.orchestra.run.smithi179.stdout:generic/062 2s 2023-12-07T00:25:56.731 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/062 2023-12-07T00:25:56.732 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:56.734 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:56.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:56.752 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-12-07T00:25:57.095 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:57.099 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:57.099 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:57.100 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:57.100 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:57.765 INFO:teuthology.orchestra.run.smithi179.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:25:57.770 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/063 2023-12-07T00:25:57.770 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/063 2023-12-07T00:25:57.770 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:57.777 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:57.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:57.959 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-12-07T00:25:58.432 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:58.438 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:58.438 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:58.439 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:58.439 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:58.936 INFO:teuthology.orchestra.run.smithi179.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-07T00:25:58.941 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/064 2023-12-07T00:25:58.941 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/064 2023-12-07T00:25:58.941 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:58.943 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:58.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:58.970 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-12-07T00:25:59.299 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:25:59.306 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:25:59.306 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:25:59.307 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:25:59.307 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:59.798 INFO:teuthology.orchestra.run.smithi179.stdout:generic/065 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:25:59.805 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/065 2023-12-07T00:25:59.805 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/065 2023-12-07T00:25:59.805 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:25:59.809 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:25:59.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:25:59.847 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-12-07T00:26:00.200 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:00.207 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:00.208 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:00.209 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:00.209 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:00.714 INFO:teuthology.orchestra.run.smithi179.stdout:generic/066 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:26:00.721 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/066 2023-12-07T00:26:00.722 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/066 2023-12-07T00:26:00.722 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:00.724 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:00.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:26:00.755 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-12-07T00:26:01.086 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:01.095 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:01.096 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:01.097 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:01.097 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:01.588 INFO:teuthology.orchestra.run.smithi179.stdout:generic/067 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:26:01.597 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/067 2023-12-07T00:26:01.597 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/067 2023-12-07T00:26:01.597 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:01.599 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:01.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:26:01.647 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-12-07T00:26:01.963 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:01.969 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:01.969 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:01.972 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:01.972 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:02.621 INFO:teuthology.orchestra.run.smithi179.stdout:generic/068 [not run] ceph does not support freezing 2023-12-07T00:26:02.630 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/068 2023-12-07T00:26:02.630 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/068 2023-12-07T00:26:02.630 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:02.632 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:02.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:26:02.655 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-12-07T00:26:03.001 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:03.013 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:03.013 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:03.014 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:03.014 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:10.248 INFO:teuthology.orchestra.run.smithi179.stdout:generic/069 7s 2023-12-07T00:26:10.256 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/069 2023-12-07T00:26:10.256 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:10.259 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:10.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:26:10.271 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-12-07T00:26:10.603 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:10.611 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:10.612 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:10.612 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:10.613 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:16.637 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:26:16.640 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:26:36.753 INFO:teuthology.orchestra.run.smithi179.stdout:generic/070 26s 2023-12-07T00:26:36.760 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/070 2023-12-07T00:26:36.760 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:36.763 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:37.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:26:37.009 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-12-07T00:26:37.478 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:37.488 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:37.488 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:37.494 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:37.494 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:37.988 INFO:teuthology.orchestra.run.smithi179.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-07T00:26:37.994 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/071 2023-12-07T00:26:37.994 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/071 2023-12-07T00:26:37.994 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:37.996 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:38.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:26:38.031 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-12-07T00:26:38.366 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:38.370 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:38.371 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:38.372 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:38.372 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:38.933 INFO:teuthology.orchestra.run.smithi179.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-07T00:26:38.937 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/072 2023-12-07T00:26:38.938 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/072 2023-12-07T00:26:38.938 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:38.945 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:38.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:26:38.974 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-12-07T00:26:39.295 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:39.302 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:39.302 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:39.303 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:39.303 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:39.755 INFO:teuthology.orchestra.run.smithi179.stdout:generic/073 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:26:39.759 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/073 2023-12-07T00:26:39.759 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/073 2023-12-07T00:26:39.759 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:39.761 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:39.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:26:39.785 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-12-07T00:26:40.088 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:26:40.096 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:26:40.096 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:26:40.097 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:26:40.097 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:26:47.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:26:47.054 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:26:47.229 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T00:26:47.228+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 227755) UID: 0 2023-12-07T00:26:47.238 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T00:26:47.238+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 227755) UID: 0 2023-12-07T00:26:59.333 INFO:teuthology.orchestra.run.smithi179.stdout:generic/074 19s 2023-12-07T00:26:59.348 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/074 2023-12-07T00:26:59.348 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:26:59.355 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:00.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:00.567 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-12-07T00:27:02.678 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:02.686 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:02.687 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:02.688 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:02.688 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:38.624 INFO:teuthology.orchestra.run.smithi179.stdout:generic/075 36s 2023-12-07T00:27:38.634 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/075 2023-12-07T00:27:38.634 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:38.640 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:39.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:39.062 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-12-07T00:27:39.472 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:39.476 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:39.476 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:39.478 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:39.478 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:39.948 INFO:teuthology.orchestra.run.smithi179.stdout:generic/076 [not run] require 172.21.15.179:6789:/scratch to be local device 2023-12-07T00:27:39.959 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/076 2023-12-07T00:27:39.959 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/076 2023-12-07T00:27:39.959 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:39.962 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:39.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:39.995 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-12-07T00:27:40.425 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:40.441 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:40.441 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:40.445 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:40.445 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:47.386 INFO:teuthology.orchestra.run.smithi179.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T00:27:47.395 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/077 2023-12-07T00:27:47.395 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/077 2023-12-07T00:27:47.395 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:47.405 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:47.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:47.583 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-12-07T00:27:48.577 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:48.584 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:48.585 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:48.586 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:48.586 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:49.174 INFO:teuthology.orchestra.run.smithi179.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-07T00:27:49.184 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/078 2023-12-07T00:27:49.184 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/078 2023-12-07T00:27:49.184 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:49.187 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:49.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:49.415 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-12-07T00:27:49.971 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:49.983 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:49.984 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:49.985 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:49.985 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:50.532 INFO:teuthology.orchestra.run.smithi179.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-07T00:27:50.537 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/079 2023-12-07T00:27:50.537 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/079 2023-12-07T00:27:50.538 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:50.539 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:50.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:50.580 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-12-07T00:27:51.030 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:51.035 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:51.036 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:51.037 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:51.037 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:53.619 INFO:teuthology.orchestra.run.smithi179.stdout:generic/080 2s 2023-12-07T00:27:53.631 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/080 2023-12-07T00:27:53.632 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:53.633 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:53.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:53.702 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-12-07T00:27:54.128 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:54.132 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:54.132 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:54.134 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:54.134 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:54.655 INFO:teuthology.orchestra.run.smithi179.stdout:generic/081 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:27:54.661 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/081 2023-12-07T00:27:54.661 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/081 2023-12-07T00:27:54.661 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:54.679 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:54.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:54.711 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-12-07T00:27:55.060 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:55.071 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:55.071 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:55.072 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:55.072 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:55.585 INFO:teuthology.orchestra.run.smithi179.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T00:27:55.593 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/082 2023-12-07T00:27:55.593 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/082 2023-12-07T00:27:55.593 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:55.596 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:55.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:55.639 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-12-07T00:27:56.103 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:56.114 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:56.114 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:56.115 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:56.116 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:56.598 INFO:teuthology.orchestra.run.smithi179.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T00:27:56.618 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/083 2023-12-07T00:27:56.619 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/083 2023-12-07T00:27:56.619 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:27:56.624 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:27:56.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:27:56.661 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-12-07T00:27:57.056 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:27:57.066 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:27:57.067 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:27:57.068 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:27:57.068 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:03.395 INFO:teuthology.orchestra.run.smithi179.stdout:generic/084 6s 2023-12-07T00:28:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/084 2023-12-07T00:28:03.418 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:28:03.426 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:03.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:28:03.442 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-12-07T00:28:03.877 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:28:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:28:03.894 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:28:03.895 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:28:03.896 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:04.447 INFO:teuthology.orchestra.run.smithi179.stdout:generic/085 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:28:04.458 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/085 2023-12-07T00:28:04.458 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/085 2023-12-07T00:28:04.458 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:28:04.460 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:04.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:28:04.487 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-12-07T00:28:04.919 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:28:04.923 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:28:04.923 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:28:04.925 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:28:04.925 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:05.426 INFO:teuthology.orchestra.run.smithi179.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:28:05.433 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/086 2023-12-07T00:28:05.433 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/086 2023-12-07T00:28:05.433 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:28:05.435 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:05.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:28:05.473 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-12-07T00:28:05.850 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:28:05.855 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:28:05.856 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:28:05.857 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:28:05.857 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:06.638 INFO:teuthology.orchestra.run.smithi179.stdout:generic/087 0s 2023-12-07T00:28:06.697 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/087 2023-12-07T00:28:06.697 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:28:06.698 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:07.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:28:07.036 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-12-07T00:28:07.520 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:28:07.524 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:28:07.524 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:28:07.526 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:28:07.526 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:08.580 INFO:teuthology.orchestra.run.smithi179.stdout:generic/088 1s 2023-12-07T00:28:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/088 2023-12-07T00:28:08.585 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:28:08.587 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:28:08.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:28:08.729 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-12-07T00:28:09.381 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:28:09.388 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:28:09.388 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:28:09.390 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:28:09.391 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:29:51.163 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:29:51.166 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:30:21.244 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:30:21.247 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:30:51.316 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:30:51.319 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:31:21.789 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:31:21.792 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:31:51.875 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:31:51.879 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:32:22.279 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:32:22.282 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:32:22.848 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T00:32:22.849+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 238363) UID: 0 2023-12-07T00:32:22.848 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T00:32:22.849+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 238363) UID: 0 2023-12-07T00:35:20.862 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:35:20.867 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:35:51.545 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:35:51.549 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:36:21.118 INFO:teuthology.orchestra.run.smithi179.stdout:generic/089 492s 2023-12-07T00:36:21.122 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/089 2023-12-07T00:36:21.122 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:36:21.124 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:36:21.610 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:36:21.631 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:36:21.862 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T00:36:21.863+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 240512) UID: 0 2023-12-07T00:36:21.867 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T00:36:21.863+0000 7f6899d25700 -1 received signal: Hangup from (PID: 240512) UID: 0 2023-12-07T00:36:23.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:36:23.100 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-12-07T00:36:24.094 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:36:24.120 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:36:24.120 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:36:24.121 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:36:24.121 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:36:24.506 INFO:teuthology.orchestra.run.smithi179.stdout:generic/090 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:36:24.510 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/090 2023-12-07T00:36:24.510 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/090 2023-12-07T00:36:24.510 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:36:24.512 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:36:24.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:36:24.543 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-12-07T00:36:24.762 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:36:24.766 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:36:24.766 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:36:24.767 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:36:24.767 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:08.762 INFO:teuthology.orchestra.run.smithi179.stdout:generic/091 104s 2023-12-07T00:38:08.766 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/091 2023-12-07T00:38:08.766 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:08.768 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:09.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:09.161 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-12-07T00:38:09.382 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:09.386 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:09.386 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:09.387 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:09.387 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:09.711 INFO:teuthology.orchestra.run.smithi179.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:38:09.715 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/092 2023-12-07T00:38:09.715 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/092 2023-12-07T00:38:09.715 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:09.717 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:09.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:09.747 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-12-07T00:38:09.946 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:09.950 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:09.950 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:09.951 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:09.951 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:10.547 INFO:teuthology.orchestra.run.smithi179.stdout:generic/093 0s 2023-12-07T00:38:10.552 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/093 2023-12-07T00:38:10.552 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:10.554 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:10.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:10.949 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-12-07T00:38:11.184 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:11.188 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:11.188 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:11.189 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:11.189 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:11.559 INFO:teuthology.orchestra.run.smithi179.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-07T00:38:11.563 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/094 2023-12-07T00:38:11.563 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/094 2023-12-07T00:38:11.563 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:11.565 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:11.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:11.932 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-12-07T00:38:12.172 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:12.176 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:12.176 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:12.177 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:12.177 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:26.253 INFO:teuthology.orchestra.run.smithi179.stdout:generic/095 14s 2023-12-07T00:38:26.258 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/095 2023-12-07T00:38:26.259 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:26.261 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:26.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:26.269 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-12-07T00:38:26.479 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:26.483 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:26.484 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:26.485 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:26.485 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:26.910 INFO:teuthology.orchestra.run.smithi179.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-07T00:38:26.914 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/096 2023-12-07T00:38:26.914 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/096 2023-12-07T00:38:26.914 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:26.916 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:26.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:26.949 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-12-07T00:38:27.172 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:27.176 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:27.177 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:27.177 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:27.178 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:28.042 INFO:teuthology.orchestra.run.smithi179.stdout:generic/097 1s 2023-12-07T00:38:28.047 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/097 2023-12-07T00:38:28.047 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:28.049 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:28.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:28.078 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-12-07T00:38:28.295 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:28.299 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:28.299 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:28.300 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:28.301 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:32.391 INFO:teuthology.orchestra.run.smithi179.stdout:generic/098 4s 2023-12-07T00:38:32.396 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/098 2023-12-07T00:38:32.396 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:32.397 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:32.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:32.406 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-12-07T00:38:32.610 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:32.613 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:32.614 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:32.615 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:32.615 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:33.531 INFO:teuthology.orchestra.run.smithi179.stdout:generic/099 1s 2023-12-07T00:38:33.546 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/099 2023-12-07T00:38:33.546 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:33.548 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:33.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:33.849 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-12-07T00:38:34.179 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:34.183 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:34.183 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:34.185 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:34.185 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:45.672 INFO:teuthology.orchestra.run.smithi179.stdout:generic/100 11s 2023-12-07T00:38:45.676 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/100 2023-12-07T00:38:45.676 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:45.678 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:49.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:49.606 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-12-07T00:38:49.933 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:49.937 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:49.938 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:49.939 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:49.939 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:50.241 INFO:teuthology.orchestra.run.smithi179.stdout:generic/101 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:38:50.245 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/101 2023-12-07T00:38:50.245 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/101 2023-12-07T00:38:50.245 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:50.247 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:50.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:50.280 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-12-07T00:38:50.500 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:50.504 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:50.505 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:50.506 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:50.506 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:50.805 INFO:teuthology.orchestra.run.smithi179.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T00:38:50.809 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/102 2023-12-07T00:38:50.809 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/102 2023-12-07T00:38:50.809 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:50.811 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:50.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:50.833 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-12-07T00:38:51.029 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:51.033 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:51.033 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:51.034 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:51.035 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:51.355 INFO:teuthology.orchestra.run.smithi179.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T00:38:51.359 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/103 2023-12-07T00:38:51.359 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/103 2023-12-07T00:38:51.359 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:51.361 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:51.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:51.825 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-12-07T00:38:52.039 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:52.043 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:52.043 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:52.044 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:52.044 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:52.358 INFO:teuthology.orchestra.run.smithi179.stdout:generic/104 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:38:52.362 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/104 2023-12-07T00:38:52.362 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/104 2023-12-07T00:38:52.362 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:52.364 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:52.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:52.391 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-12-07T00:38:52.589 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:52.593 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:52.594 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:52.595 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:52.595 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:53.498 INFO:teuthology.orchestra.run.smithi179.stdout:generic/105 1s 2023-12-07T00:38:53.513 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/105 2023-12-07T00:38:53.513 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:53.516 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:53.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:53.534 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-12-07T00:38:53.736 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:53.740 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:53.740 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:53.741 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:53.741 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:54.074 INFO:teuthology.orchestra.run.smithi179.stdout:generic/106 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:38:54.078 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/106 2023-12-07T00:38:54.078 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/106 2023-12-07T00:38:54.078 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:54.080 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:54.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:54.100 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-12-07T00:38:54.321 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:54.325 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:54.326 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:54.327 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:54.327 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:54.647 INFO:teuthology.orchestra.run.smithi179.stdout:generic/107 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:38:54.651 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/107 2023-12-07T00:38:54.651 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/107 2023-12-07T00:38:54.651 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:54.653 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:54.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:54.689 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-12-07T00:38:54.903 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:54.907 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:54.908 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:54.909 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:54.909 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:55.372 INFO:teuthology.orchestra.run.smithi179.stdout:generic/108 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T00:38:55.376 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/108 2023-12-07T00:38:55.376 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/108 2023-12-07T00:38:55.376 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:38:55.378 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:38:55.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:38:55.402 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-12-07T00:38:55.603 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:38:55.607 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:38:55.608 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:38:55.609 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:38:55.609 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:39:05.265 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:39:05.268 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:39:05.846 INFO:teuthology.orchestra.run.smithi179.stdout:generic/109 10s 2023-12-07T00:39:05.905 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/109 2023-12-07T00:39:05.906 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:39:05.908 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:39:05.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:39:05.917 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-12-07T00:39:06.515 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:39:06.519 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:39:06.520 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:39:06.521 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:39:06.521 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:39:26.543 INFO:teuthology.orchestra.run.smithi179.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T00:39:26.548 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/110 2023-12-07T00:39:26.548 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/110 2023-12-07T00:39:26.548 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:39:26.551 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:39:26.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:39:26.950 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-12-07T00:39:27.268 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:39:27.272 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:39:27.272 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:39:27.273 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:39:27.274 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:39:27.615 INFO:teuthology.orchestra.run.smithi179.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T00:39:27.620 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/111 2023-12-07T00:39:27.620 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/111 2023-12-07T00:39:27.620 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:39:27.621 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:39:28.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:39:28.005 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-12-07T00:39:28.200 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:39:28.204 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:39:28.205 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:39:28.205 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:39:28.206 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:39:35.892 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:39:35.895 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:39:43.274 INFO:teuthology.orchestra.run.smithi179.stdout:generic/112 15s 2023-12-07T00:39:43.279 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/112 2023-12-07T00:39:43.279 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:39:43.281 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:39:43.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:39:43.435 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-12-07T00:39:43.856 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:39:43.860 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:39:43.860 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:39:43.861 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:39:43.861 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:00.329 INFO:teuthology.orchestra.run.smithi179.stdout:generic/113 16s 2023-12-07T00:40:00.396 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/113 2023-12-07T00:40:00.396 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:00.398 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:00.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:00.726 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-12-07T00:40:01.047 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:01.051 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:01.052 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:01.053 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:01.053 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:01.423 INFO:teuthology.orchestra.run.smithi179.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-07T00:40:01.427 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/114 2023-12-07T00:40:01.427 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/114 2023-12-07T00:40:01.427 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:01.429 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:01.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:01.457 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-12-07T00:40:01.678 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:01.682 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:01.683 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:01.684 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:01.684 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:02.026 INFO:teuthology.orchestra.run.smithi179.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T00:40:02.030 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/115 2023-12-07T00:40:02.030 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/115 2023-12-07T00:40:02.031 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:02.033 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:02.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:02.200 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-12-07T00:40:02.602 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:02.606 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:02.606 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:02.607 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:02.607 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:02.963 INFO:teuthology.orchestra.run.smithi179.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T00:40:02.967 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/116 2023-12-07T00:40:02.967 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/116 2023-12-07T00:40:02.967 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:02.969 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:03.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:03.307 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-12-07T00:40:03.555 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:03.559 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:03.559 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:03.560 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:03.560 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:05.991 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:40:05.993 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:40:16.436 INFO:teuthology.orchestra.run.smithi179.stdout:generic/117 13s 2023-12-07T00:40:16.442 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/117 2023-12-07T00:40:16.442 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:16.444 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:16.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:16.453 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-12-07T00:40:16.678 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:16.682 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:16.682 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:16.683 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:16.683 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:17.390 INFO:teuthology.orchestra.run.smithi179.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T00:40:17.394 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/118 2023-12-07T00:40:17.394 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/118 2023-12-07T00:40:17.394 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:17.396 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:17.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:17.709 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-12-07T00:40:18.058 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:18.062 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:18.062 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:18.063 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:18.063 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:18.411 INFO:teuthology.orchestra.run.smithi179.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T00:40:18.415 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/119 2023-12-07T00:40:18.415 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/119 2023-12-07T00:40:18.415 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:18.417 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:18.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:18.742 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-12-07T00:40:18.985 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:18.990 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:18.990 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:18.991 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:18.991 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:19.314 INFO:teuthology.orchestra.run.smithi179.stdout:generic/120 [not run] atime not maintained by ceph 2023-12-07T00:40:19.318 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/120 2023-12-07T00:40:19.318 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/120 2023-12-07T00:40:19.318 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:19.320 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:19.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:19.344 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-12-07T00:40:19.554 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:19.558 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:19.558 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:19.559 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:19.559 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:19.910 INFO:teuthology.orchestra.run.smithi179.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-07T00:40:19.914 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/121 2023-12-07T00:40:19.914 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/121 2023-12-07T00:40:19.914 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:19.916 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:20.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:20.262 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-12-07T00:40:20.503 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:20.507 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:20.508 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:20.509 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:20.509 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:20.865 INFO:teuthology.orchestra.run.smithi179.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-07T00:40:20.869 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/122 2023-12-07T00:40:20.869 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/122 2023-12-07T00:40:20.869 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:20.871 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:21.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:21.143 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-12-07T00:40:21.436 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:21.440 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:21.441 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:21.442 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:21.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:21.924 INFO:teuthology.orchestra.run.smithi179.stdout:generic/123 0s 2023-12-07T00:40:21.929 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/123 2023-12-07T00:40:21.929 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:21.931 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:22.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:22.262 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-12-07T00:40:22.507 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:22.511 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:22.512 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:22.513 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:22.513 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:24.794 INFO:teuthology.orchestra.run.smithi179.stdout:generic/124 2s 2023-12-07T00:40:24.805 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/124 2023-12-07T00:40:24.805 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:40:24.807 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:25.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:40:25.277 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-12-07T00:40:25.605 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:40:25.610 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:40:25.611 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:40:25.611 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:40:25.611 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:40:36.091 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:40:36.096 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:41:06.172 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:41:06.178 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:41:27.187 INFO:teuthology.orchestra.run.smithi179.stdout:generic/125 62s 2023-12-07T00:41:27.192 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/125 2023-12-07T00:41:27.192 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:41:27.195 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:41:27.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:41:27.535 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-12-07T00:41:27.789 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:41:27.793 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:41:27.793 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:41:27.794 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:41:27.794 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:41:28.283 INFO:teuthology.orchestra.run.smithi179.stdout:generic/126 1s 2023-12-07T00:41:28.287 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/126 2023-12-07T00:41:28.287 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:41:28.289 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:41:28.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:41:28.693 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-12-07T00:41:28.896 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:41:28.900 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:41:28.900 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:41:28.901 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:41:28.901 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:41:36.244 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:41:36.246 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:42:06.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:42:06.312 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:42:36.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:42:36.367 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:43:06.420 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:43:06.423 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:43:36.493 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:43:36.496 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:44:06.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:44:06.553 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:44:36.703 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:44:36.706 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:45:06.770 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:45:06.773 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:45:36.835 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:45:36.838 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:46:06.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:46:06.895 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:46:36.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:46:36.993 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:47:07.062 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:47:07.069 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:47:37.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:47:37.129 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:48:07.473 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:48:07.475 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:48:37.529 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:48:37.532 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:49:07.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:49:07.637 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:49:37.739 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:49:37.742 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:50:07.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:50:07.807 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:50:37.877 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:50:37.879 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:51:07.933 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:51:07.936 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:51:23.207 INFO:teuthology.orchestra.run.smithi179.stdout:generic/127 594s 2023-12-07T00:51:23.212 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/127 2023-12-07T00:51:23.212 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:51:23.214 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:51:23.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:51:23.535 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-12-07T00:51:23.789 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:51:23.793 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:51:23.793 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:51:23.794 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:51:23.794 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:51:24.856 INFO:teuthology.orchestra.run.smithi179.stdout:generic/128 1s 2023-12-07T00:51:24.861 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/128 2023-12-07T00:51:24.861 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T00:51:24.863 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:51:24.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T00:51:24.871 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-12-07T00:51:25.089 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T00:51:25.093 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T00:51:25.093 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T00:51:25.095 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T00:51:25.095 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T00:51:38.004 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:51:38.010 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:52:08.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:52:08.100 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:52:38.628 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:52:38.631 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:52:38.706 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T00:52:38.706+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 280170) UID: 0 2023-12-07T00:52:38.717 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T00:52:38.713+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 280170) UID: 0 2023-12-07T00:52:38.717 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T00:52:38.705+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 280170) UID: 0 2023-12-07T00:52:38.721 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T00:52:38.705+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 280170) UID: 0 2023-12-07T00:56:13.597 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:56:13.600 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T00:56:13.774 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T00:56:13.773+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115425) UID: 0 2023-12-07T00:56:13.775 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T00:56:13.769+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115425) UID: 0 2023-12-07T00:56:13.780 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T00:56:13.774+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115425) UID: 0 2023-12-07T00:56:13.803 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T00:56:13.764+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115425) UID: 0 2023-12-07T01:01:21.512 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:01:21.531 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:01:21.931 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T01:01:21.931+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115509) UID: 0 2023-12-07T01:01:21.931 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T01:01:21.931+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115509) UID: 0 2023-12-07T01:01:21.931 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T01:01:21.931+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115509) UID: 0 2023-12-07T01:01:21.931 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T01:01:21.931+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115509) UID: 0 2023-12-07T01:11:35.182 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:11:35.207 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:11:35.460 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T01:11:35.457+0000 7f918020f700 -1 received signal: Hangup from (PID: 280416) UID: 0 2023-12-07T01:11:35.461 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T01:11:35.459+0000 7ff5f6948700 -1 received signal: Hangup from (PID: 280416) UID: 0 2023-12-07T01:11:35.461 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T01:11:35.458+0000 7f4df7d65700 -1 received signal: Hangup from (PID: 280416) UID: 0 2023-12-07T01:11:35.462 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T01:11:35.458+0000 7fd2f87cb700 -1 received signal: Hangup from (PID: 280416) UID: 0 2023-12-07T01:11:35.583 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T01:11:35.583+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115621) UID: 0 2023-12-07T01:11:35.583 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T01:11:35.583+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115621) UID: 0 2023-12-07T01:11:35.584 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T01:11:35.584+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115621) UID: 0 2023-12-07T01:11:35.584 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T01:11:35.584+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 115621) UID: 0 2023-12-07T01:13:31.427 INFO:teuthology.orchestra.run.smithi179.stdout:generic/129 1326s 2023-12-07T01:13:31.547 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/129 2023-12-07T01:13:31.547 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:13:31.549 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:13:31.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:13:31.559 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-12-07T01:13:32.186 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:13:32.189 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:13:32.190 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:13:32.191 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:13:32.191 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:13:47.900 INFO:teuthology.orchestra.run.smithi179.stdout:generic/130 15s 2023-12-07T01:13:47.929 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/130 2023-12-07T01:13:47.929 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:13:47.931 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:13:47.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:13:47.940 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-12-07T01:13:48.177 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:13:48.181 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:13:48.181 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:13:48.182 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:13:48.182 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:13:49.696 INFO:teuthology.orchestra.run.smithi179.stdout:generic/131 1s 2023-12-07T01:13:49.710 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/131 2023-12-07T01:13:49.710 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:13:49.712 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:13:50.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:13:50.062 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-12-07T01:13:50.510 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:13:50.515 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:13:50.516 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:13:50.519 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:13:50.519 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:14:05.066 INFO:teuthology.orchestra.run.smithi179.stdout:generic/132 15s 2023-12-07T01:14:05.071 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/132 2023-12-07T01:14:05.071 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:14:05.075 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:14:05.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:14:05.082 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-12-07T01:14:05.290 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:14:05.342 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:14:05.342 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:14:05.343 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:14:05.343 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:17:26.962 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:17:26.965 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:17:27.063 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T01:17:27.064+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 283772) UID: 0 2023-12-07T01:17:27.064 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T01:17:27.064+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 283772) UID: 0 2023-12-07T01:17:27.064 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T01:17:27.064+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 283772) UID: 0 2023-12-07T01:17:27.064 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T01:17:27.064+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 283772) UID: 0 2023-12-07T01:18:34.173 INFO:teuthology.orchestra.run.smithi179.stdout:generic/133 269s 2023-12-07T01:18:34.177 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/133 2023-12-07T01:18:34.177 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:34.179 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:34.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:34.469 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-12-07T01:18:35.002 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:35.010 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:35.011 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:35.012 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:35.012 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:35.439 INFO:teuthology.orchestra.run.smithi179.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:35.443 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/134 2023-12-07T01:18:35.443 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/134 2023-12-07T01:18:35.443 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:35.445 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:35.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:35.814 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-12-07T01:18:36.089 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:36.093 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:36.094 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:36.094 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:36.094 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:37.251 INFO:teuthology.orchestra.run.smithi179.stdout:generic/135 1s 2023-12-07T01:18:37.260 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/135 2023-12-07T01:18:37.260 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:37.262 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:37.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:37.271 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-12-07T01:18:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:37.492 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:37.493 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:37.493 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:37.864 INFO:teuthology.orchestra.run.smithi179.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-07T01:18:37.867 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/136 2023-12-07T01:18:37.868 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/136 2023-12-07T01:18:37.868 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:37.869 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:37.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:37.996 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-12-07T01:18:38.517 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:38.521 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:38.522 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:38.523 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:38.523 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:38.876 INFO:teuthology.orchestra.run.smithi179.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:38.880 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/137 2023-12-07T01:18:38.880 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/137 2023-12-07T01:18:38.880 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:38.882 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:39.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:39.278 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-12-07T01:18:39.525 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:39.528 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:39.529 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:39.530 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:39.530 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:39.887 INFO:teuthology.orchestra.run.smithi179.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:39.890 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/138 2023-12-07T01:18:39.891 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/138 2023-12-07T01:18:39.891 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:39.892 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:40.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:40.287 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-12-07T01:18:40.512 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:40.516 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:40.516 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:40.517 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:40.517 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:40.883 INFO:teuthology.orchestra.run.smithi179.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:40.887 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/139 2023-12-07T01:18:40.887 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/139 2023-12-07T01:18:40.887 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:40.889 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:41.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:41.248 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-12-07T01:18:41.528 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:41.532 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:41.533 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:41.533 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:41.888 INFO:teuthology.orchestra.run.smithi179.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:41.894 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/140 2023-12-07T01:18:41.894 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/140 2023-12-07T01:18:41.894 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:41.894 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:42.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:42.200 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-12-07T01:18:42.541 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:42.544 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:42.545 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:42.546 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:42.546 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:43.112 INFO:teuthology.orchestra.run.smithi179.stdout:generic/141 1s 2023-12-07T01:18:43.117 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/141 2023-12-07T01:18:43.117 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:43.119 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:43.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:43.128 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-12-07T01:18:43.361 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:43.365 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:43.366 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:43.367 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:43.367 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:43.737 INFO:teuthology.orchestra.run.smithi179.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:43.738 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/142 2023-12-07T01:18:43.739 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/142 2023-12-07T01:18:43.739 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:43.741 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:44.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:44.135 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-12-07T01:18:44.373 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:44.376 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:44.377 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:44.378 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:44.378 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:44.723 INFO:teuthology.orchestra.run.smithi179.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:44.727 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/143 2023-12-07T01:18:44.728 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/143 2023-12-07T01:18:44.728 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:44.729 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:45.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:45.110 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-12-07T01:18:45.362 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:45.366 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:45.367 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:45.367 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:45.368 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:45.719 INFO:teuthology.orchestra.run.smithi179.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/144 2023-12-07T01:18:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/144 2023-12-07T01:18:45.723 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:45.725 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:45.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:45.772 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-12-07T01:18:46.344 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:46.348 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:46.348 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:46.349 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:46.349 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:46.677 INFO:teuthology.orchestra.run.smithi179.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:46.681 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/145 2023-12-07T01:18:46.681 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/145 2023-12-07T01:18:46.681 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:46.683 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:47.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:47.075 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-12-07T01:18:47.346 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:47.350 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:47.350 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:47.351 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:47.351 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:47.699 INFO:teuthology.orchestra.run.smithi179.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:47.703 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/146 2023-12-07T01:18:47.703 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/146 2023-12-07T01:18:47.703 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:47.706 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:48.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:48.057 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-12-07T01:18:48.331 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:48.335 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:48.335 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:48.336 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:48.336 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:48.696 INFO:teuthology.orchestra.run.smithi179.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:48.700 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/147 2023-12-07T01:18:48.700 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/147 2023-12-07T01:18:48.700 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:48.702 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:49.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:49.094 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-12-07T01:18:49.322 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:49.326 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:49.326 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:49.327 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:49.327 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:49.682 INFO:teuthology.orchestra.run.smithi179.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:49.683 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/148 2023-12-07T01:18:49.683 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/148 2023-12-07T01:18:49.683 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:49.685 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:49.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:49.976 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-12-07T01:18:50.318 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:50.322 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:50.323 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:50.324 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:50.324 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:50.670 INFO:teuthology.orchestra.run.smithi179.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:50.674 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/149 2023-12-07T01:18:50.674 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/149 2023-12-07T01:18:50.674 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:50.676 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:51.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:51.071 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-12-07T01:18:51.348 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:51.352 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:51.352 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:51.353 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:51.353 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:51.709 INFO:teuthology.orchestra.run.smithi179.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:51.713 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/150 2023-12-07T01:18:51.713 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/150 2023-12-07T01:18:51.713 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:51.715 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:52.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:52.163 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-12-07T01:18:52.405 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:52.409 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:52.410 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:52.411 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:52.411 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:52.762 INFO:teuthology.orchestra.run.smithi179.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:52.766 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/151 2023-12-07T01:18:52.766 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/151 2023-12-07T01:18:52.766 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:52.768 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:53.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:53.046 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-12-07T01:18:53.390 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:53.394 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:53.395 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:53.395 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:53.396 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:53.754 INFO:teuthology.orchestra.run.smithi179.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:53.758 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/152 2023-12-07T01:18:53.758 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/152 2023-12-07T01:18:53.758 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:53.760 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:54.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:54.118 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-12-07T01:18:54.399 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:54.403 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:54.403 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:54.404 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:54.404 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:54.756 INFO:teuthology.orchestra.run.smithi179.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:54.760 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/153 2023-12-07T01:18:54.760 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/153 2023-12-07T01:18:54.760 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:54.762 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:55.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:55.178 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-12-07T01:18:55.416 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:55.419 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:55.420 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:55.421 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:55.421 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:55.773 INFO:teuthology.orchestra.run.smithi179.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:55.777 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/154 2023-12-07T01:18:55.777 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/154 2023-12-07T01:18:55.777 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:55.779 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:56.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:56.118 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-12-07T01:18:56.418 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:56.422 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:56.422 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:56.423 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:56.423 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:56.790 INFO:teuthology.orchestra.run.smithi179.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:56.794 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/155 2023-12-07T01:18:56.794 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/155 2023-12-07T01:18:56.795 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:56.797 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:57.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:57.181 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-12-07T01:18:57.414 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:57.418 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:57.419 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:57.420 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:57.420 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:57.764 INFO:teuthology.orchestra.run.smithi179.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:57.768 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/156 2023-12-07T01:18:57.768 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/156 2023-12-07T01:18:57.768 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:57.770 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:58.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:58.029 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-12-07T01:18:58.386 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:58.390 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:58.390 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:58.391 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:58.391 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:58.743 INFO:teuthology.orchestra.run.smithi179.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:18:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/157 2023-12-07T01:18:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/157 2023-12-07T01:18:58.747 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:58.749 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:58.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:18:58.891 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-12-07T01:18:59.382 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:18:59.386 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:18:59.386 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:18:59.387 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:18:59.387 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:18:59.746 INFO:teuthology.orchestra.run.smithi179.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-07T01:18:59.750 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/158 2023-12-07T01:18:59.750 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/158 2023-12-07T01:18:59.750 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:18:59.752 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:00.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:00.061 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-12-07T01:19:00.377 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:00.381 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:00.382 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:00.382 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:00.382 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:00.763 INFO:teuthology.orchestra.run.smithi179.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-07T01:19:00.768 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/159 2023-12-07T01:19:00.768 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/159 2023-12-07T01:19:00.768 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:00.770 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:00.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:00.802 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-12-07T01:19:01.002 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:01.006 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:01.006 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:01.007 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:01.007 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:01.358 INFO:teuthology.orchestra.run.smithi179.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-07T01:19:01.362 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/160 2023-12-07T01:19:01.362 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/160 2023-12-07T01:19:01.363 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:01.365 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:01.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:01.399 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-12-07T01:19:01.608 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:01.612 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:01.613 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:01.615 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:01.615 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:02.449 INFO:teuthology.orchestra.run.smithi179.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:02.511 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/161 2023-12-07T01:19:02.512 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/161 2023-12-07T01:19:02.512 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:02.517 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:02.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:02.554 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-12-07T01:19:02.786 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:02.790 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:02.790 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:02.791 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:02.791 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:03.313 INFO:teuthology.orchestra.run.smithi179.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-07T01:19:03.626 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/162 2023-12-07T01:19:03.626 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/162 2023-12-07T01:19:03.626 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:03.638 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:03.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:03.791 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-12-07T01:19:04.002 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:04.006 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:04.006 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:04.007 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:04.007 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:04.524 INFO:teuthology.orchestra.run.smithi179.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-07T01:19:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/163 2023-12-07T01:19:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/163 2023-12-07T01:19:04.802 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:04.889 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:04.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:04.973 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-12-07T01:19:05.207 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:05.212 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:05.212 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:05.213 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:05.213 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:06.113 INFO:teuthology.orchestra.run.smithi179.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:06.133 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/164 2023-12-07T01:19:06.133 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/164 2023-12-07T01:19:06.133 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:06.135 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:06.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:06.185 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-12-07T01:19:06.386 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:06.391 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:06.391 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:06.392 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:06.392 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:07.267 INFO:teuthology.orchestra.run.smithi179.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:07.303 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/165 2023-12-07T01:19:07.303 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/165 2023-12-07T01:19:07.303 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:07.350 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:07.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:07.392 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-12-07T01:19:07.595 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:07.599 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:07.599 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:07.600 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:07.600 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:08.342 INFO:teuthology.orchestra.run.smithi179.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:08.350 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/166 2023-12-07T01:19:08.350 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/166 2023-12-07T01:19:08.350 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:08.361 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:08.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:08.572 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-12-07T01:19:08.780 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:08.784 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:08.784 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:08.785 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:08.785 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:09.635 INFO:teuthology.orchestra.run.smithi179.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:09.663 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/167 2023-12-07T01:19:09.663 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/167 2023-12-07T01:19:09.663 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:09.672 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:09.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:09.752 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-12-07T01:19:09.968 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:09.972 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:09.972 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:09.973 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:09.973 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:10.705 INFO:teuthology.orchestra.run.smithi179.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:10.710 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/168 2023-12-07T01:19:10.710 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/168 2023-12-07T01:19:10.710 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:10.713 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:10.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:10.957 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-12-07T01:19:11.170 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:11.174 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:11.174 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:11.175 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:11.176 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:11.956 INFO:teuthology.orchestra.run.smithi179.stdout:generic/169 0s 2023-12-07T01:19:11.970 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/169 2023-12-07T01:19:11.970 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:11.972 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:11.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:11.981 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-12-07T01:19:12.188 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:12.192 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:12.192 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:12.193 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:12.193 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:13.035 INFO:teuthology.orchestra.run.smithi179.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:13.043 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/170 2023-12-07T01:19:13.043 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/170 2023-12-07T01:19:13.043 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:13.063 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:13.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:13.138 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-12-07T01:19:13.343 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:13.347 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:13.347 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:13.348 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:13.348 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:14.044 INFO:teuthology.orchestra.run.smithi179.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:14.070 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/171 2023-12-07T01:19:14.070 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/171 2023-12-07T01:19:14.070 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:14.200 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:14.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:14.291 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-12-07T01:19:14.513 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:14.517 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:14.518 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:14.521 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:14.521 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:15.251 INFO:teuthology.orchestra.run.smithi179.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:15.340 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/172 2023-12-07T01:19:15.341 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/172 2023-12-07T01:19:15.341 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:15.388 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:15.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:15.484 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-12-07T01:19:15.703 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:15.707 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:15.708 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:15.709 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:15.709 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:16.411 INFO:teuthology.orchestra.run.smithi179.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:16.554 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/173 2023-12-07T01:19:16.555 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/173 2023-12-07T01:19:16.555 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:16.567 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:16.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:16.672 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-12-07T01:19:16.886 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:16.890 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:16.890 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:16.891 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:16.892 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:17.793 INFO:teuthology.orchestra.run.smithi179.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:17.809 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/174 2023-12-07T01:19:17.809 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/174 2023-12-07T01:19:17.810 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:17.822 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:17.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:17.873 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-12-07T01:19:18.094 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:18.097 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:18.098 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:18.099 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:18.099 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:18.956 INFO:teuthology.orchestra.run.smithi179.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:18.962 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/175 2023-12-07T01:19:18.962 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/175 2023-12-07T01:19:18.962 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:19.009 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:19.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:19.070 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-12-07T01:19:19.285 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:19.289 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:19.289 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:19.290 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:19.290 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:20.151 INFO:teuthology.orchestra.run.smithi179.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:20.198 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/176 2023-12-07T01:19:20.198 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/176 2023-12-07T01:19:20.198 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:20.210 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:20.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:20.264 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-12-07T01:19:20.495 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:20.498 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:20.499 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:20.500 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:20.500 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:20.993 INFO:teuthology.orchestra.run.smithi179.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-07T01:19:20.998 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/177 2023-12-07T01:19:20.998 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/177 2023-12-07T01:19:20.998 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:20.999 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:21.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:21.353 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-12-07T01:19:21.634 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:21.635 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:21.637 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:21.638 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:21.638 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:22.006 INFO:teuthology.orchestra.run.smithi179.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:19:22.010 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/178 2023-12-07T01:19:22.010 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/178 2023-12-07T01:19:22.010 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:22.011 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:22.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:22.333 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-12-07T01:19:22.648 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:22.653 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:22.653 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:22.654 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:22.654 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:23.003 INFO:teuthology.orchestra.run.smithi179.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:19:23.007 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/179 2023-12-07T01:19:23.007 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/179 2023-12-07T01:19:23.007 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:23.009 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:23.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:23.371 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-12-07T01:19:23.640 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:23.644 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:23.644 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:23.645 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:23.645 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:23.991 INFO:teuthology.orchestra.run.smithi179.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:19:23.995 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/180 2023-12-07T01:19:23.995 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/180 2023-12-07T01:19:23.995 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:23.997 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:24.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:24.333 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-12-07T01:19:24.629 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:24.634 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:24.634 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:24.635 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:24.636 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:24.982 INFO:teuthology.orchestra.run.smithi179.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:19:24.986 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/181 2023-12-07T01:19:24.986 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/181 2023-12-07T01:19:24.986 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:24.987 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:25.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:25.410 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-12-07T01:19:25.635 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:25.639 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:25.640 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:25.641 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:25.641 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:26.000 INFO:teuthology.orchestra.run.smithi179.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-07T01:19:26.004 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/182 2023-12-07T01:19:26.004 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/182 2023-12-07T01:19:26.004 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:26.006 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:26.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:26.376 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-12-07T01:19:26.641 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:26.645 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:26.645 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:26.646 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:26.646 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:27.370 INFO:teuthology.orchestra.run.smithi179.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:27.437 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/183 2023-12-07T01:19:27.437 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/183 2023-12-07T01:19:27.437 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:27.441 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:27.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:27.621 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-12-07T01:19:27.844 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:27.848 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:27.848 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:27.849 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:27.849 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:28.213 INFO:teuthology.orchestra.run.smithi179.stdout:generic/184 0s 2023-12-07T01:19:28.218 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/184 2023-12-07T01:19:28.218 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:28.219 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:28.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:28.248 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-12-07T01:19:28.457 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:28.461 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:28.461 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:28.462 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:28.462 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:29.346 INFO:teuthology.orchestra.run.smithi179.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:29.358 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/185 2023-12-07T01:19:29.359 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/185 2023-12-07T01:19:29.359 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:29.362 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:29.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:29.433 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-12-07T01:19:29.638 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:29.643 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:29.643 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:29.643 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:29.643 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:30.482 INFO:teuthology.orchestra.run.smithi179.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:30.520 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/186 2023-12-07T01:19:30.520 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/186 2023-12-07T01:19:30.520 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:30.527 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:30.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:30.578 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-12-07T01:19:30.782 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:30.786 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:30.786 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:30.787 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:30.787 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:31.587 INFO:teuthology.orchestra.run.smithi179.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:31.653 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/187 2023-12-07T01:19:31.653 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/187 2023-12-07T01:19:31.653 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:31.671 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:31.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:31.720 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-12-07T01:19:31.941 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:31.945 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:31.945 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:31.946 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:31.946 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:32.705 INFO:teuthology.orchestra.run.smithi179.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:32.714 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/188 2023-12-07T01:19:32.714 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/188 2023-12-07T01:19:32.714 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:32.718 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:32.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:32.905 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-12-07T01:19:33.119 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:33.123 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:33.123 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:33.124 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:33.124 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:33.887 INFO:teuthology.orchestra.run.smithi179.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:33.896 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/189 2023-12-07T01:19:33.896 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/189 2023-12-07T01:19:33.896 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:33.900 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:34.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:34.042 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-12-07T01:19:34.248 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:34.252 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:34.252 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:34.253 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:34.253 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:34.936 INFO:teuthology.orchestra.run.smithi179.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:34.966 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/190 2023-12-07T01:19:34.966 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/190 2023-12-07T01:19:34.966 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:35.072 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:35.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:35.212 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-12-07T01:19:35.437 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:35.440 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:35.440 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:35.441 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:35.442 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:36.295 INFO:teuthology.orchestra.run.smithi179.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:36.343 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/191 2023-12-07T01:19:36.343 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/191 2023-12-07T01:19:36.343 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:36.347 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:36.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:36.391 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-12-07T01:19:36.612 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:36.616 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:36.616 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:36.617 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:36.617 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:36.947 INFO:teuthology.orchestra.run.smithi179.stdout:generic/192 [not run] atime not maintained by ceph 2023-12-07T01:19:36.951 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/192 2023-12-07T01:19:36.952 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/192 2023-12-07T01:19:36.952 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:36.954 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:36.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:36.977 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-12-07T01:19:37.195 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:37.200 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:37.200 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:37.201 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:37.201 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:38.035 INFO:teuthology.orchestra.run.smithi179.stdout:generic/193 1s 2023-12-07T01:19:38.039 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/193 2023-12-07T01:19:38.039 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:38.041 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:38.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:38.350 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-12-07T01:19:38.694 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:38.698 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:38.699 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:38.699 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:38.700 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:39.543 INFO:teuthology.orchestra.run.smithi179.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:39.568 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/194 2023-12-07T01:19:39.568 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/194 2023-12-07T01:19:39.569 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:39.571 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:39.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:39.650 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-12-07T01:19:39.857 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:39.861 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:39.862 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:39.863 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:39.863 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:40.637 INFO:teuthology.orchestra.run.smithi179.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:40.660 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/195 2023-12-07T01:19:40.660 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/195 2023-12-07T01:19:40.660 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:40.662 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:40.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:40.803 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-12-07T01:19:41.017 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:41.020 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:41.021 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:41.022 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:41.022 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:41.867 INFO:teuthology.orchestra.run.smithi179.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:41.875 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/196 2023-12-07T01:19:41.875 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/196 2023-12-07T01:19:41.875 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:41.879 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:41.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:41.945 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-12-07T01:19:42.186 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:42.190 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:42.191 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:42.192 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:42.192 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:42.922 INFO:teuthology.orchestra.run.smithi179.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:42.936 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/197 2023-12-07T01:19:42.936 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/197 2023-12-07T01:19:42.936 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:42.967 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:43.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:43.137 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-12-07T01:19:43.340 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:43.343 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:43.344 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:43.345 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:43.345 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:44.059 INFO:teuthology.orchestra.run.smithi179.stdout:generic/198 1s 2023-12-07T01:19:44.064 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/198 2023-12-07T01:19:44.064 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:44.066 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:44.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:44.295 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-12-07T01:19:44.724 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:44.729 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:44.729 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:44.730 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:44.730 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:45.469 INFO:teuthology.orchestra.run.smithi179.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:45.498 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/199 2023-12-07T01:19:45.498 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/199 2023-12-07T01:19:45.498 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:45.501 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:45.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:45.698 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-12-07T01:19:45.956 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:45.960 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:45.960 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:45.961 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:45.962 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:46.792 INFO:teuthology.orchestra.run.smithi179.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:46.799 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/200 2023-12-07T01:19:46.799 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/200 2023-12-07T01:19:46.799 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:46.806 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:46.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:46.898 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-12-07T01:19:47.115 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:47.118 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:47.119 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:47.120 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:47.120 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:48.010 INFO:teuthology.orchestra.run.smithi179.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:48.034 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/201 2023-12-07T01:19:48.034 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/201 2023-12-07T01:19:48.034 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:48.078 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:48.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:48.115 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-12-07T01:19:48.330 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:48.334 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:48.335 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:48.335 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:48.336 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:49.107 INFO:teuthology.orchestra.run.smithi179.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:49.233 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/202 2023-12-07T01:19:49.233 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/202 2023-12-07T01:19:49.233 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:49.238 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:49.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:49.267 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-12-07T01:19:49.472 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:49.476 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:49.477 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:49.478 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:49.478 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:50.379 INFO:teuthology.orchestra.run.smithi179.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:50.398 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/203 2023-12-07T01:19:50.398 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/203 2023-12-07T01:19:50.398 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:50.400 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:50.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:50.424 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-12-07T01:19:50.635 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:50.639 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:50.639 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:50.640 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:50.640 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:53.213 INFO:teuthology.orchestra.run.smithi179.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:19:53.218 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/204 2023-12-07T01:19:53.219 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/204 2023-12-07T01:19:53.219 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:53.221 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:53.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:53.242 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-12-07T01:19:53.455 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:53.459 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:53.459 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:53.460 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:53.461 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:54.167 INFO:teuthology.orchestra.run.smithi179.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:54.172 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/205 2023-12-07T01:19:54.172 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/205 2023-12-07T01:19:54.172 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:54.175 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:54.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:54.363 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-12-07T01:19:54.604 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:54.608 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:54.609 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:54.610 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:54.610 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:55.467 INFO:teuthology.orchestra.run.smithi179.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:19:55.487 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/206 2023-12-07T01:19:55.488 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/206 2023-12-07T01:19:55.488 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:19:55.496 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:19:55.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:19:55.539 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-12-07T01:19:55.761 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:19:55.765 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:19:55.766 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:19:55.767 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:19:55.767 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:20:04.025 INFO:teuthology.orchestra.run.smithi179.stdout:generic/207 9s 2023-12-07T01:20:04.029 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/207 2023-12-07T01:20:04.029 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:20:04.031 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:20:04.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:20:04.384 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-12-07T01:20:04.632 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:20:04.636 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:20:04.637 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:20:04.638 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:20:04.638 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:20:30.915 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:20:30.922 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:21:01.010 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:21:01.013 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:21:31.145 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:21:31.148 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:22:01.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:22:01.602 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:22:01.641 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T01:22:01.640+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 321910) UID: 0 2023-12-07T01:22:01.642 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T01:22:01.640+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 321910) UID: 0 2023-12-07T01:22:01.642 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T01:22:01.640+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 321910) UID: 0 2023-12-07T01:22:01.642 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T01:22:01.640+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 321910) UID: 0 2023-12-07T01:23:25.078 INFO:teuthology.orchestra.run.smithi179.stdout:generic/208 201s 2023-12-07T01:23:25.082 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/208 2023-12-07T01:23:25.082 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:23:25.085 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:23:25.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:23:25.361 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-12-07T01:23:25.737 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:23:25.741 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:23:25.741 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:23:25.742 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:23:25.742 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:01.644 INFO:teuthology.orchestra.run.smithi179.stdout:generic/209 36s 2023-12-07T01:24:01.648 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/209 2023-12-07T01:24:01.649 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:01.650 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:02.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:02.052 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-12-07T01:24:02.292 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:02.295 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:02.296 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:02.297 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:02.297 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:02.803 INFO:teuthology.orchestra.run.smithi179.stdout:generic/210 0s 2023-12-07T01:24:02.876 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/210 2023-12-07T01:24:02.877 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:02.878 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:03.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:03.216 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-12-07T01:24:03.472 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:03.476 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:03.477 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:03.477 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:04.004 INFO:teuthology.orchestra.run.smithi179.stdout:generic/211 0s 2023-12-07T01:24:04.078 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/211 2023-12-07T01:24:04.078 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:04.080 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:04.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:04.108 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-12-07T01:24:04.310 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:04.314 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:04.314 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:04.315 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:04.315 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:04.744 INFO:teuthology.orchestra.run.smithi179.stdout:generic/212 0s 2023-12-07T01:24:04.748 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/212 2023-12-07T01:24:04.748 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:04.750 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:04.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:04.776 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-12-07T01:24:04.992 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:04.997 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:04.997 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:04.998 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:04.998 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:05.343 INFO:teuthology.orchestra.run.smithi179.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:24:05.347 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/213 2023-12-07T01:24:05.347 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/213 2023-12-07T01:24:05.347 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:05.349 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:05.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:05.374 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-12-07T01:24:05.594 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:05.598 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:05.598 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:05.599 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:05.599 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:05.949 INFO:teuthology.orchestra.run.smithi179.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:24:05.953 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/214 2023-12-07T01:24:05.953 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/214 2023-12-07T01:24:05.953 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:05.955 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:05.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:05.979 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-12-07T01:24:06.197 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:06.201 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:06.201 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:06.202 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:06.202 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:08.596 INFO:teuthology.orchestra.run.smithi179.stdout:generic/215 2s 2023-12-07T01:24:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/215 2023-12-07T01:24:08.601 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:08.603 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:08.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:08.642 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-12-07T01:24:08.844 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:08.848 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:08.848 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:08.849 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:08.850 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:09.483 INFO:teuthology.orchestra.run.smithi179.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:24:09.566 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/216 2023-12-07T01:24:09.566 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/216 2023-12-07T01:24:09.566 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:09.696 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:09.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:09.798 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-12-07T01:24:10.019 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:10.023 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:10.023 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:10.024 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:10.024 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:10.700 INFO:teuthology.orchestra.run.smithi179.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:24:10.775 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/217 2023-12-07T01:24:10.775 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/217 2023-12-07T01:24:10.775 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:10.778 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:10.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:10.964 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-12-07T01:24:11.189 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:11.193 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:11.193 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:11.194 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:11.194 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:12.011 INFO:teuthology.orchestra.run.smithi179.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:24:12.108 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/218 2023-12-07T01:24:12.108 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/218 2023-12-07T01:24:12.108 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:12.110 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:12.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:12.147 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-12-07T01:24:12.357 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:12.361 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:12.361 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:12.362 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:12.362 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:12.681 INFO:teuthology.orchestra.run.smithi179.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:24:12.684 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/219 2023-12-07T01:24:12.684 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/219 2023-12-07T01:24:12.684 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:12.687 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:12.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:12.712 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-12-07T01:24:12.924 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:12.928 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:12.928 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:12.929 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:12.929 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:13.695 INFO:teuthology.orchestra.run.smithi179.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:24:13.702 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/220 2023-12-07T01:24:13.702 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/220 2023-12-07T01:24:13.702 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:13.705 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:13.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:13.865 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-12-07T01:24:14.084 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:14.088 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:14.089 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:14.090 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:14.090 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:15.442 INFO:teuthology.orchestra.run.smithi179.stdout:generic/221 1s 2023-12-07T01:24:15.447 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/221 2023-12-07T01:24:15.447 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:15.449 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:15.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:15.477 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-12-07T01:24:15.677 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:15.681 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:15.682 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:15.683 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:15.683 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:16.603 INFO:teuthology.orchestra.run.smithi179.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:24:16.609 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/222 2023-12-07T01:24:16.610 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/222 2023-12-07T01:24:16.610 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:16.618 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:16.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:16.647 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-12-07T01:24:16.859 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:16.863 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:16.864 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:16.865 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:16.865 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:17.206 INFO:teuthology.orchestra.run.smithi179.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:24:17.209 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/223 2023-12-07T01:24:17.210 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/223 2023-12-07T01:24:17.210 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:17.211 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:17.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:17.238 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-12-07T01:24:17.440 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:17.444 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:17.445 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:17.446 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:17.446 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:17.755 INFO:teuthology.orchestra.run.smithi179.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:24:17.759 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/224 2023-12-07T01:24:17.759 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/224 2023-12-07T01:24:17.759 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:17.761 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:17.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:17.786 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-12-07T01:24:17.987 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:17.991 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:17.992 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:17.993 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:17.993 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:18.381 INFO:teuthology.orchestra.run.smithi179.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-07T01:24:18.385 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/225 2023-12-07T01:24:18.385 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/225 2023-12-07T01:24:18.385 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:18.387 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:18.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:18.659 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-12-07T01:24:19.002 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:19.006 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:19.007 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:19.008 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:19.008 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:19.371 INFO:teuthology.orchestra.run.smithi179.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:24:19.375 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/226 2023-12-07T01:24:19.375 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/226 2023-12-07T01:24:19.375 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:19.377 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:19.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:19.401 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-12-07T01:24:19.629 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:19.633 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:19.633 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:19.634 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:19.634 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:20.389 INFO:teuthology.orchestra.run.smithi179.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:24:20.495 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/227 2023-12-07T01:24:20.495 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/227 2023-12-07T01:24:20.495 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:20.536 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:20.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:20.585 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-12-07T01:24:20.799 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:20.803 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:20.803 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:20.804 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:20.805 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:21.149 INFO:teuthology.orchestra.run.smithi179.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:24:21.153 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/228 2023-12-07T01:24:21.153 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/228 2023-12-07T01:24:21.153 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:21.155 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:21.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:21.183 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-12-07T01:24:21.390 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:21.394 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:21.394 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:21.395 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:21.395 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:24:22.304 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/229 2023-12-07T01:24:22.312 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/229 2023-12-07T01:24:22.312 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:22.322 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:22.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:22.353 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-12-07T01:24:22.568 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:22.572 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:22.572 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:22.573 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:22.573 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:22.944 INFO:teuthology.orchestra.run.smithi179.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:24:22.948 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/230 2023-12-07T01:24:22.948 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/230 2023-12-07T01:24:22.949 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:22.951 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:22.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:22.985 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-12-07T01:24:23.199 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:23.203 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:23.204 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:23.204 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:23.205 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:23.736 INFO:teuthology.orchestra.run.smithi179.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:24:23.740 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/231 2023-12-07T01:24:23.740 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/231 2023-12-07T01:24:23.740 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:23.741 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:23.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:23.770 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-12-07T01:24:24.019 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:24.024 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:24.024 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:24.025 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:24.025 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:24.459 INFO:teuthology.orchestra.run.smithi179.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:24:24.463 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/232 2023-12-07T01:24:24.463 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/232 2023-12-07T01:24:24.463 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:24.465 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:24.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:24.498 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-12-07T01:24:24.710 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:24.714 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:24.715 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:24.716 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:24.716 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:25.036 INFO:teuthology.orchestra.run.smithi179.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:24:25.040 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/233 2023-12-07T01:24:25.040 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/233 2023-12-07T01:24:25.041 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:25.043 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:25.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:25.060 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-12-07T01:24:25.264 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:25.269 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:25.269 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:25.270 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:25.270 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:25.593 INFO:teuthology.orchestra.run.smithi179.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:24:25.598 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/234 2023-12-07T01:24:25.598 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/234 2023-12-07T01:24:25.598 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:25.599 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:25.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:25.627 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-12-07T01:24:25.845 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:25.849 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:25.850 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:25.851 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:25.851 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:26.169 INFO:teuthology.orchestra.run.smithi179.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:24:26.173 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/235 2023-12-07T01:24:26.173 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/235 2023-12-07T01:24:26.173 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:26.175 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:26.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:26.196 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-12-07T01:24:26.406 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:26.410 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:26.410 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:26.411 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:26.411 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:27.819 INFO:teuthology.orchestra.run.smithi179.stdout:generic/236 1s 2023-12-07T01:24:27.825 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/236 2023-12-07T01:24:27.825 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:27.827 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:28.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:28.200 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-12-07T01:24:28.426 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:28.430 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:28.430 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:28.431 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:28.838 INFO:teuthology.orchestra.run.smithi179.stdout:generic/237 0s 2023-12-07T01:24:28.843 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/237 2023-12-07T01:24:28.843 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:28.845 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:29.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:29.003 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-12-07T01:24:29.429 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:29.433 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:29.433 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:29.434 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:29.434 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:30.218 INFO:teuthology.orchestra.run.smithi179.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:24:30.241 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/238 2023-12-07T01:24:30.241 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/238 2023-12-07T01:24:30.241 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:24:30.246 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:30.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:24:30.340 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-12-07T01:24:30.545 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:24:30.549 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:24:30.549 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:24:30.550 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:24:30.550 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:24:54.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:24:54.359 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:24:54.625 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T01:24:54.625+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117087) UID: 0 2023-12-07T01:24:54.626 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T01:24:54.625+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117087) UID: 0 2023-12-07T01:24:54.629 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T01:24:54.628+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117087) UID: 0 2023-12-07T01:24:54.631 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T01:24:54.631+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117087) UID: 0 2023-12-07T01:26:29.943 INFO:teuthology.orchestra.run.smithi179.stdout:generic/239 119s 2023-12-07T01:26:29.954 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/239 2023-12-07T01:26:29.954 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:26:29.954 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:26:30.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:26:30.282 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-12-07T01:26:30.526 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:26:30.530 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:26:30.531 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:26:30.532 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:26:30.532 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:26:31.220 INFO:teuthology.orchestra.run.smithi179.stdout:generic/240 1s 2023-12-07T01:26:31.225 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/240 2023-12-07T01:26:31.226 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:26:31.229 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:26:31.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:26:31.561 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-12-07T01:26:31.852 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:26:31.856 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:26:31.857 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:26:31.857 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:26:31.857 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:45.297 INFO:teuthology.orchestra.run.smithi179.stdout:generic/241 73s 2023-12-07T01:27:45.301 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/241 2023-12-07T01:27:45.301 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:27:45.305 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:46.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:27:46.391 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-12-07T01:27:46.616 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:27:46.620 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:27:46.620 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:27:46.621 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:27:46.621 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:47.706 INFO:teuthology.orchestra.run.smithi179.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:27:47.712 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/242 2023-12-07T01:27:47.712 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/242 2023-12-07T01:27:47.712 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:27:47.716 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:47.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:27:47.835 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-12-07T01:27:48.064 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:27:48.068 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:27:48.068 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:27:48.069 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:27:48.069 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:48.838 INFO:teuthology.orchestra.run.smithi179.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:27:48.922 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/243 2023-12-07T01:27:48.922 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/243 2023-12-07T01:27:48.922 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:27:48.952 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:48.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:27:49.000 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-12-07T01:27:49.214 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:27:49.218 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:27:49.219 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:27:49.219 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:27:49.220 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:49.550 INFO:teuthology.orchestra.run.smithi179.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:27:49.554 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/244 2023-12-07T01:27:49.554 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/244 2023-12-07T01:27:49.555 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:27:49.556 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:49.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:27:49.576 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-12-07T01:27:49.798 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:27:49.802 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:27:49.802 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:27:49.803 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:27:49.803 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:50.262 INFO:teuthology.orchestra.run.smithi179.stdout:generic/245 0s 2023-12-07T01:27:50.332 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/245 2023-12-07T01:27:50.332 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:27:50.333 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:50.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:27:50.547 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-12-07T01:27:50.920 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:27:50.924 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:27:50.924 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:27:50.925 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:27:50.925 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:51.331 INFO:teuthology.orchestra.run.smithi179.stdout:generic/246 0s 2023-12-07T01:27:51.397 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/246 2023-12-07T01:27:51.397 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:27:51.399 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:27:51.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:27:51.754 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-12-07T01:27:52.004 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:27:52.008 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:27:52.009 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:27:52.009 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:27:52.010 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:03.214 INFO:teuthology.orchestra.run.smithi179.stdout:generic/247 11s 2023-12-07T01:28:03.219 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/247 2023-12-07T01:28:03.219 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:03.221 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:03.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:03.229 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-12-07T01:28:03.429 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:03.435 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:03.436 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:03.436 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:03.783 INFO:teuthology.orchestra.run.smithi179.stdout:generic/248 0s 2023-12-07T01:28:03.788 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/248 2023-12-07T01:28:03.788 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:03.790 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:03.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:03.832 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-12-07T01:28:04.030 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:04.034 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:04.035 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:04.036 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:04.036 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:04.615 INFO:teuthology.orchestra.run.smithi179.stdout:generic/249 0s 2023-12-07T01:28:04.620 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/249 2023-12-07T01:28:04.620 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:04.622 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:04.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:04.974 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-12-07T01:28:05.240 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:05.244 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:05.245 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:05.245 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:05.245 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:05.577 INFO:teuthology.orchestra.run.smithi179.stdout:generic/250 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:28:05.581 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/250 2023-12-07T01:28:05.581 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/250 2023-12-07T01:28:05.581 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:05.583 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:05.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:05.615 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-12-07T01:28:05.836 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:05.840 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:05.840 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:05.841 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:05.842 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:06.335 INFO:teuthology.orchestra.run.smithi179.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:06.354 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/251 2023-12-07T01:28:06.354 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/251 2023-12-07T01:28:06.354 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:06.356 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:06.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:06.385 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-12-07T01:28:06.604 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:06.607 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:06.608 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:06.609 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:06.609 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:06.933 INFO:teuthology.orchestra.run.smithi179.stdout:generic/252 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:28:06.936 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/252 2023-12-07T01:28:06.937 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/252 2023-12-07T01:28:06.937 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:06.939 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:06.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:06.972 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-12-07T01:28:07.192 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:07.196 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:07.196 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:07.197 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:07.197 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:08.020 INFO:teuthology.orchestra.run.smithi179.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:08.052 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/253 2023-12-07T01:28:08.052 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/253 2023-12-07T01:28:08.052 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:08.054 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:08.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:08.092 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-12-07T01:28:08.301 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:08.305 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:08.305 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:08.306 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:08.306 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:09.113 INFO:teuthology.orchestra.run.smithi179.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:09.159 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/254 2023-12-07T01:28:09.159 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/254 2023-12-07T01:28:09.159 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:09.166 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:09.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:09.239 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-12-07T01:28:09.444 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:09.448 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:09.448 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:09.449 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:09.450 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:09.879 INFO:teuthology.orchestra.run.smithi179.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:28:09.883 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/255 2023-12-07T01:28:09.883 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/255 2023-12-07T01:28:09.883 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:09.885 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:10.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:10.213 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-12-07T01:28:10.462 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:10.466 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:10.466 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:10.467 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:10.467 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:10.972 INFO:teuthology.orchestra.run.smithi179.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:28:10.977 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/256 2023-12-07T01:28:10.977 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/256 2023-12-07T01:28:10.977 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:10.978 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:11.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:11.008 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-12-07T01:28:11.211 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:11.215 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:11.215 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:11.216 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:11.216 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:12.042 INFO:teuthology.orchestra.run.smithi179.stdout:generic/257 1s 2023-12-07T01:28:12.047 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/257 2023-12-07T01:28:12.047 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:12.049 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:12.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:12.364 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-12-07T01:28:12.689 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:12.693 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:12.693 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:12.694 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:12.694 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:13.107 INFO:teuthology.orchestra.run.smithi179.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-12-07T01:28:13.111 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/258 2023-12-07T01:28:13.111 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/258 2023-12-07T01:28:13.112 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:13.113 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:13.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:13.137 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-12-07T01:28:13.354 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:13.358 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:13.358 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:13.359 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:13.359 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:14.135 INFO:teuthology.orchestra.run.smithi179.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:14.216 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/259 2023-12-07T01:28:14.216 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/259 2023-12-07T01:28:14.216 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:14.221 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:14.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:14.286 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-12-07T01:28:14.489 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:14.493 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:14.493 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:14.494 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:14.494 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:14.975 INFO:teuthology.orchestra.run.smithi179.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:15.002 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/260 2023-12-07T01:28:15.002 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/260 2023-12-07T01:28:15.002 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:15.004 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:15.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:15.029 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-12-07T01:28:15.233 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:15.237 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:15.237 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:15.238 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:15.239 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:16.082 INFO:teuthology.orchestra.run.smithi179.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:16.093 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/261 2023-12-07T01:28:16.093 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/261 2023-12-07T01:28:16.093 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:16.095 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:16.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:16.183 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-12-07T01:28:16.389 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:16.393 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:16.394 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:16.395 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:16.395 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:17.222 INFO:teuthology.orchestra.run.smithi179.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:17.228 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/262 2023-12-07T01:28:17.228 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/262 2023-12-07T01:28:17.228 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:17.231 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:17.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:17.300 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-12-07T01:28:17.515 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:17.519 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:17.520 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:17.520 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:17.521 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:20.798 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:28:20.801 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:28:20.838 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T01:28:20.838+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 350721) UID: 0 2023-12-07T01:28:20.838 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T01:28:20.838+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 350721) UID: 0 2023-12-07T01:28:54.255 INFO:teuthology.orchestra.run.smithi179.stdout:generic/263 37s 2023-12-07T01:28:54.297 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/263 2023-12-07T01:28:54.297 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:54.299 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:54.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:54.749 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-12-07T01:28:55.012 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:55.015 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:55.016 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:55.016 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:55.017 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:55.893 INFO:teuthology.orchestra.run.smithi179.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:55.910 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/264 2023-12-07T01:28:55.910 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/264 2023-12-07T01:28:55.911 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:55.915 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:55.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:55.947 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-12-07T01:28:56.156 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:56.160 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:56.161 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:56.162 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:56.162 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:57.012 INFO:teuthology.orchestra.run.smithi179.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:57.055 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/265 2023-12-07T01:28:57.055 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/265 2023-12-07T01:28:57.055 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:57.064 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:57.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:57.095 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-12-07T01:28:57.298 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:57.302 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:57.303 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:57.304 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:57.304 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:58.018 INFO:teuthology.orchestra.run.smithi179.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:58.227 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/266 2023-12-07T01:28:58.227 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/266 2023-12-07T01:28:58.227 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:58.246 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:58.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:58.270 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-12-07T01:28:58.490 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:58.493 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:58.493 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:58.494 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:58.494 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:59.295 INFO:teuthology.orchestra.run.smithi179.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:28:59.324 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/267 2023-12-07T01:28:59.324 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/267 2023-12-07T01:28:59.324 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:28:59.399 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:28:59.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:28:59.446 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-12-07T01:28:59.647 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:28:59.651 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:28:59.651 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:28:59.652 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:28:59.652 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:00.402 INFO:teuthology.orchestra.run.smithi179.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:00.412 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/268 2023-12-07T01:29:00.413 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/268 2023-12-07T01:29:00.413 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:00.420 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:00.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:00.589 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-12-07T01:29:00.818 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:00.821 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:00.822 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:00.823 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:00.823 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:01.135 INFO:teuthology.orchestra.run.smithi179.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:29:01.139 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/269 2023-12-07T01:29:01.139 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/269 2023-12-07T01:29:01.139 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:01.141 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:01.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:01.160 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-12-07T01:29:01.365 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:01.370 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:01.370 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:01.371 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:01.371 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:01.680 INFO:teuthology.orchestra.run.smithi179.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:29:01.682 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/270 2023-12-07T01:29:01.682 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/270 2023-12-07T01:29:01.682 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:01.684 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:01.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:01.705 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-12-07T01:29:01.919 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:01.923 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:01.924 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:01.924 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:01.924 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:02.705 INFO:teuthology.orchestra.run.smithi179.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:02.717 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/271 2023-12-07T01:29:02.718 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/271 2023-12-07T01:29:02.718 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:02.843 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:02.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:02.891 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-12-07T01:29:03.108 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:03.111 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:03.112 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:03.113 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:03.113 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:03.862 INFO:teuthology.orchestra.run.smithi179.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/272 2023-12-07T01:29:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/272 2023-12-07T01:29:03.907 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:03.994 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:04.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:04.088 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-12-07T01:29:04.305 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:04.309 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:04.309 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:04.310 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:04.310 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:04.629 INFO:teuthology.orchestra.run.smithi179.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:29:04.633 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/273 2023-12-07T01:29:04.633 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/273 2023-12-07T01:29:04.633 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:04.634 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:04.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:04.659 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-12-07T01:29:04.862 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:04.866 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:04.866 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:04.867 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:04.867 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:05.200 INFO:teuthology.orchestra.run.smithi179.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-07T01:29:05.204 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/274 2023-12-07T01:29:05.205 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/274 2023-12-07T01:29:05.205 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:05.207 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:05.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:05.235 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-12-07T01:29:05.443 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:05.447 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:05.448 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:05.449 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:05.449 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:05.777 INFO:teuthology.orchestra.run.smithi179.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:29:05.781 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/275 2023-12-07T01:29:05.781 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/275 2023-12-07T01:29:05.781 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:05.783 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:05.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:05.804 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-12-07T01:29:06.008 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:06.010 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:06.011 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:06.012 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:06.012 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:07.428 INFO:teuthology.orchestra.run.smithi179.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:07.432 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/276 2023-12-07T01:29:07.433 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/276 2023-12-07T01:29:07.433 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:07.434 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:07.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:07.455 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-12-07T01:29:07.663 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:07.667 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:07.668 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:07.668 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:07.669 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:08.060 INFO:teuthology.orchestra.run.smithi179.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-12-07T01:29:08.064 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/277 2023-12-07T01:29:08.064 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/277 2023-12-07T01:29:08.064 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:08.066 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:08.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:08.092 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-12-07T01:29:08.413 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:08.418 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:08.418 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:08.419 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:08.419 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:09.376 INFO:teuthology.orchestra.run.smithi179.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:09.384 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/278 2023-12-07T01:29:09.384 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/278 2023-12-07T01:29:09.384 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:09.387 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:09.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:09.445 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-12-07T01:29:09.662 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:09.665 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:09.666 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:09.667 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:09.668 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:10.574 INFO:teuthology.orchestra.run.smithi179.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:10.599 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/279 2023-12-07T01:29:10.599 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/279 2023-12-07T01:29:10.599 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:10.603 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:10.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:10.633 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-12-07T01:29:10.838 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:10.842 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:10.843 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:10.844 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:10.844 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:11.257 INFO:teuthology.orchestra.run.smithi179.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:29:11.261 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/280 2023-12-07T01:29:11.261 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/280 2023-12-07T01:29:11.261 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:11.263 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:11.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:11.283 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-12-07T01:29:11.485 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:11.489 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:11.489 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:11.490 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:11.490 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:12.368 INFO:teuthology.orchestra.run.smithi179.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:12.381 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/281 2023-12-07T01:29:12.381 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/281 2023-12-07T01:29:12.381 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:12.388 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:12.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:12.420 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-12-07T01:29:12.637 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:12.641 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:12.642 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:12.642 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:12.642 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:13.539 INFO:teuthology.orchestra.run.smithi179.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:13.561 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/282 2023-12-07T01:29:13.561 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/282 2023-12-07T01:29:13.561 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:13.563 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:13.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:13.880 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-12-07T01:29:14.098 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:14.102 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:14.102 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:14.103 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:14.103 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:14.975 INFO:teuthology.orchestra.run.smithi179.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:14.980 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/283 2023-12-07T01:29:14.980 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/283 2023-12-07T01:29:14.980 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:14.992 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:15.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:15.122 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-12-07T01:29:15.346 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:15.350 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:15.350 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:15.352 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:15.352 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:16.169 INFO:teuthology.orchestra.run.smithi179.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:16.206 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/284 2023-12-07T01:29:16.206 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/284 2023-12-07T01:29:16.206 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:16.221 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:16.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:16.272 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-12-07T01:29:16.497 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:16.501 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:16.501 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:16.502 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:16.503 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:17.819 INFO:teuthology.orchestra.run.smithi179.stdout:generic/285 1s 2023-12-07T01:29:17.824 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/285 2023-12-07T01:29:17.824 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:17.826 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:18.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:18.425 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-12-07T01:29:18.711 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:18.714 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:18.715 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:18.716 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:18.716 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:19.210 INFO:teuthology.orchestra.run.smithi179.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:29:19.216 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/286 2023-12-07T01:29:19.216 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/286 2023-12-07T01:29:19.216 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:19.218 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:19.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:19.279 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-12-07T01:29:19.738 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:19.743 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:19.744 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:19.745 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:19.745 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:21.040 INFO:teuthology.orchestra.run.smithi179.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:21.047 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/287 2023-12-07T01:29:21.047 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/287 2023-12-07T01:29:21.047 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:21.057 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:21.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:21.096 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-12-07T01:29:21.595 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:21.617 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:21.617 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:21.619 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:21.619 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:22.376 INFO:teuthology.orchestra.run.smithi179.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:22.413 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/288 2023-12-07T01:29:22.413 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/288 2023-12-07T01:29:22.413 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:22.415 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:22.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:22.444 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-12-07T01:29:22.886 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:22.894 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:22.894 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:22.895 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:22.895 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:24.060 INFO:teuthology.orchestra.run.smithi179.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:24.089 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/289 2023-12-07T01:29:24.089 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/289 2023-12-07T01:29:24.089 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:24.112 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:24.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:24.170 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-12-07T01:29:24.574 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:24.585 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:24.585 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:24.586 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:24.586 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:25.354 INFO:teuthology.orchestra.run.smithi179.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:25.486 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/290 2023-12-07T01:29:25.486 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/290 2023-12-07T01:29:25.486 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:25.513 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:25.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:25.561 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-12-07T01:29:25.767 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:25.770 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:25.771 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:25.772 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:25.772 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:26.472 INFO:teuthology.orchestra.run.smithi179.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:26.478 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/291 2023-12-07T01:29:26.478 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/291 2023-12-07T01:29:26.478 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:26.487 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:26.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:26.687 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-12-07T01:29:26.908 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:26.912 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:26.912 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:26.913 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:26.913 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:27.729 INFO:teuthology.orchestra.run.smithi179.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:27.799 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/292 2023-12-07T01:29:27.800 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/292 2023-12-07T01:29:27.800 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:27.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:27.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:27.840 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-12-07T01:29:28.063 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:28.066 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:28.067 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:28.068 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:28.068 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:28.814 INFO:teuthology.orchestra.run.smithi179.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:28.915 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/293 2023-12-07T01:29:28.915 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/293 2023-12-07T01:29:28.915 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:28.919 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:29.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:29.021 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-12-07T01:29:29.221 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:29.224 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:29.225 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:29.226 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:29.226 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:30.376 INFO:teuthology.orchestra.run.smithi179.stdout:generic/294 1s 2023-12-07T01:29:30.447 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/294 2023-12-07T01:29:30.447 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:30.450 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:30.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:30.461 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-12-07T01:29:30.685 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:30.688 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:30.689 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:30.690 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:30.690 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:31.554 INFO:teuthology.orchestra.run.smithi179.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:31.562 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/295 2023-12-07T01:29:31.563 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/295 2023-12-07T01:29:31.563 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:31.566 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:31.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:31.646 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-12-07T01:29:32.036 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:32.041 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:32.041 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:32.042 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:32.042 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:32.877 INFO:teuthology.orchestra.run.smithi179.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:32.929 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/296 2023-12-07T01:29:32.929 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/296 2023-12-07T01:29:32.929 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:32.961 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:33.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:33.014 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-12-07T01:29:33.241 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:33.245 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:33.245 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:33.246 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:33.246 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:34.082 INFO:teuthology.orchestra.run.smithi179.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:34.106 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/297 2023-12-07T01:29:34.106 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/297 2023-12-07T01:29:34.106 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:34.108 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:34.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:34.175 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-12-07T01:29:34.432 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:34.438 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:34.438 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:34.439 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:34.439 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:35.325 INFO:teuthology.orchestra.run.smithi179.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:35.341 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/298 2023-12-07T01:29:35.342 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/298 2023-12-07T01:29:35.342 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:35.348 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:35.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:35.416 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-12-07T01:29:35.617 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:35.621 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:35.621 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:35.622 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:35.622 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:36.058 INFO:teuthology.orchestra.run.smithi179.stdout:generic/299 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:29:36.062 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/299 2023-12-07T01:29:36.062 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/299 2023-12-07T01:29:36.062 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:36.064 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:36.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:36.091 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-12-07T01:29:36.302 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:36.306 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:36.306 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:36.307 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:36.307 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:36.718 INFO:teuthology.orchestra.run.smithi179.stdout:generic/300 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:29:36.722 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/300 2023-12-07T01:29:36.722 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/300 2023-12-07T01:29:36.722 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:36.724 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:36.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:36.751 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-12-07T01:29:36.962 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:36.966 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:36.967 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:36.967 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:36.968 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:37.815 INFO:teuthology.orchestra.run.smithi179.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:37.853 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/301 2023-12-07T01:29:37.853 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/301 2023-12-07T01:29:37.853 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:37.859 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:37.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:37.911 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-12-07T01:29:38.127 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:38.131 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:38.132 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:38.133 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:38.133 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:39.001 INFO:teuthology.orchestra.run.smithi179.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:39.023 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/302 2023-12-07T01:29:39.024 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/302 2023-12-07T01:29:39.024 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:39.032 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:39.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:39.057 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-12-07T01:29:39.263 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:39.267 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:39.268 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:39.268 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:39.268 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:39.637 INFO:teuthology.orchestra.run.smithi179.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:29:39.640 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/303 2023-12-07T01:29:39.641 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/303 2023-12-07T01:29:39.641 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:39.642 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:40.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:40.026 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-12-07T01:29:40.270 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:40.274 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:40.274 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:40.275 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:40.275 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:40.629 INFO:teuthology.orchestra.run.smithi179.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-07T01:29:40.633 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/304 2023-12-07T01:29:40.633 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/304 2023-12-07T01:29:40.633 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:40.635 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:40.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:40.940 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-12-07T01:29:41.230 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:41.234 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:41.235 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:41.236 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:41.236 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:42.117 INFO:teuthology.orchestra.run.smithi179.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:29:42.146 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/305 2023-12-07T01:29:42.146 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/305 2023-12-07T01:29:42.146 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:42.152 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:42.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:42.179 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-12-07T01:29:42.389 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:42.393 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:42.394 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:42.395 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:42.395 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:43.301 INFO:teuthology.orchestra.run.smithi179.stdout:generic/306 1s 2023-12-07T01:29:43.333 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/306 2023-12-07T01:29:43.333 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:43.471 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:43.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:43.683 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-12-07T01:29:44.101 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:44.105 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:44.105 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:44.107 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:44.107 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:45.924 INFO:teuthology.orchestra.run.smithi179.stdout:generic/307 1s 2023-12-07T01:29:45.929 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/307 2023-12-07T01:29:45.929 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:45.933 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:45.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:45.940 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-12-07T01:29:46.146 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:46.150 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:46.150 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:46.151 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:46.151 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:46.503 INFO:teuthology.orchestra.run.smithi179.stdout:generic/308 0s 2023-12-07T01:29:46.507 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/308 2023-12-07T01:29:46.507 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:46.509 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:46.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:46.539 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-12-07T01:29:47.171 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:47.193 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:47.193 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:47.194 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:47.194 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:48.927 INFO:teuthology.orchestra.run.smithi179.stdout:generic/309 1s 2023-12-07T01:29:48.932 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/309 2023-12-07T01:29:48.932 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:29:48.934 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:29:49.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:29:49.191 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-12-07T01:29:49.647 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:29:49.651 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:29:49.651 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:29:49.652 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:29:49.652 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:06.160 INFO:teuthology.orchestra.run.smithi179.stdout:generic/310 77s 2023-12-07T01:31:06.241 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/310 2023-12-07T01:31:06.241 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:06.244 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:06.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:06.628 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-12-07T01:31:07.023 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:07.027 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:07.027 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:07.029 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:07.029 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:07.467 INFO:teuthology.orchestra.run.smithi179.stdout:generic/311 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:31:07.470 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/311 2023-12-07T01:31:07.470 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/311 2023-12-07T01:31:07.470 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:07.472 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:07.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:07.500 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-12-07T01:31:07.717 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:07.721 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:07.721 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:07.722 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:07.722 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:08.040 INFO:teuthology.orchestra.run.smithi179.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:31:08.045 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/312 2023-12-07T01:31:08.045 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/312 2023-12-07T01:31:08.045 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:08.046 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:08.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:08.071 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-12-07T01:31:08.287 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:08.291 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:08.291 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:08.292 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:08.293 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:12.668 INFO:teuthology.orchestra.run.smithi179.stdout:generic/313 4s 2023-12-07T01:31:12.673 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/313 2023-12-07T01:31:12.673 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:12.676 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:12.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:12.712 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-12-07T01:31:12.935 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:12.939 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:12.939 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:12.940 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:12.940 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:13.470 INFO:teuthology.orchestra.run.smithi179.stdout:generic/314 0s 2023-12-07T01:31:13.475 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/314 2023-12-07T01:31:13.475 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:13.477 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:13.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:13.508 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-12-07T01:31:13.727 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:13.731 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:13.731 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:13.732 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:13.732 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:14.073 INFO:teuthology.orchestra.run.smithi179.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-07T01:31:14.077 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/315 2023-12-07T01:31:14.077 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/315 2023-12-07T01:31:14.077 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:14.079 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:14.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:14.107 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-12-07T01:31:14.310 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:14.314 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:14.314 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:14.316 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:14.316 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:14.781 INFO:teuthology.orchestra.run.smithi179.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-07T01:31:14.785 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/316 2023-12-07T01:31:14.785 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/316 2023-12-07T01:31:14.785 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:14.787 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:14.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:14.983 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-12-07T01:31:15.380 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:15.384 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:15.385 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:15.386 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:15.386 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:19.731 INFO:teuthology.orchestra.run.smithi179.stdout:generic/317 4s 2023-12-07T01:31:19.736 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/317 2023-12-07T01:31:19.736 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:19.738 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:19.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:19.747 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-12-07T01:31:19.968 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:19.972 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:19.972 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:19.973 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:19.973 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:20.810 INFO:teuthology.orchestra.run.smithi179.stdout:generic/318 0s 2023-12-07T01:31:20.815 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/318 2023-12-07T01:31:20.815 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:20.817 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:20.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:20.826 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-12-07T01:31:21.030 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:21.034 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:21.035 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:21.036 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:21.036 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:21.620 INFO:teuthology.orchestra.run.smithi179.stdout:generic/319 0s 2023-12-07T01:31:21.625 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/319 2023-12-07T01:31:21.625 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:21.627 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:21.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:21.636 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-12-07T01:31:21.839 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:21.843 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:21.843 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:21.845 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:21.845 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:22.164 INFO:teuthology.orchestra.run.smithi179.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:31:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/320 2023-12-07T01:31:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/320 2023-12-07T01:31:22.168 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:22.170 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:22.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:22.195 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-12-07T01:31:22.408 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:22.412 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:22.412 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:22.413 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:22.413 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:22.742 INFO:teuthology.orchestra.run.smithi179.stdout:generic/321 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:31:22.746 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/321 2023-12-07T01:31:22.746 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/321 2023-12-07T01:31:22.746 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:22.748 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:22.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:22.771 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-12-07T01:31:22.982 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:22.987 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:22.987 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:22.988 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:22.988 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:23.320 INFO:teuthology.orchestra.run.smithi179.stdout:generic/322 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:31:23.324 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/322 2023-12-07T01:31:23.324 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/322 2023-12-07T01:31:23.324 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:31:23.326 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:23.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:31:23.352 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-12-07T01:31:23.555 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:31:23.560 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:31:23.560 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:31:23.561 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:31:23.561 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:31:41.737 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:31:41.740 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:32:12.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:32:12.035 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:32:42.163 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:32:42.166 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:33:12.236 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:33:12.240 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:33:12.513 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T01:33:12.513+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 384861) UID: 0 2023-12-07T01:33:12.514 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T01:33:12.513+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 384861) UID: 0 2023-12-07T01:33:12.514 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T01:33:12.513+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 384861) UID: 0 2023-12-07T01:33:12.514 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T01:33:12.514+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 384861) UID: 0 2023-12-07T01:33:24.450 INFO:teuthology.orchestra.run.smithi179.stdout:generic/323 121s 2023-12-07T01:33:24.512 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/323 2023-12-07T01:33:24.513 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:24.514 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:24.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:24.799 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-12-07T01:33:25.126 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:25.129 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:25.130 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:25.131 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:25.131 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:25.466 INFO:teuthology.orchestra.run.smithi179.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-12-07T01:33:25.470 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/324 2023-12-07T01:33:25.470 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/324 2023-12-07T01:33:25.470 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:25.472 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:25.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:25.501 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-12-07T01:33:25.713 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:25.717 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:25.718 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:25.719 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:25.719 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:26.052 INFO:teuthology.orchestra.run.smithi179.stdout:generic/325 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:33:26.055 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/325 2023-12-07T01:33:26.055 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/325 2023-12-07T01:33:26.056 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:26.057 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:26.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:26.087 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-12-07T01:33:26.302 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:26.306 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:26.306 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:26.307 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:26.307 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:27.514 INFO:teuthology.orchestra.run.smithi179.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:27.522 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/326 2023-12-07T01:33:27.522 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/326 2023-12-07T01:33:27.522 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:27.526 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:27.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:27.624 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-12-07T01:33:27.843 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:27.847 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:27.848 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:27.849 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:27.849 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:28.666 INFO:teuthology.orchestra.run.smithi179.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:28.749 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/327 2023-12-07T01:33:28.750 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/327 2023-12-07T01:33:28.750 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:28.752 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:28.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:28.800 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-12-07T01:33:29.017 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:29.021 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:29.021 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:29.022 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:29.022 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:29.888 INFO:teuthology.orchestra.run.smithi179.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:29.912 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/328 2023-12-07T01:33:29.912 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/328 2023-12-07T01:33:29.912 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:29.923 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:29.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:29.959 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-12-07T01:33:30.186 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:30.189 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:30.190 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:30.194 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:30.194 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:31.536 INFO:teuthology.orchestra.run.smithi179.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:31.544 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/329 2023-12-07T01:33:31.544 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/329 2023-12-07T01:33:31.544 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:31.548 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:31.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:31.626 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-12-07T01:33:31.852 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:31.856 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:31.856 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:31.857 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:31.857 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:32.626 INFO:teuthology.orchestra.run.smithi179.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:32.732 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/330 2023-12-07T01:33:32.732 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/330 2023-12-07T01:33:32.732 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:32.737 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:32.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:32.799 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-12-07T01:33:33.014 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:33.017 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:33.018 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:33.019 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:33.019 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:33.915 INFO:teuthology.orchestra.run.smithi179.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:33.923 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/331 2023-12-07T01:33:33.923 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/331 2023-12-07T01:33:33.923 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:33.926 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:33.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:33.964 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-12-07T01:33:34.174 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:34.178 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:34.179 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:34.179 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:34.180 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:34.993 INFO:teuthology.orchestra.run.smithi179.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:34.998 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/332 2023-12-07T01:33:34.999 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/332 2023-12-07T01:33:34.999 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:35.054 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:35.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:35.098 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-12-07T01:33:35.328 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:35.332 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:35.332 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:35.333 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:35.333 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:36.161 INFO:teuthology.orchestra.run.smithi179.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:36.206 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/333 2023-12-07T01:33:36.206 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/333 2023-12-07T01:33:36.206 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:36.207 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:36.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:36.309 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-12-07T01:33:36.522 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:36.526 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:36.526 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:36.527 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:36.527 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:37.294 INFO:teuthology.orchestra.run.smithi179.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:33:37.299 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/334 2023-12-07T01:33:37.299 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/334 2023-12-07T01:33:37.299 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:37.302 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:37.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:37.437 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-12-07T01:33:37.674 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:37.678 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:37.678 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:37.679 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:37.679 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:38.019 INFO:teuthology.orchestra.run.smithi179.stdout:generic/335 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:33:38.023 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/335 2023-12-07T01:33:38.024 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/335 2023-12-07T01:33:38.024 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:38.025 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:38.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:38.047 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-12-07T01:33:38.259 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:38.264 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:38.264 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:38.265 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:38.265 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:38.624 INFO:teuthology.orchestra.run.smithi179.stdout:generic/336 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:33:38.628 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/336 2023-12-07T01:33:38.628 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/336 2023-12-07T01:33:38.628 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:38.630 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:38.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:38.664 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-12-07T01:33:38.891 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:38.895 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:38.895 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:38.896 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:38.896 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:39.490 INFO:teuthology.orchestra.run.smithi179.stdout:generic/337 0s 2023-12-07T01:33:39.496 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/337 2023-12-07T01:33:39.496 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:39.498 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:39.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:39.507 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-12-07T01:33:39.721 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:39.725 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:39.725 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:39.726 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:39.726 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:40.061 INFO:teuthology.orchestra.run.smithi179.stdout:generic/338 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:33:40.065 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/338 2023-12-07T01:33:40.065 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/338 2023-12-07T01:33:40.065 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:33:40.067 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:33:40.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:33:40.096 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-12-07T01:33:40.312 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:33:40.316 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:33:40.316 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:33:40.317 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:33:40.317 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:34.816 INFO:teuthology.orchestra.run.smithi179.stdout:generic/339 54s 2023-12-07T01:34:34.820 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/339 2023-12-07T01:34:34.820 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:34.822 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:34.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:34.831 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-12-07T01:34:35.269 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:35.273 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:35.273 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:35.274 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:35.274 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:38.376 INFO:teuthology.orchestra.run.smithi179.stdout:generic/340 3s 2023-12-07T01:34:38.409 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/340 2023-12-07T01:34:38.410 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:38.413 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:38.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:38.433 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-12-07T01:34:38.662 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:38.666 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:38.667 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:38.668 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:38.668 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:39.677 INFO:teuthology.orchestra.run.smithi179.stdout:generic/341 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:34:39.681 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/341 2023-12-07T01:34:39.681 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/341 2023-12-07T01:34:39.681 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:39.683 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:39.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:39.712 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-12-07T01:34:39.920 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:39.923 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:39.924 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:39.925 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:39.925 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:40.260 INFO:teuthology.orchestra.run.smithi179.stdout:generic/342 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:34:40.264 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/342 2023-12-07T01:34:40.264 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/342 2023-12-07T01:34:40.265 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:40.267 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:40.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:40.294 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-12-07T01:34:40.513 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:40.518 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:40.518 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:40.519 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:40.519 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:41.291 INFO:teuthology.orchestra.run.smithi179.stdout:generic/343 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:34:41.295 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/343 2023-12-07T01:34:41.295 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/343 2023-12-07T01:34:41.295 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:41.297 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:41.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:41.334 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-12-07T01:34:41.561 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:41.565 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:41.565 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:41.566 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:41.567 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:47.087 INFO:teuthology.orchestra.run.smithi179.stdout:generic/344 6s 2023-12-07T01:34:47.098 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/344 2023-12-07T01:34:47.098 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:47.101 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:47.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:47.113 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-12-07T01:34:47.543 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:47.548 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:47.549 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:47.550 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:47.550 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:53.131 INFO:teuthology.orchestra.run.smithi179.stdout:generic/345 6s 2023-12-07T01:34:53.268 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/345 2023-12-07T01:34:53.268 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:53.272 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:53.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:53.293 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-12-07T01:34:53.789 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:53.804 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:53.804 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:53.811 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:53.811 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:57.568 INFO:teuthology.orchestra.run.smithi179.stdout:generic/346 3s 2023-12-07T01:34:57.581 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/346 2023-12-07T01:34:57.581 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:57.592 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:57.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:57.603 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-12-07T01:34:57.812 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:57.816 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:57.816 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:57.817 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:57.817 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:58.466 INFO:teuthology.orchestra.run.smithi179.stdout:generic/347 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:34:58.471 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/347 2023-12-07T01:34:58.472 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/347 2023-12-07T01:34:58.472 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:58.475 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:58.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:58.519 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-12-07T01:34:58.791 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:58.797 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:58.797 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:59.127 INFO:teuthology.orchestra.run.smithi179.stdout:generic/348 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:34:59.131 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/348 2023-12-07T01:34:59.131 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/348 2023-12-07T01:34:59.131 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:59.132 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:59.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:59.161 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-12-07T01:34:59.365 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:34:59.369 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:34:59.370 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:34:59.371 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:34:59.371 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:59.771 INFO:teuthology.orchestra.run.smithi179.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-07T01:34:59.775 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/349 2023-12-07T01:34:59.775 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/349 2023-12-07T01:34:59.775 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:34:59.777 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:34:59.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:34:59.806 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-12-07T01:35:00.041 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:00.045 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:00.046 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:00.047 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:00.047 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:00.874 INFO:teuthology.orchestra.run.smithi179.stdout:generic/350 0s 2023-12-07T01:35:00.878 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/350 2023-12-07T01:35:00.879 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:00.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:00.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:00.890 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-12-07T01:35:01.120 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:01.124 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:01.125 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:01.126 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:01.126 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:01.456 INFO:teuthology.orchestra.run.smithi179.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:35:01.460 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/351 2023-12-07T01:35:01.461 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/351 2023-12-07T01:35:01.461 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:01.462 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:01.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:01.494 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-12-07T01:35:01.691 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:01.694 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:01.695 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:01.695 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:01.695 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:02.533 INFO:teuthology.orchestra.run.smithi179.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:02.543 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/352 2023-12-07T01:35:02.544 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/352 2023-12-07T01:35:02.544 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:02.558 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:02.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:02.611 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-12-07T01:35:02.823 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:02.827 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:02.827 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:02.828 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:02.828 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:03.594 INFO:teuthology.orchestra.run.smithi179.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:03.617 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/353 2023-12-07T01:35:03.617 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/353 2023-12-07T01:35:03.618 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:03.618 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:03.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:03.746 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-12-07T01:35:03.953 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:03.957 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:03.958 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:03.959 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:03.959 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:08.918 INFO:teuthology.orchestra.run.smithi179.stdout:generic/354 4s 2023-12-07T01:35:08.929 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/354 2023-12-07T01:35:08.929 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:08.932 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:08.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:08.941 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-12-07T01:35:09.279 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:09.285 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:09.285 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:09.286 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:09.286 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:10.241 INFO:teuthology.orchestra.run.smithi179.stdout:generic/355 1s 2023-12-07T01:35:10.246 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/355 2023-12-07T01:35:10.246 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:10.248 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:10.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:10.426 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-12-07T01:35:10.813 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:10.817 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:10.817 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:10.818 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:10.819 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:11.355 INFO:teuthology.orchestra.run.smithi179.stdout:generic/356 [not run] swapfiles are not supported 2023-12-07T01:35:11.359 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/356 2023-12-07T01:35:11.359 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/356 2023-12-07T01:35:11.359 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:11.361 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:11.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:11.384 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-12-07T01:35:11.593 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:11.597 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:11.597 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:11.598 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:11.598 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:12.142 INFO:teuthology.orchestra.run.smithi179.stdout:generic/357 [not run] swapfiles are not supported 2023-12-07T01:35:12.146 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/357 2023-12-07T01:35:12.146 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/357 2023-12-07T01:35:12.146 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:12.148 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:12.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:12.172 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-12-07T01:35:12.380 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:12.384 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:12.384 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:12.385 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:12.385 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:13.195 INFO:teuthology.orchestra.run.smithi179.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:13.227 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/358 2023-12-07T01:35:13.227 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/358 2023-12-07T01:35:13.227 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:13.230 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:13.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:13.278 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-12-07T01:35:13.475 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:13.479 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:13.480 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:13.481 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:13.481 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:14.272 INFO:teuthology.orchestra.run.smithi179.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:14.312 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/359 2023-12-07T01:35:14.313 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/359 2023-12-07T01:35:14.313 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:14.324 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:14.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:14.378 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-12-07T01:35:14.597 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:14.601 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:14.601 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:14.602 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:14.602 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:14.973 INFO:teuthology.orchestra.run.smithi179.stdout:generic/360 0s 2023-12-07T01:35:14.978 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/360 2023-12-07T01:35:14.978 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:14.980 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:15.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:15.011 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-12-07T01:35:15.212 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:15.219 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:15.219 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:15.219 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:15.219 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:15.546 INFO:teuthology.orchestra.run.smithi179.stdout:generic/361 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:35:15.550 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/361 2023-12-07T01:35:15.550 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/361 2023-12-07T01:35:15.550 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:15.552 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:15.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:15.576 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-12-07T01:35:15.779 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:15.783 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:15.783 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:15.784 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:15.784 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:16.080 INFO:teuthology.orchestra.run.smithi179.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:16.084 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/362 2023-12-07T01:35:16.085 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/362 2023-12-07T01:35:16.085 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:16.087 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:16.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:16.117 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-12-07T01:35:16.314 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:16.317 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:16.318 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:16.319 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:16.319 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:16.639 INFO:teuthology.orchestra.run.smithi179.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:16.643 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/363 2023-12-07T01:35:16.643 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/363 2023-12-07T01:35:16.643 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:16.645 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:16.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:16.678 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-12-07T01:35:16.883 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:16.887 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:16.887 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:16.888 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:16.888 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:17.192 INFO:teuthology.orchestra.run.smithi179.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:17.196 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/364 2023-12-07T01:35:17.196 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/364 2023-12-07T01:35:17.196 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:17.198 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:17.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:17.217 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-12-07T01:35:17.417 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:17.421 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:17.422 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:17.423 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:17.423 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:17.736 INFO:teuthology.orchestra.run.smithi179.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:17.740 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/365 2023-12-07T01:35:17.740 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/365 2023-12-07T01:35:17.740 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:17.742 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:17.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:17.771 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-12-07T01:35:17.974 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:17.978 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:17.979 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:17.980 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:17.980 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:18.265 INFO:teuthology.orchestra.run.smithi179.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:18.269 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/366 2023-12-07T01:35:18.269 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/366 2023-12-07T01:35:18.269 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:18.271 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:18.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:18.298 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-12-07T01:35:18.504 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:18.508 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:18.508 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:18.509 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:18.509 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:18.807 INFO:teuthology.orchestra.run.smithi179.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:18.811 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/367 2023-12-07T01:35:18.811 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/367 2023-12-07T01:35:18.812 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:18.813 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:18.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:18.851 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-12-07T01:35:19.069 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:19.073 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:19.073 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:19.075 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:19.075 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:19.374 INFO:teuthology.orchestra.run.smithi179.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:19.378 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/368 2023-12-07T01:35:19.378 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/368 2023-12-07T01:35:19.378 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:19.380 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:19.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:19.399 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-12-07T01:35:19.598 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:19.602 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:19.603 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:19.604 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:19.604 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:19.925 INFO:teuthology.orchestra.run.smithi179.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:19.929 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/369 2023-12-07T01:35:19.929 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/369 2023-12-07T01:35:19.929 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:19.931 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:19.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:19.951 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-12-07T01:35:20.146 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:20.150 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:20.150 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:20.151 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:20.151 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:20.454 INFO:teuthology.orchestra.run.smithi179.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-07T01:35:20.458 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/370 2023-12-07T01:35:20.458 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/370 2023-12-07T01:35:20.459 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:20.460 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:20.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:20.485 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-12-07T01:35:20.687 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:20.691 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:20.691 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:20.692 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:20.692 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:21.014 INFO:teuthology.orchestra.run.smithi179.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:35:21.018 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/371 2023-12-07T01:35:21.018 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/371 2023-12-07T01:35:21.018 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:21.020 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:21.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:21.046 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-12-07T01:35:21.250 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:21.254 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:21.254 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:21.255 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:21.255 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:21.914 INFO:teuthology.orchestra.run.smithi179.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:22.044 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/372 2023-12-07T01:35:22.044 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/372 2023-12-07T01:35:22.044 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:22.053 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:22.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:22.106 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-12-07T01:35:22.333 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:22.336 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:22.337 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:22.338 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:22.338 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:23.100 INFO:teuthology.orchestra.run.smithi179.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:23.124 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/373 2023-12-07T01:35:23.124 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/373 2023-12-07T01:35:23.124 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:23.151 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:23.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:23.221 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-12-07T01:35:23.428 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:23.432 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:23.433 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:23.434 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:23.434 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:23.908 INFO:teuthology.orchestra.run.smithi179.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-07T01:35:24.221 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/374 2023-12-07T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/374 2023-12-07T01:35:24.222 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:24.250 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:24.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:24.343 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-12-07T01:35:24.542 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:24.546 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:24.547 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:24.548 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:24.548 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:24.949 INFO:teuthology.orchestra.run.smithi179.stdout:generic/375 0s 2023-12-07T01:35:24.954 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/375 2023-12-07T01:35:24.954 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:24.956 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:25.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:25.179 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-12-07T01:35:25.529 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:25.534 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:25.534 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:25.535 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:25.535 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:25.866 INFO:teuthology.orchestra.run.smithi179.stdout:generic/376 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:35:25.869 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/376 2023-12-07T01:35:25.869 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/376 2023-12-07T01:35:25.870 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:25.872 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:25.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:25.898 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-12-07T01:35:26.096 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:26.100 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:26.100 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:26.101 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:26.101 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:26.641 INFO:teuthology.orchestra.run.smithi179.stdout:generic/377 0s 2023-12-07T01:35:26.645 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/377 2023-12-07T01:35:26.646 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:26.647 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:26.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:26.656 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-12-07T01:35:26.853 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:26.857 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:26.858 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:26.859 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:26.859 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:27.313 INFO:teuthology.orchestra.run.smithi179.stdout:generic/378 0s 2023-12-07T01:35:27.319 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/378 2023-12-07T01:35:27.320 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:27.321 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:27.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:27.631 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-12-07T01:35:27.898 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:27.902 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:27.902 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:27.903 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:27.903 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:28.198 INFO:teuthology.orchestra.run.smithi179.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:28.202 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/379 2023-12-07T01:35:28.202 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/379 2023-12-07T01:35:28.202 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:28.204 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:28.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:28.227 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-12-07T01:35:28.425 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:28.429 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:28.430 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:28.431 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:28.431 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:28.741 INFO:teuthology.orchestra.run.smithi179.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:28.745 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/380 2023-12-07T01:35:28.745 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/380 2023-12-07T01:35:28.745 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:28.747 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:28.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:28.772 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-12-07T01:35:28.988 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:28.992 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:28.992 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:28.993 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:28.993 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:29.285 INFO:teuthology.orchestra.run.smithi179.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:29.289 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/381 2023-12-07T01:35:29.289 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/381 2023-12-07T01:35:29.289 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:29.291 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:29.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:29.316 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-12-07T01:35:29.531 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:29.535 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:29.535 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:29.536 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:29.537 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:29.842 INFO:teuthology.orchestra.run.smithi179.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:29.846 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/382 2023-12-07T01:35:29.846 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/382 2023-12-07T01:35:29.846 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:29.848 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:29.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:29.871 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-12-07T01:35:30.080 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:30.084 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:30.085 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:30.085 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:30.086 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:30.411 INFO:teuthology.orchestra.run.smithi179.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:30.415 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/383 2023-12-07T01:35:30.415 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/383 2023-12-07T01:35:30.415 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:30.417 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:30.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:30.440 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-12-07T01:35:30.652 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:30.656 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:30.656 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:30.657 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:30.657 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:30.957 INFO:teuthology.orchestra.run.smithi179.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:30.961 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/384 2023-12-07T01:35:30.961 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/384 2023-12-07T01:35:30.961 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:30.964 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:30.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:30.992 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-12-07T01:35:31.194 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:31.198 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:31.198 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:31.199 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:31.199 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:31.517 INFO:teuthology.orchestra.run.smithi179.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:31.521 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/385 2023-12-07T01:35:31.521 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/385 2023-12-07T01:35:31.521 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:31.525 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:31.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:31.545 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-12-07T01:35:31.748 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:31.752 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:31.752 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:31.753 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:31.753 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:32.058 INFO:teuthology.orchestra.run.smithi179.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:32.062 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/386 2023-12-07T01:35:32.062 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/386 2023-12-07T01:35:32.062 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:32.064 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:32.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:32.099 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-12-07T01:35:32.313 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:32.317 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:32.318 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:32.319 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:32.319 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:33.090 INFO:teuthology.orchestra.run.smithi179.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:33.165 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/387 2023-12-07T01:35:33.165 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/387 2023-12-07T01:35:33.165 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:33.169 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:33.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:33.220 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-12-07T01:35:33.426 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:33.431 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:33.431 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:33.432 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:33.432 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:33.767 INFO:teuthology.orchestra.run.smithi179.stdout:generic/388 [not run] require 172.21.15.179:6789:/scratch to be local device 2023-12-07T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/388 2023-12-07T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/388 2023-12-07T01:35:33.771 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:33.773 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:33.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:33.804 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-12-07T01:35:34.008 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:34.012 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:34.012 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:34.013 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:34.013 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:34.342 INFO:teuthology.orchestra.run.smithi179.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-07T01:35:34.347 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/389 2023-12-07T01:35:34.347 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/389 2023-12-07T01:35:34.347 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:34.349 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:34.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:34.377 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-12-07T01:35:34.581 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:34.585 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:34.586 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:34.590 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:34.590 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:34.940 INFO:teuthology.orchestra.run.smithi179.stdout:generic/390 [not run] ceph does not support freezing 2023-12-07T01:35:34.944 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/390 2023-12-07T01:35:34.944 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/390 2023-12-07T01:35:34.944 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:34.946 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:34.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:34.970 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-12-07T01:35:35.167 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:35.171 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:35.171 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:35.172 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:35.172 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:35.495 INFO:teuthology.orchestra.run.smithi179.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:35:35.499 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/391 2023-12-07T01:35:35.499 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/391 2023-12-07T01:35:35.499 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:35.502 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:35.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:35.525 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-12-07T01:35:35.740 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:35.744 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:35.744 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:35.745 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:35.745 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:36.171 INFO:teuthology.orchestra.run.smithi179.stdout:generic/392 [not run] ceph does not support shutdown 2023-12-07T01:35:36.188 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/392 2023-12-07T01:35:36.188 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/392 2023-12-07T01:35:36.188 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:36.190 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:36.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:36.222 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-12-07T01:35:36.424 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:36.428 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:36.429 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:36.429 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:36.430 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:37.019 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:35:37.021 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:35:37.544 INFO:teuthology.orchestra.run.smithi179.stdout:generic/393 1s 2023-12-07T01:35:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/393 2023-12-07T01:35:37.558 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:37.560 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:37.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:37.569 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-12-07T01:35:37.763 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:37.767 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:37.768 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:37.769 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:37.769 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:38.117 INFO:teuthology.orchestra.run.smithi179.stdout:generic/394 1s 2023-12-07T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/394 2023-12-07T01:35:38.121 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:38.123 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:38.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:38.453 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-12-07T01:35:38.685 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:38.690 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:38.691 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:39.220 INFO:teuthology.orchestra.run.smithi179.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-12-07T01:35:39.237 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/395 2023-12-07T01:35:39.237 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/395 2023-12-07T01:35:39.237 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:39.239 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:39.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:39.262 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-12-07T01:35:39.611 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:39.621 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:39.622 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:39.624 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:39.624 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:40.384 INFO:teuthology.orchestra.run.smithi179.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-12-07T01:35:40.398 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/396 2023-12-07T01:35:40.398 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/396 2023-12-07T01:35:40.398 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:40.400 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:40.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:40.431 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-12-07T01:35:40.684 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:40.688 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:40.689 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:40.690 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:40.690 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:41.209 INFO:teuthology.orchestra.run.smithi179.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-12-07T01:35:41.223 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/397 2023-12-07T01:35:41.224 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/397 2023-12-07T01:35:41.224 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:41.225 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:41.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:41.248 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-12-07T01:35:41.463 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:41.467 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:41.468 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:41.469 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:41.469 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:41.977 INFO:teuthology.orchestra.run.smithi179.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-12-07T01:35:41.990 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/398 2023-12-07T01:35:41.991 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/398 2023-12-07T01:35:41.991 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:41.992 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:42.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:42.011 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-12-07T01:35:42.222 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:42.226 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:42.227 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:42.227 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:42.739 INFO:teuthology.orchestra.run.smithi179.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-12-07T01:35:42.763 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/399 2023-12-07T01:35:42.763 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/399 2023-12-07T01:35:42.763 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:42.765 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:42.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:42.784 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-12-07T01:35:42.987 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:42.991 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:42.992 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:42.993 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:42.993 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:43.291 INFO:teuthology.orchestra.run.smithi179.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T01:35:43.295 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/400 2023-12-07T01:35:43.296 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/400 2023-12-07T01:35:43.296 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:43.297 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:43.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:43.321 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-12-07T01:35:43.543 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:43.547 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:43.547 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:43.548 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:43.549 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:44.397 INFO:teuthology.orchestra.run.smithi179.stdout:generic/401 1s 2023-12-07T01:35:44.414 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/401 2023-12-07T01:35:44.415 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:44.428 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:44.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:44.445 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-12-07T01:35:44.685 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:44.689 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:44.690 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:44.691 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:44.691 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:45.197 INFO:teuthology.orchestra.run.smithi179.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-12-07T01:35:45.216 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/402 2023-12-07T01:35:45.216 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/402 2023-12-07T01:35:45.216 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:45.217 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:45.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:45.239 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-12-07T01:35:45.438 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:45.442 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:45.443 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:45.444 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:45.444 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:46.149 INFO:teuthology.orchestra.run.smithi179.stdout:generic/403 1s 2023-12-07T01:35:46.153 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/403 2023-12-07T01:35:46.153 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:46.155 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:46.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:46.164 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-12-07T01:35:46.367 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:46.371 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:46.371 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:46.372 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:46.372 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:46.714 INFO:teuthology.orchestra.run.smithi179.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:35:46.718 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/404 2023-12-07T01:35:46.718 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/404 2023-12-07T01:35:46.718 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:46.720 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:46.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:46.755 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-12-07T01:35:46.951 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:46.955 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:46.956 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:46.957 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:46.957 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:47.311 INFO:teuthology.orchestra.run.smithi179.stdout:generic/405 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:35:47.315 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/405 2023-12-07T01:35:47.315 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/405 2023-12-07T01:35:47.315 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:47.317 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:47.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:47.341 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-12-07T01:35:47.542 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:47.546 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:47.546 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:47.547 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:47.548 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:49.361 INFO:teuthology.orchestra.run.smithi179.stdout:generic/406 2s 2023-12-07T01:35:49.366 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/406 2023-12-07T01:35:49.366 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:49.368 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:49.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:49.377 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-12-07T01:35:49.581 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:49.585 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:49.585 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:49.586 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:49.586 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:49.938 INFO:teuthology.orchestra.run.smithi179.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:35:49.942 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/407 2023-12-07T01:35:49.942 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/407 2023-12-07T01:35:49.942 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:49.944 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:50.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:50.284 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-12-07T01:35:50.597 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:50.602 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:50.602 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:50.603 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:50.603 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:50.942 INFO:teuthology.orchestra.run.smithi179.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-07T01:35:50.946 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/408 2023-12-07T01:35:50.946 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/408 2023-12-07T01:35:50.946 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:50.948 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:51.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:51.263 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-12-07T01:35:51.536 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:51.541 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:51.541 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:51.542 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:51.542 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:51.855 INFO:teuthology.orchestra.run.smithi179.stdout:generic/409 [not run] require 172.21.15.179:6789:/scratch to be local device 2023-12-07T01:35:51.860 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/409 2023-12-07T01:35:51.860 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/409 2023-12-07T01:35:51.860 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:51.862 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:51.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:51.885 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-12-07T01:35:52.100 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:52.104 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:52.104 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:52.105 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:52.105 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:52.410 INFO:teuthology.orchestra.run.smithi179.stdout:generic/410 [not run] require 172.21.15.179:6789:/scratch to be local device 2023-12-07T01:35:52.414 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/410 2023-12-07T01:35:52.414 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/410 2023-12-07T01:35:52.414 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:52.416 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:52.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:52.439 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-12-07T01:35:52.633 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:52.637 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:52.638 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:52.639 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:52.639 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:52.948 INFO:teuthology.orchestra.run.smithi179.stdout:generic/411 [not run] require 172.21.15.179:6789:/scratch to be local device 2023-12-07T01:35:52.952 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/411 2023-12-07T01:35:52.952 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/411 2023-12-07T01:35:52.952 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:52.954 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:52.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:52.980 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-12-07T01:35:53.183 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:53.188 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:53.188 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:53.189 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:53.189 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:53.855 INFO:teuthology.orchestra.run.smithi179.stdout:generic/412 0s 2023-12-07T01:35:53.860 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/412 2023-12-07T01:35:53.860 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:53.862 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:53.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:53.871 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-12-07T01:35:54.084 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:54.089 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:54.089 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:54.090 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:54.090 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:54.545 INFO:teuthology.orchestra.run.smithi179.stdout:generic/413 [not run] mount 172.21.15.179:6789:/scratch with dax failed 2023-12-07T01:35:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/413 2023-12-07T01:35:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/413 2023-12-07T01:35:54.549 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:54.551 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:54.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:54.572 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-12-07T01:35:54.792 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:54.796 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:54.796 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:54.797 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:54.797 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:55.586 INFO:teuthology.orchestra.run.smithi179.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:55.590 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/414 2023-12-07T01:35:55.590 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/414 2023-12-07T01:35:55.590 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:55.596 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:55.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:55.675 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-12-07T01:35:55.894 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:55.898 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:55.899 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:55.900 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:55.900 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:56.593 INFO:teuthology.orchestra.run.smithi179.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:35:56.760 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/415 2023-12-07T01:35:56.760 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/415 2023-12-07T01:35:56.760 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:56.766 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:56.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:56.826 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-12-07T01:35:57.053 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:57.056 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:57.057 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:57.058 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:57.058 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:57.371 INFO:teuthology.orchestra.run.smithi179.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:35:57.375 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/416 2023-12-07T01:35:57.375 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/416 2023-12-07T01:35:57.375 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:57.377 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:57.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:57.398 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-12-07T01:35:57.596 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:57.600 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:57.600 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:57.601 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:57.601 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:58.068 INFO:teuthology.orchestra.run.smithi179.stdout:generic/417 [not run] ceph does not support shutdown 2023-12-07T01:35:58.083 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/417 2023-12-07T01:35:58.083 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/417 2023-12-07T01:35:58.083 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:58.085 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:58.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:58.117 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-12-07T01:35:58.322 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:58.326 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:58.327 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:58.327 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:58.327 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:58.664 INFO:teuthology.orchestra.run.smithi179.stdout:generic/418 [not run] require 172.21.15.179:6789:/test to be valid block disk 2023-12-07T01:35:58.668 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/418 2023-12-07T01:35:58.668 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/418 2023-12-07T01:35:58.668 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:58.670 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:58.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:58.702 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-12-07T01:35:58.917 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:58.922 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:58.922 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:58.923 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:58.923 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:59.472 INFO:teuthology.orchestra.run.smithi179.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-12-07T01:35:59.493 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/419 2023-12-07T01:35:59.493 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/419 2023-12-07T01:35:59.493 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:35:59.495 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:35:59.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:35:59.520 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-12-07T01:35:59.743 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:35:59.747 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:35:59.747 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:35:59.748 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:35:59.748 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:00.184 INFO:teuthology.orchestra.run.smithi179.stdout:generic/420 1s 2023-12-07T01:36:00.189 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/420 2023-12-07T01:36:00.189 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:00.191 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:00.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:00.418 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-12-07T01:36:00.784 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:00.788 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:00.789 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:00.789 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:00.789 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:01.294 INFO:teuthology.orchestra.run.smithi179.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-12-07T01:36:01.309 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/421 2023-12-07T01:36:01.309 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/421 2023-12-07T01:36:01.309 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:01.311 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:01.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:01.328 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-12-07T01:36:01.534 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:01.538 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:01.538 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:01.539 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:01.539 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:01.858 INFO:teuthology.orchestra.run.smithi179.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-07T01:36:01.862 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/422 2023-12-07T01:36:01.862 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/422 2023-12-07T01:36:01.862 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:01.865 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:01.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:01.894 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-12-07T01:36:02.100 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:02.104 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:02.104 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:02.105 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:02.105 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:02.510 INFO:teuthology.orchestra.run.smithi179.stdout:generic/423 0s 2023-12-07T01:36:02.514 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/423 2023-12-07T01:36:02.514 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:02.517 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:02.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:02.828 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-12-07T01:36:03.106 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:03.110 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:03.110 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:03.111 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:03.111 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:03.437 INFO:teuthology.orchestra.run.smithi179.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-07T01:36:03.441 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/424 2023-12-07T01:36:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/424 2023-12-07T01:36:03.442 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:03.444 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:03.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:03.476 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-12-07T01:36:03.678 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:03.682 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:03.683 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:04.041 INFO:teuthology.orchestra.run.smithi179.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-12-07T01:36:04.045 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/425 2023-12-07T01:36:04.045 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/425 2023-12-07T01:36:04.045 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:04.047 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:04.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:04.363 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-12-07T01:36:04.633 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:04.637 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:04.638 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:04.639 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:04.639 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:07.300 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:36:07.303 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:36:37.366 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:36:37.396 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:36:51.134 INFO:teuthology.orchestra.run.smithi179.stdout:generic/426 47s 2023-12-07T01:36:51.230 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/426 2023-12-07T01:36:51.230 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:51.241 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:51.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:51.652 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-12-07T01:36:52.696 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:52.699 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:52.700 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:52.701 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:52.701 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:53.158 INFO:teuthology.orchestra.run.smithi179.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:36:53.162 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/427 2023-12-07T01:36:53.162 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/427 2023-12-07T01:36:53.162 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:53.164 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:53.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:53.206 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-12-07T01:36:53.412 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:53.416 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:53.417 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:53.417 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:53.418 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:53.785 INFO:teuthology.orchestra.run.smithi179.stdout:generic/428 0s 2023-12-07T01:36:53.790 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/428 2023-12-07T01:36:53.790 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:53.792 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:53.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:53.825 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-12-07T01:36:54.029 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:54.033 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:54.033 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:54.034 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:54.035 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:54.578 INFO:teuthology.orchestra.run.smithi179.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-12-07T01:36:54.598 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/429 2023-12-07T01:36:54.598 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/429 2023-12-07T01:36:54.598 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:54.600 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:54.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:54.632 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-12-07T01:36:54.840 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:54.843 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:54.844 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:54.845 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:54.845 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:55.306 INFO:teuthology.orchestra.run.smithi179.stdout:generic/430 0s 2023-12-07T01:36:55.310 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/430 2023-12-07T01:36:55.311 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:55.312 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:55.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:55.650 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-12-07T01:36:55.924 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:55.928 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:55.928 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:55.929 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:55.929 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:56.329 INFO:teuthology.orchestra.run.smithi179.stdout:generic/431 0s 2023-12-07T01:36:56.334 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/431 2023-12-07T01:36:56.334 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:56.337 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:56.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:56.520 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-12-07T01:36:56.967 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:56.971 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:56.971 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:56.972 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:56.972 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:57.401 INFO:teuthology.orchestra.run.smithi179.stdout:generic/432 0s 2023-12-07T01:36:57.406 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/432 2023-12-07T01:36:57.406 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:57.408 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:57.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:57.745 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-12-07T01:36:58.012 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:58.018 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:58.018 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:58.019 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:58.019 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:58.406 INFO:teuthology.orchestra.run.smithi179.stdout:generic/433 0s 2023-12-07T01:36:58.411 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/433 2023-12-07T01:36:58.411 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:58.413 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:58.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:58.536 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-12-07T01:36:59.025 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:36:59.029 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:36:59.029 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:36:59.030 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:36:59.030 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:59.430 INFO:teuthology.orchestra.run.smithi179.stdout:generic/434 0s 2023-12-07T01:36:59.435 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/434 2023-12-07T01:36:59.435 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:36:59.437 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:36:59.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:36:59.744 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-12-07T01:37:00.033 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:37:00.037 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:37:00.037 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:37:00.038 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:37:00.038 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:37:00.570 INFO:teuthology.orchestra.run.smithi179.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-12-07T01:37:00.598 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/435 2023-12-07T01:37:00.598 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/435 2023-12-07T01:37:00.598 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:37:00.600 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:37:00.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:37:00.621 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-12-07T01:37:00.826 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:37:00.830 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:37:00.830 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:37:00.831 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:37:00.832 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:37:01.527 INFO:teuthology.orchestra.run.smithi179.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:37:01.531 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/436 2023-12-07T01:37:01.531 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/436 2023-12-07T01:37:01.531 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:37:01.533 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:37:01.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:37:01.886 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-12-07T01:37:02.119 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:37:02.123 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:37:02.123 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:37:02.124 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:37:02.124 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:37:03.110 INFO:teuthology.orchestra.run.smithi179.stdout:generic/437 1s 2023-12-07T01:37:03.115 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/437 2023-12-07T01:37:03.115 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:37:03.117 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:37:03.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:37:03.152 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-12-07T01:37:03.361 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:37:03.365 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:37:03.365 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:37:03.366 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:37:03.367 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:37:08.368 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:37:08.370 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:37:38.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:37:38.515 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:38:03.641 INFO:teuthology.orchestra.run.smithi179.stdout:generic/438 60s 2023-12-07T01:38:03.646 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/438 2023-12-07T01:38:03.646 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:03.648 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:03.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:03.678 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-12-07T01:38:03.881 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:03.885 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:03.886 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:03.888 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:03.888 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:05.036 INFO:teuthology.orchestra.run.smithi179.stdout:generic/439 1s 2023-12-07T01:38:05.042 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/439 2023-12-07T01:38:05.042 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:05.044 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:05.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:05.075 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-12-07T01:38:05.292 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:05.296 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:05.297 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:05.829 INFO:teuthology.orchestra.run.smithi179.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-12-07T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/440 2023-12-07T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/440 2023-12-07T01:38:05.851 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:05.853 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:05.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:05.875 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-12-07T01:38:06.078 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:06.082 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:06.082 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:06.083 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:06.083 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:06.478 INFO:teuthology.orchestra.run.smithi179.stdout:generic/441 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:38:06.483 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/441 2023-12-07T01:38:06.483 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/441 2023-12-07T01:38:06.483 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:06.484 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:06.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:06.510 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-12-07T01:38:06.726 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:06.730 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:06.730 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:06.731 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:06.731 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:07.062 INFO:teuthology.orchestra.run.smithi179.stdout:generic/442 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:38:07.066 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/442 2023-12-07T01:38:07.066 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/442 2023-12-07T01:38:07.066 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:07.068 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:07.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:07.093 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-12-07T01:38:07.296 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:07.300 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:07.301 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:07.302 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:07.302 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:07.651 INFO:teuthology.orchestra.run.smithi179.stdout:generic/443 0s 2023-12-07T01:38:07.656 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/443 2023-12-07T01:38:07.656 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:07.658 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:07.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:07.692 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-12-07T01:38:07.901 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:07.905 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:07.905 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:07.906 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:07.907 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:08.326 INFO:teuthology.orchestra.run.smithi179.stdout:generic/444 0s 2023-12-07T01:38:08.331 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/444 2023-12-07T01:38:08.331 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:08.333 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:08.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:08.367 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-12-07T01:38:08.570 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:08.575 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:08.576 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:08.576 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:08.662 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:38:08.664 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:38:09.236 INFO:teuthology.orchestra.run.smithi179.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:38:09.240 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/445 2023-12-07T01:38:09.240 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/445 2023-12-07T01:38:09.240 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:09.242 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:09.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:09.563 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-12-07T01:38:09.833 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:09.837 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:09.838 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:09.839 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:09.839 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:29.470 INFO:teuthology.orchestra.run.smithi179.stdout:generic/446 19s 2023-12-07T01:38:29.487 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/446 2023-12-07T01:38:29.487 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:29.488 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:29.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:29.507 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-12-07T01:38:29.741 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:29.745 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:29.746 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:29.747 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:29.747 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:30.591 INFO:teuthology.orchestra.run.smithi179.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:38:30.599 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/447 2023-12-07T01:38:30.599 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/447 2023-12-07T01:38:30.599 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:30.602 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:30.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:30.635 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-12-07T01:38:30.892 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:30.896 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:30.896 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:30.897 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:30.897 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:31.881 INFO:teuthology.orchestra.run.smithi179.stdout:generic/448 0s 2023-12-07T01:38:31.886 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/448 2023-12-07T01:38:31.886 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:31.888 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:32.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:32.173 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-12-07T01:38:32.504 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:32.508 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:32.508 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:32.510 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:32.510 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:32.893 INFO:teuthology.orchestra.run.smithi179.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T01:38:32.897 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/449 2023-12-07T01:38:32.897 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/449 2023-12-07T01:38:32.897 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:32.899 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:33.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:33.107 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-12-07T01:38:33.502 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:33.506 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:33.506 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:33.508 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:33.508 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:34.261 INFO:teuthology.orchestra.run.smithi179.stdout:generic/450 1s 2023-12-07T01:38:34.265 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/450 2023-12-07T01:38:34.265 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:38:34.267 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:34.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:38:34.543 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-12-07T01:38:34.889 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:38:34.893 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:38:34.893 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:38:34.894 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:38:34.894 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:38:38.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:38:38.731 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:39:05.341 INFO:teuthology.orchestra.run.smithi179.stdout:generic/451 30s 2023-12-07T01:39:05.345 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/451 2023-12-07T01:39:05.346 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:05.347 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:05.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:05.740 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-12-07T01:39:05.957 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:05.961 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:05.961 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:05.962 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:05.962 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:06.582 INFO:teuthology.orchestra.run.smithi179.stdout:generic/452 0s 2023-12-07T01:39:06.587 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/452 2023-12-07T01:39:06.587 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:06.589 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:06.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:06.598 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-12-07T01:39:06.804 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:06.809 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:06.809 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:06.809 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:06.809 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:07.132 INFO:teuthology.orchestra.run.smithi179.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-12-07T01:39:07.136 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/453 2023-12-07T01:39:07.136 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/453 2023-12-07T01:39:07.136 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:07.138 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:07.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:07.169 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-12-07T01:39:07.385 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:07.390 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:07.390 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:07.391 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:07.391 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:07.748 INFO:teuthology.orchestra.run.smithi179.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-12-07T01:39:07.752 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/454 2023-12-07T01:39:07.753 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/454 2023-12-07T01:39:07.753 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:07.754 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:07.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:07.792 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-12-07T01:39:07.998 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:08.002 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:08.002 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:08.003 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:08.004 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:08.406 INFO:teuthology.orchestra.run.smithi179.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-07T01:39:08.410 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/455 2023-12-07T01:39:08.410 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/455 2023-12-07T01:39:08.410 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:08.412 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:08.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:08.444 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-12-07T01:39:08.650 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:08.655 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:08.655 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:08.656 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:08.656 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:08.885 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:39:08.888 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:39:09.015 INFO:teuthology.orchestra.run.smithi179.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T01:39:09.019 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/456 2023-12-07T01:39:09.019 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/456 2023-12-07T01:39:09.020 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:09.021 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:09.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:09.044 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-12-07T01:39:09.248 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:09.252 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:09.253 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:09.254 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:09.254 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:10.067 INFO:teuthology.orchestra.run.smithi179.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:39:10.104 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/457 2023-12-07T01:39:10.104 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/457 2023-12-07T01:39:10.104 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:10.112 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:10.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:10.164 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-12-07T01:39:10.410 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:10.414 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:10.414 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:10.415 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:10.416 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:11.249 INFO:teuthology.orchestra.run.smithi179.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T01:39:11.290 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/458 2023-12-07T01:39:11.291 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/458 2023-12-07T01:39:11.291 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:11.292 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:11.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:11.341 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-12-07T01:39:11.560 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:11.564 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:11.565 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:11.566 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:11.566 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:12.103 INFO:teuthology.orchestra.run.smithi179.stdout:generic/459 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:39:12.107 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/459 2023-12-07T01:39:12.107 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/459 2023-12-07T01:39:12.107 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:12.109 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:12.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:12.135 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-12-07T01:39:12.351 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:12.355 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:12.356 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:12.357 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:12.357 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:14.319 INFO:teuthology.orchestra.run.smithi179.stdout:generic/460 2s 2023-12-07T01:39:14.323 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/460 2023-12-07T01:39:14.323 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:14.325 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:14.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:14.334 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-12-07T01:39:14.545 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:14.549 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:14.549 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:14.550 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:14.551 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:15.061 INFO:teuthology.orchestra.run.smithi179.stdout:generic/461 [not run] ceph does not support shutdown 2023-12-07T01:39:15.065 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/461 2023-12-07T01:39:15.065 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/461 2023-12-07T01:39:15.065 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:15.067 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:15.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:15.087 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-12-07T01:39:15.319 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:15.328 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:15.328 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:15.329 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:15.329 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:15.930 INFO:teuthology.orchestra.run.smithi179.stdout:generic/462 [not run] mount 172.21.15.179:6789:/scratch with dax failed 2023-12-07T01:39:15.934 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/462 2023-12-07T01:39:15.935 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/462 2023-12-07T01:39:15.935 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:15.937 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:15.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:15.962 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-12-07T01:39:16.174 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:16.181 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:16.181 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:16.181 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:16.181 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:16.560 INFO:teuthology.orchestra.run.smithi179.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-12-07T01:39:16.564 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/463 2023-12-07T01:39:16.564 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/463 2023-12-07T01:39:16.564 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:39:16.566 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:16.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:39:16.890 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-12-07T01:39:17.182 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:39:17.186 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:39:17.187 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:39:17.187 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:39:17.188 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:39:39.023 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:39:39.028 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:40:09.321 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:40:09.325 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:40:14.232 INFO:teuthology.orchestra.run.smithi179.stdout:generic/464 57s 2023-12-07T01:40:14.237 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/464 2023-12-07T01:40:14.237 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:40:14.239 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:40:14.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:40:14.248 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-12-07T01:40:14.463 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:40:14.467 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:40:14.467 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:40:14.468 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:40:14.469 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:40:19.098 INFO:teuthology.orchestra.run.smithi179.stdout:generic/465 4s 2023-12-07T01:40:19.105 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/465 2023-12-07T01:40:19.105 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:40:19.107 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:40:19.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:40:19.117 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-12-07T01:40:19.335 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:40:19.339 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:40:19.340 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:40:19.341 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:40:19.341 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:40:19.717 INFO:teuthology.orchestra.run.smithi179.stdout:generic/466 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:40:19.721 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/466 2023-12-07T01:40:19.721 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/466 2023-12-07T01:40:19.721 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:40:19.723 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:40:19.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:40:19.753 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-12-07T01:40:19.957 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:40:19.961 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:40:19.961 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:40:19.962 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:40:19.962 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:40:39.460 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:40:39.520 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:41:10.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:41:10.336 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:41:23.107 INFO:teuthology.orchestra.run.smithi179.stdout:generic/467 63s 2023-12-07T01:41:23.192 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/467 2023-12-07T01:41:23.192 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:41:23.201 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:41:23.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:41:23.596 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-12-07T01:41:24.606 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:41:24.610 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:41:24.611 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:41:24.612 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:41:24.612 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:41:25.181 INFO:teuthology.orchestra.run.smithi179.stdout:generic/468 [not run] ceph does not support shutdown 2023-12-07T01:41:25.200 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/468 2023-12-07T01:41:25.200 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/468 2023-12-07T01:41:25.200 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:41:25.202 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:41:25.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:41:25.236 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-12-07T01:41:25.444 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:41:25.448 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:41:25.448 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:41:25.449 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:41:25.449 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:41:25.815 INFO:teuthology.orchestra.run.smithi179.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-07T01:41:25.818 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/469 2023-12-07T01:41:25.819 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/469 2023-12-07T01:41:25.819 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:41:25.821 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:41:25.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:41:25.849 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-12-07T01:41:26.064 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:41:26.069 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:41:26.069 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:41:26.070 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:41:26.070 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:41:26.507 INFO:teuthology.orchestra.run.smithi179.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-07T01:41:26.511 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/470 2023-12-07T01:41:26.511 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/470 2023-12-07T01:41:26.511 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:41:26.514 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:41:26.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:41:26.538 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-12-07T01:41:26.742 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:41:26.746 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:41:26.746 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:41:26.748 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:41:26.748 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:41:40.963 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:41:40.966 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:42:10.718 INFO:teuthology.orchestra.run.smithi179.stdout:generic/471 44s 2023-12-07T01:42:10.736 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/471 2023-12-07T01:42:10.736 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:42:10.738 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:10.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:42:10.995 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-12-07T01:42:11.178 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:42:11.181 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:42:11.752 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:42:11.777 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:42:11.783 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:42:11.795 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:42:11.795 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:13.219 INFO:teuthology.orchestra.run.smithi179.stdout:generic/472 [not run] swapfiles are not supported 2023-12-07T01:42:13.223 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/472 2023-12-07T01:42:13.223 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/472 2023-12-07T01:42:13.224 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:42:13.226 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:13.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:42:13.251 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-12-07T01:42:13.458 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:42:13.462 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:42:13.462 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:42:13.463 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:42:13.463 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:13.866 INFO:teuthology.orchestra.run.smithi179.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-07T01:42:13.870 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/473 2023-12-07T01:42:13.870 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/473 2023-12-07T01:42:13.870 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:42:13.872 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:13.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:42:13.901 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-12-07T01:42:14.109 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:42:14.113 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:42:14.113 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:42:14.114 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:42:14.115 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:14.609 INFO:teuthology.orchestra.run.smithi179.stdout:generic/474 [not run] ceph does not support shutdown 2023-12-07T01:42:14.648 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/474 2023-12-07T01:42:14.649 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/474 2023-12-07T01:42:14.649 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:42:14.650 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:14.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:42:14.678 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-12-07T01:42:14.905 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:42:14.909 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:42:14.910 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:42:14.911 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:42:14.911 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:15.277 INFO:teuthology.orchestra.run.smithi179.stdout:generic/475 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T01:42:15.281 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/475 2023-12-07T01:42:15.281 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/475 2023-12-07T01:42:15.281 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T01:42:15.283 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:15.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T01:42:15.308 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-12-07T01:42:15.518 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T01:42:15.522 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T01:42:15.523 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T01:42:15.523 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T01:42:15.524 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T01:42:41.561 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:42:41.569 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:43:12.235 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:43:12.244 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:43:42.361 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:43:42.445 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:44:12.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:44:13.023 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:44:43.645 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:44:44.344 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:45:14.784 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:45:14.787 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:45:14.880 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T01:45:14.879+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118885) UID: 0 2023-12-07T01:45:14.881 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T01:45:14.879+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118885) UID: 0 2023-12-07T01:45:14.885 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T01:45:14.879+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118885) UID: 0 2023-12-07T01:45:14.885 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T01:45:14.885+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118885) UID: 0 2023-12-07T01:49:32.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:49:33.221 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:49:33.306 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T01:49:33.306+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 642244) UID: 0 2023-12-07T01:49:33.311 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T01:49:33.311+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 642244) UID: 0 2023-12-07T01:49:33.424 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T01:49:33.424+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118965) UID: 0 2023-12-07T01:49:33.433 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T01:49:33.424+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118965) UID: 0 2023-12-07T01:49:33.433 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T01:49:33.426+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118965) UID: 0 2023-12-07T01:49:33.434 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T01:49:33.429+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118965) UID: 0 2023-12-07T01:54:14.971 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:54:15.002 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:54:45.730 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:54:45.742 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:55:16.185 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:55:16.234 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:55:46.801 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:55:46.809 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:56:17.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:56:17.326 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:56:47.603 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:56:47.615 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:57:18.443 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:57:18.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T01:57:18.644 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T01:57:18.643+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642532) UID: 0 2023-12-07T01:57:18.645 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T01:57:18.643+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642532) UID: 0 2023-12-07T01:57:18.646 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T01:57:18.643+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642532) UID: 0 2023-12-07T01:57:18.647 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T01:57:18.643+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642532) UID: 0 2023-12-07T02:01:26.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:01:26.768 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:01:27.668 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T02:01:27.667+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642608) UID: 0 2023-12-07T02:01:27.672 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T02:01:27.673+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642608) UID: 0 2023-12-07T02:01:27.672 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T02:01:27.673+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642608) UID: 0 2023-12-07T02:01:27.677 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T02:01:27.673+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642608) UID: 0 2023-12-07T02:01:27.853 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T02:01:27.845+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119279) UID: 0 2023-12-07T02:01:27.854 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:01:27.845+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119279) UID: 0 2023-12-07T02:01:27.872 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:01:27.853+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119279) UID: 0 2023-12-07T02:01:27.872 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T02:01:27.846+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119279) UID: 0 2023-12-07T02:05:56.055 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:05:56.120 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:05:57.023 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T02:05:57.023+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 642681) UID: 0 2023-12-07T02:05:57.023 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T02:05:57.021+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 642681) UID: 0 2023-12-07T02:05:57.183 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T02:05:57.182+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119349) UID: 0 2023-12-07T02:05:57.184 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T02:05:57.182+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119349) UID: 0 2023-12-07T02:05:57.187 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:05:57.182+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119349) UID: 0 2023-12-07T02:05:57.198 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:05:57.182+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119349) UID: 0 2023-12-07T02:09:45.979 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T02:09:45.979+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642742) UID: 0 2023-12-07T02:09:45.979 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T02:09:45.979+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642742) UID: 0 2023-12-07T02:09:45.980 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T02:09:45.979+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642742) UID: 0 2023-12-07T02:09:45.980 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T02:09:45.979+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642742) UID: 0 2023-12-07T02:14:21.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:14:21.035 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:14:21.389 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T02:14:21.387+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642815) UID: 0 2023-12-07T02:14:21.398 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T02:14:21.399+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642815) UID: 0 2023-12-07T02:14:21.411 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T02:14:21.399+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642815) UID: 0 2023-12-07T02:14:21.422 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T02:14:21.398+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 642815) UID: 0 2023-12-07T02:18:28.972 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:18:28.993 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:18:29.525 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T02:18:29.525+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119535) UID: 0 2023-12-07T02:18:29.526 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:18:29.525+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119535) UID: 0 2023-12-07T02:18:29.526 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:18:29.525+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119535) UID: 0 2023-12-07T02:18:29.527 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T02:18:29.525+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119535) UID: 0 2023-12-07T02:22:42.686 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:22:42.711 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:22:42.813 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T02:22:42.814+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119603) UID: 0 2023-12-07T02:22:42.814 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T02:22:42.814+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119603) UID: 0 2023-12-07T02:22:42.814 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:22:42.814+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119603) UID: 0 2023-12-07T02:22:42.815 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:22:42.814+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119603) UID: 0 2023-12-07T02:22:42.939 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T02:22:42.940+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 642942) UID: 0 2023-12-07T02:22:42.939 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T02:22:42.940+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 642942) UID: 0 2023-12-07T02:27:39.801 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:27:39.844 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:27:40.001 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T02:27:40.001+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119672) UID: 0 2023-12-07T02:27:40.001 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T02:27:40.001+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119672) UID: 0 2023-12-07T02:27:40.002 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:27:40.001+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119672) UID: 0 2023-12-07T02:27:40.002 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:27:40.001+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119672) UID: 0 2023-12-07T02:31:41.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:31:41.266 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:31:41.969 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T02:31:41.970+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 643090) UID: 0 2023-12-07T02:31:41.969 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T02:31:41.970+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 643090) UID: 0 2023-12-07T02:31:41.973 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T02:31:41.973+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 643090) UID: 0 2023-12-07T02:31:41.973 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T02:31:41.970+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 643090) UID: 0 2023-12-07T02:39:41.427 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:39:41.433 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:39:42.310 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T02:39:42.312+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 643195) UID: 0 2023-12-07T02:39:42.333 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T02:39:42.320+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 643195) UID: 0 2023-12-07T02:44:45.003 INFO:teuthology.orchestra.run.smithi179.stdout:generic/476 3749s 2023-12-07T02:44:45.040 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/476 2023-12-07T02:44:45.040 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:44:45.049 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:44:45.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:44:45.061 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-12-07T02:44:59.101 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:44:59.106 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:44:59.107 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:44:59.108 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:44:59.108 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:45:03.914 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:45:03.917 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:45:04.085 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T02:45:04.086+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119910) UID: 0 2023-12-07T02:45:04.085 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T02:45:04.086+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119910) UID: 0 2023-12-07T02:45:04.085 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:45:04.086+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119910) UID: 0 2023-12-07T02:45:04.086 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:45:04.087+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119910) UID: 0 2023-12-07T02:48:35.715 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:48:35.723 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:48:35.801 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T02:48:35.803+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 643616) UID: 0 2023-12-07T02:48:35.803 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T02:48:35.803+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 643616) UID: 0 2023-12-07T02:51:47.329 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T02:51:47.330+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 643651) UID: 0 2023-12-07T02:51:47.329 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T02:51:47.330+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 643651) UID: 0 2023-12-07T02:51:47.330 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T02:51:47.331+0000 7fd2f87cb700 -1 received signal: Hangup from (PID: 643651) UID: 0 2023-12-07T02:51:47.330 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T02:51:47.331+0000 7f4df7d65700 -1 received signal: Hangup from (PID: 643651) UID: 0 2023-12-07T02:53:06.648 INFO:teuthology.orchestra.run.smithi179.stdout:generic/477 44s 2023-12-07T02:53:06.770 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/477 2023-12-07T02:53:06.771 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:06.853 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:07.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:07.366 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-12-07T02:53:11.056 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:11.062 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:11.063 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:11.064 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:11.064 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:22.711 INFO:teuthology.orchestra.run.smithi179.stdout:generic/478 11s 2023-12-07T02:53:22.759 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/478 2023-12-07T02:53:22.759 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:22.762 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:22.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:22.821 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-12-07T02:53:23.228 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:23.246 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:23.247 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:23.248 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:23.248 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:24.325 INFO:teuthology.orchestra.run.smithi179.stdout:generic/479 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:24.330 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/479 2023-12-07T02:53:24.336 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/479 2023-12-07T02:53:24.336 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:24.338 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:24.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:24.393 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-12-07T02:53:24.808 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:24.817 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:24.817 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:24.818 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:24.818 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:25.463 INFO:teuthology.orchestra.run.smithi179.stdout:generic/480 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:25.470 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/480 2023-12-07T02:53:25.471 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/480 2023-12-07T02:53:25.471 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:25.472 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:25.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:25.538 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-12-07T02:53:25.974 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:25.981 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:25.981 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:25.992 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:25.992 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:26.592 INFO:teuthology.orchestra.run.smithi179.stdout:generic/481 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:26.598 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/481 2023-12-07T02:53:26.598 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/481 2023-12-07T02:53:26.598 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:26.602 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:26.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:26.631 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-12-07T02:53:27.171 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:27.188 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:27.188 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:27.188 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:27.188 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:27.929 INFO:teuthology.orchestra.run.smithi179.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-07T02:53:27.934 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/482 2023-12-07T02:53:27.934 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/482 2023-12-07T02:53:27.934 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:27.942 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:27.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:27.997 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-12-07T02:53:28.483 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:28.489 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:28.489 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:28.490 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:28.490 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:29.112 INFO:teuthology.orchestra.run.smithi179.stdout:generic/483 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:29.114 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/483 2023-12-07T02:53:29.114 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/483 2023-12-07T02:53:29.115 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:29.121 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:29.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:29.152 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-12-07T02:53:29.589 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:29.596 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:29.596 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:29.597 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:29.597 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:30.251 INFO:teuthology.orchestra.run.smithi179.stdout:generic/484 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:30.257 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/484 2023-12-07T02:53:30.257 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/484 2023-12-07T02:53:30.257 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:30.264 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:30.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:30.289 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-12-07T02:53:30.688 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:30.692 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:30.693 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:30.694 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:30.694 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:31.278 INFO:teuthology.orchestra.run.smithi179.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-07T02:53:31.283 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/485 2023-12-07T02:53:31.283 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/485 2023-12-07T02:53:31.283 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:31.285 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:31.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:31.328 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-12-07T02:53:31.767 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:31.772 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:31.772 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:31.773 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:31.773 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:33.439 INFO:teuthology.orchestra.run.smithi179.stdout:generic/486 1s 2023-12-07T02:53:33.453 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/486 2023-12-07T02:53:33.453 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:33.461 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:33.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:33.490 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-12-07T02:53:33.897 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:33.902 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:33.902 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:33.905 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:33.905 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:35.029 INFO:teuthology.orchestra.run.smithi179.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-12-07T02:53:35.036 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/487 2023-12-07T02:53:35.036 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/487 2023-12-07T02:53:35.036 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:35.039 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:35.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:35.086 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-12-07T02:53:35.518 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:35.533 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:35.534 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:35.534 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:35.535 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:36.067 INFO:teuthology.orchestra.run.smithi179.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-07T02:53:36.074 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/488 2023-12-07T02:53:36.074 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/488 2023-12-07T02:53:36.074 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:36.082 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:36.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:36.112 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-12-07T02:53:36.554 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:36.559 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:36.560 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:36.561 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:36.561 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:37.129 INFO:teuthology.orchestra.run.smithi179.stdout:generic/489 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:37.135 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/489 2023-12-07T02:53:37.135 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/489 2023-12-07T02:53:37.135 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:37.145 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:37.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:37.184 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-12-07T02:53:37.533 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:37.542 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:37.543 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:40.355 INFO:teuthology.orchestra.run.smithi179.stdout:generic/490 3s 2023-12-07T02:53:40.362 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/490 2023-12-07T02:53:40.362 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:40.365 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:40.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:40.601 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-12-07T02:53:41.258 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:41.268 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:41.269 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:41.270 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:41.270 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:41.868 INFO:teuthology.orchestra.run.smithi179.stdout:generic/491 [not run] ceph does not support freezing 2023-12-07T02:53:41.880 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/491 2023-12-07T02:53:41.880 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/491 2023-12-07T02:53:41.880 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:41.882 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:41.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:41.916 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-12-07T02:53:42.375 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:42.384 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:42.385 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:42.401 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:42.401 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:42.955 INFO:teuthology.orchestra.run.smithi179.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-12-07T02:53:42.966 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/492 2023-12-07T02:53:42.967 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/492 2023-12-07T02:53:42.967 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:42.970 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:43.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:43.009 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-12-07T02:53:43.407 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:43.417 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:43.418 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:43.419 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:43.419 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:45.152 INFO:teuthology.orchestra.run.smithi179.stdout:generic/493 [not run] swapfiles are not supported 2023-12-07T02:53:45.161 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/493 2023-12-07T02:53:45.161 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/493 2023-12-07T02:53:45.161 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:45.167 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:45.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:45.217 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-12-07T02:53:45.716 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:45.725 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:45.725 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:45.727 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:45.727 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:46.697 INFO:teuthology.orchestra.run.smithi179.stdout:generic/494 [not run] swapfiles are not supported 2023-12-07T02:53:46.704 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/494 2023-12-07T02:53:46.704 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/494 2023-12-07T02:53:46.704 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:46.707 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:46.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:46.745 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-12-07T02:53:47.205 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:47.212 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:47.212 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:47.213 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:47.213 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:48.079 INFO:teuthology.orchestra.run.smithi179.stdout:generic/495 [not run] swapfiles are not supported 2023-12-07T02:53:48.084 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/495 2023-12-07T02:53:48.084 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/495 2023-12-07T02:53:48.084 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:48.087 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:48.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:48.133 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-12-07T02:53:48.536 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:48.547 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:48.548 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:48.549 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:48.549 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:49.539 INFO:teuthology.orchestra.run.smithi179.stdout:generic/496 [not run] swapfiles are not supported 2023-12-07T02:53:49.545 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/496 2023-12-07T02:53:49.545 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/496 2023-12-07T02:53:49.545 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:49.547 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:49.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:49.578 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-12-07T02:53:50.023 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:50.032 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:50.033 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:50.034 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:50.034 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:51.021 INFO:teuthology.orchestra.run.smithi179.stdout:generic/497 [not run] swapfiles are not supported 2023-12-07T02:53:51.026 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/497 2023-12-07T02:53:51.026 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/497 2023-12-07T02:53:51.026 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:51.035 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:51.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:51.086 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-12-07T02:53:51.519 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:51.523 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:51.531 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:51.535 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:51.535 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:52.181 INFO:teuthology.orchestra.run.smithi179.stdout:generic/498 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:52.190 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/498 2023-12-07T02:53:52.191 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/498 2023-12-07T02:53:52.191 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:52.194 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:52.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:52.243 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-12-07T02:53:52.682 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:52.690 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:52.691 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:52.695 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:52.696 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:53.248 INFO:teuthology.orchestra.run.smithi179.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-07T02:53:53.253 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/499 2023-12-07T02:53:53.253 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/499 2023-12-07T02:53:53.253 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:53.256 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:53.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:53.305 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-12-07T02:53:53.714 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:53.724 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:53.724 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:53.726 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:53.726 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:54.298 INFO:teuthology.orchestra.run.smithi179.stdout:generic/500 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:54.308 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/500 2023-12-07T02:53:54.308 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/500 2023-12-07T02:53:54.309 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:54.316 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:54.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:54.351 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-12-07T02:53:54.777 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:54.784 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:54.785 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:54.785 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:54.786 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:55.871 INFO:teuthology.orchestra.run.smithi179.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T02:53:55.913 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/501 2023-12-07T02:53:55.913 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/501 2023-12-07T02:53:55.913 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:55.916 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:56.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:56.079 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-12-07T02:53:56.514 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:56.538 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:56.538 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:56.539 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:56.539 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:57.116 INFO:teuthology.orchestra.run.smithi179.stdout:generic/502 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:53:57.121 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/502 2023-12-07T02:53:57.121 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/502 2023-12-07T02:53:57.121 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:57.123 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:57.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:57.180 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-12-07T02:53:57.554 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:57.562 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:57.562 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:57.563 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:57.563 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:58.151 INFO:teuthology.orchestra.run.smithi179.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T02:53:58.157 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/503 2023-12-07T02:53:58.157 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/503 2023-12-07T02:53:58.157 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:58.168 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:58.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:58.233 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-12-07T02:53:58.661 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:58.680 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:58.681 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:58.682 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:58.682 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:59.310 INFO:teuthology.orchestra.run.smithi179.stdout:generic/504 1s 2023-12-07T02:53:59.318 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/504 2023-12-07T02:53:59.319 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:53:59.326 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:53:59.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:53:59.370 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-12-07T02:53:59.824 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:53:59.829 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:53:59.830 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:53:59.831 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:53:59.831 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:00.730 INFO:teuthology.orchestra.run.smithi179.stdout:generic/505 [not run] ceph does not support shutdown 2023-12-07T02:54:00.769 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/505 2023-12-07T02:54:00.769 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/505 2023-12-07T02:54:00.769 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:00.774 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:00.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:00.812 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-12-07T02:54:01.225 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:01.236 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:01.237 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:01.244 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:01.244 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:01.793 INFO:teuthology.orchestra.run.smithi179.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-07T02:54:01.798 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/506 2023-12-07T02:54:01.798 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/506 2023-12-07T02:54:01.798 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:01.800 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:01.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:01.840 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-12-07T02:54:02.280 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:02.298 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:02.300 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:02.306 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:02.306 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:02.877 INFO:teuthology.orchestra.run.smithi179.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-07T02:54:02.885 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/507 2023-12-07T02:54:02.885 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/507 2023-12-07T02:54:02.885 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:02.890 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:02.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:02.929 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-12-07T02:54:03.427 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:03.438 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:03.439 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:03.440 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:03.440 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:04.019 INFO:teuthology.orchestra.run.smithi179.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-12-07T02:54:04.029 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/508 2023-12-07T02:54:04.029 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/508 2023-12-07T02:54:04.029 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:04.046 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:04.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:04.083 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-12-07T02:54:04.530 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:04.538 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:04.541 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:04.544 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:04.545 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:05.078 INFO:teuthology.orchestra.run.smithi179.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-12-07T02:54:05.084 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/509 2023-12-07T02:54:05.084 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/509 2023-12-07T02:54:05.084 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:05.086 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:05.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:05.133 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-12-07T02:54:05.544 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:05.548 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:05.549 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:05.550 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:05.550 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:06.134 INFO:teuthology.orchestra.run.smithi179.stdout:generic/510 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:54:06.144 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/510 2023-12-07T02:54:06.144 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/510 2023-12-07T02:54:06.144 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:06.152 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:06.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:06.194 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-12-07T02:54:06.589 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:06.593 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:06.593 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:06.594 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:06.595 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:07.133 INFO:teuthology.orchestra.run.smithi179.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-07T02:54:07.141 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/511 2023-12-07T02:54:07.141 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/511 2023-12-07T02:54:07.141 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:07.144 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:07.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:07.193 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-12-07T02:54:07.622 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:07.627 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:07.630 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:07.632 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:07.632 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:08.260 INFO:teuthology.orchestra.run.smithi179.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T02:54:08.267 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/512 2023-12-07T02:54:08.267 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/512 2023-12-07T02:54:08.267 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:08.270 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:08.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:08.323 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-12-07T02:54:08.773 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:08.778 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:08.778 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:08.780 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:08.780 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:10.014 INFO:teuthology.orchestra.run.smithi179.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T02:54:10.109 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/513 2023-12-07T02:54:10.109 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/513 2023-12-07T02:54:10.109 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:10.120 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:10.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:10.176 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-12-07T02:54:10.670 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:10.677 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:10.680 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:10.681 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:10.681 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:11.966 INFO:teuthology.orchestra.run.smithi179.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T02:54:12.014 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/514 2023-12-07T02:54:12.014 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/514 2023-12-07T02:54:12.015 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:12.028 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:12.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:12.103 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-12-07T02:54:12.478 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:12.486 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:12.487 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:12.488 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:12.488 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:13.614 INFO:teuthology.orchestra.run.smithi179.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T02:54:13.710 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/515 2023-12-07T02:54:13.710 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/515 2023-12-07T02:54:13.710 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:13.732 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:13.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:13.829 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-12-07T02:54:14.261 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:14.270 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:14.271 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:14.272 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:14.272 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:14.950 INFO:teuthology.orchestra.run.smithi179.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-07T02:54:14.955 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/516 2023-12-07T02:54:14.955 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/516 2023-12-07T02:54:14.955 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:14.963 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:15.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:15.393 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-12-07T02:54:15.930 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:15.937 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:15.938 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:15.939 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:15.939 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:16.798 INFO:teuthology.orchestra.run.smithi179.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-07T02:54:17.070 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/517 2023-12-07T02:54:17.070 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/517 2023-12-07T02:54:17.070 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:17.219 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:17.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:17.316 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-12-07T02:54:17.782 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:17.791 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:17.791 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:17.792 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:17.793 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:18.848 INFO:teuthology.orchestra.run.smithi179.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T02:54:18.989 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/518 2023-12-07T02:54:18.989 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/518 2023-12-07T02:54:18.989 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:19.089 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:19.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:19.172 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-12-07T02:54:19.586 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:19.599 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:19.600 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:19.601 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:19.601 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:20.395 INFO:teuthology.orchestra.run.smithi179.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-12-07T02:54:20.403 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/519 2023-12-07T02:54:20.403 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/519 2023-12-07T02:54:20.404 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:20.406 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:20.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:20.800 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-12-07T02:54:21.296 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:21.300 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:21.301 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:21.301 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:21.302 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:21.826 INFO:teuthology.orchestra.run.smithi179.stdout:generic/520 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T02:54:21.830 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/520 2023-12-07T02:54:21.830 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/520 2023-12-07T02:54:21.830 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T02:54:21.836 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:54:21.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T02:54:21.881 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-12-07T02:54:22.256 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T02:54:22.260 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T02:54:22.261 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T02:54:22.262 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T02:54:22.262 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T02:55:28.994 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:55:28.997 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:55:29.084 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T02:55:29.086+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120049) UID: 0 2023-12-07T02:55:29.085 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T02:55:29.086+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120049) UID: 0 2023-12-07T02:55:29.085 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:55:29.086+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120049) UID: 0 2023-12-07T02:55:29.085 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:55:29.086+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120049) UID: 0 2023-12-07T02:55:29.104 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T02:55:29.105+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666109) UID: 0 2023-12-07T02:55:29.104 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T02:55:29.105+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666109) UID: 0 2023-12-07T02:55:29.104 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T02:55:29.105+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666109) UID: 0 2023-12-07T02:55:29.105 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T02:55:29.106+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666109) UID: 0 2023-12-07T02:59:07.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:59:07.817 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T02:59:08.095 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T02:59:08.097+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120107) UID: 0 2023-12-07T02:59:08.095 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T02:59:08.097+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120107) UID: 0 2023-12-07T02:59:08.098 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:59:08.100+0000 7fc7d3de3700 -1 Fail to open '/proc/120107/cmdline' error = (2) No such file or directory 2023-12-07T02:59:08.098 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T02:59:08.100+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 120107) UID: 0 2023-12-07T02:59:08.131 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:59:08.098+0000 7ff4ae1b8700 -1 Fail to open '/proc/120107/cmdline' error = (2) No such file or directory 2023-12-07T02:59:08.131 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T02:59:08.098+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 120107) UID: 0 2023-12-07T03:02:39.080 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:02:39.084 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:03:09.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:03:09.207 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:03:39.304 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:03:39.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:04:09.411 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:04:09.414 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:04:39.526 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:04:39.530 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:05:09.848 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:05:09.851 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:05:09.900 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T03:05:09.900+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666360) UID: 0 2023-12-07T03:05:09.900 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T03:05:09.900+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666360) UID: 0 2023-12-07T03:05:09.900 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T03:05:09.901+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666360) UID: 0 2023-12-07T03:05:09.901 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T03:05:09.901+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666360) UID: 0 2023-12-07T03:08:26.045 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:08:26.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:08:26.135 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T03:08:26.136+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120351) UID: 0 2023-12-07T03:08:26.136 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T03:08:26.136+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120351) UID: 0 2023-12-07T03:08:26.136 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T03:08:26.136+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120351) UID: 0 2023-12-07T03:08:26.136 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:08:26.138+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 120351) UID: 0 2023-12-07T03:08:27.655 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T03:08:27.656+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666410) UID: 0 2023-12-07T03:08:27.655 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T03:08:27.656+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666410) UID: 0 2023-12-07T03:08:27.656 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T03:08:27.657+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666410) UID: 0 2023-12-07T03:08:27.656 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T03:08:27.656+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 666410) UID: 0 2023-12-07T03:11:50.691 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:11:50.695 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:12:20.833 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:12:20.838 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:12:50.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:12:50.972 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:13:21.072 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:13:21.074 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:13:51.146 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:13:51.150 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:14:21.237 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:14:21.240 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:14:51.773 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:14:51.776 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:14:51.859 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T03:14:51.860+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120557) UID: 0 2023-12-07T03:14:51.859 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T03:14:51.860+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120557) UID: 0 2023-12-07T03:14:51.859 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T03:14:51.860+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120557) UID: 0 2023-12-07T03:14:51.859 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:14:51.861+0000 7ff4ae1b8700 -1 Fail to open '/proc/120557/cmdline' error = (2) No such file or directory 2023-12-07T03:14:51.860 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:14:51.861+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 120557) UID: 0 2023-12-07T03:18:12.744 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:18:12.747 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:18:42.840 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:18:42.843 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:19:12.913 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:19:12.915 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:19:43.045 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:19:43.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:19:43.122 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T03:19:43.124+0000 7fe3fc6fb700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 666744) UID: 0 2023-12-07T03:19:43.123 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T03:19:43.124+0000 7f6899d25700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 666744) UID: 0 2023-12-07T03:22:49.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:22:49.224 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:23:19.673 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:23:19.676 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:23:50.004 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:23:50.007 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:24:20.383 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:24:20.386 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:24:50.484 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:24:50.489 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:25:20.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:25:20.592 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:25:50.761 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:25:50.764 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:26:20.906 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:26:20.911 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:26:51.015 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:26:51.018 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:27:21.105 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:27:21.108 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:27:51.435 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:27:51.441 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:28:21.983 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:28:21.986 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:28:52.095 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:28:52.098 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:29:22.177 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:29:22.180 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:29:52.284 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:29:52.297 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:29:52.362 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T03:29:52.362+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121091) UID: 0 2023-12-07T03:29:52.362 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T03:29:52.362+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121091) UID: 0 2023-12-07T03:29:52.363 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T03:29:52.364+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 121091) UID: 0 2023-12-07T03:29:52.363 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:29:52.364+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 121091) UID: 0 2023-12-07T03:33:07.239 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:33:07.245 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:33:07.338 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T03:33:07.340+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121152) UID: 0 2023-12-07T03:33:07.339 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T03:33:07.340+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121152) UID: 0 2023-12-07T03:33:07.339 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T03:33:07.341+0000 7fc7d3de3700 -1 Fail to open '/proc/121152/cmdline' error = (2) No such file or directory 2023-12-07T03:33:07.340 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T03:33:07.341+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 121152) UID: 0 2023-12-07T03:33:07.340 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:33:07.341+0000 7ff4ae1b8700 -1 Fail to open '/proc/121152/cmdline' error = (2) No such file or directory 2023-12-07T03:33:07.340 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:33:07.341+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 121152) UID: 0 2023-12-07T03:36:23.438 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:36:23.441 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:36:53.742 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:36:53.745 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:37:23.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:37:23.976 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:37:54.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:37:54.056 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:38:24.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:38:24.154 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:38:54.270 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:38:54.273 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:38:54.321 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T03:38:54.322+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667606) UID: 0 2023-12-07T03:38:54.321 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T03:38:54.322+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667606) UID: 0 2023-12-07T03:38:54.321 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T03:38:54.322+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667606) UID: 0 2023-12-07T03:38:54.322 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T03:38:54.323+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667606) UID: 0 2023-12-07T03:42:01.294 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T03:42:01.295+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667648) UID: 0 2023-12-07T03:42:01.295 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T03:42:01.295+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667648) UID: 0 2023-12-07T03:42:01.295 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T03:42:01.295+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667648) UID: 0 2023-12-07T03:42:01.296 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T03:42:01.295+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667648) UID: 0 2023-12-07T03:42:08.701 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:42:08.706 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:42:08.767 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T03:42:08.768+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121382) UID: 0 2023-12-07T03:42:08.767 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T03:42:08.768+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121382) UID: 0 2023-12-07T03:42:08.768 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T03:42:08.768+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121382) UID: 0 2023-12-07T03:42:08.768 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:42:08.769+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 121382) UID: 0 2023-12-07T03:45:41.132 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:45:41.135 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:46:11.379 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:46:11.382 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:46:41.602 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:46:41.612 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:46:41.667 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T03:46:41.667+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667777) UID: 0 2023-12-07T03:46:41.669 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T03:46:41.669+0000 7f4df7d65700 -1 received signal: Hangup from (PID: 667777) UID: 0 2023-12-07T03:46:41.669 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T03:46:41.669+0000 7f918020f700 -1 received signal: Hangup from (PID: 667777) UID: 0 2023-12-07T03:46:41.670 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T03:46:41.667+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667777) UID: 0 2023-12-07T03:50:00.030 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:50:00.033 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:50:30.167 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:50:30.173 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:51:00.251 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:51:00.255 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:51:30.332 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:51:30.335 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:52:00.624 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:52:00.627 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:52:30.711 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:52:30.714 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:53:00.842 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:53:00.845 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:53:30.939 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:53:30.944 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:54:01.045 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:54:01.048 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:54:31.552 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:54:31.563 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:55:01.698 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:55:01.702 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:55:31.809 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:55:31.812 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:56:01.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:56:01.896 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:56:31.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:56:31.995 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:57:02.082 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:57:02.085 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:57:32.216 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:57:32.220 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T03:57:32.356 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T03:57:32.357+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121943) UID: 0 2023-12-07T03:57:32.356 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T03:57:32.357+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121943) UID: 0 2023-12-07T03:57:32.356 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:57:32.358+0000 7ff4ae1b8700 -1 Fail to open '/proc/121943/cmdline' error = (2) No such file or directory 2023-12-07T03:57:32.357 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T03:57:32.358+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 121943) UID: 0 2023-12-07T03:57:32.357 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T03:57:32.357+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121943) UID: 0 2023-12-07T04:00:44.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:00:44.426 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:00:44.508 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T04:00:44.510+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121997) UID: 0 2023-12-07T04:00:44.509 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:00:44.511+0000 7ff4ae1b8700 -1 Fail to open '/proc/121997/cmdline' error = (2) No such file or directory 2023-12-07T04:00:44.509 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:00:44.511+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 121997) UID: 0 2023-12-07T04:00:44.510 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:00:44.511+0000 7fc4b5304700 -1 Fail to open '/proc/121997/cmdline' error = (2) No such file or directory 2023-12-07T04:00:44.510 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:00:44.511+0000 7fc4b5304700 -1 received signal: Hangup from (PID: 121997) UID: 0 2023-12-07T04:00:44.510 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T04:00:44.511+0000 7fc7d3de3700 -1 Fail to open '/proc/121997/cmdline' error = (2) No such file or directory 2023-12-07T04:00:44.510 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T04:00:44.512+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 121997) UID: 0 2023-12-07T04:04:02.768 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:04:02.772 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:04:33.009 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:04:33.012 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:05:03.356 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:05:03.367 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:05:33.446 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:05:33.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:06:03.602 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:06:03.608 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:06:33.700 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:06:33.703 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:07:03.808 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:07:03.811 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:07:33.956 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:07:33.965 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:08:04.052 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:08:04.054 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:08:04.135 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T04:08:04.137+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122261) UID: 0 2023-12-07T04:08:04.136 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T04:08:04.138+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 122261) UID: 0 2023-12-07T04:08:04.137 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:08:04.139+0000 7fc4b5304700 -1 Fail to open '/proc/122261/cmdline' error = (2) No such file or directory 2023-12-07T04:08:04.137 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:08:04.139+0000 7fc4b5304700 -1 received signal: Hangup from (PID: 122261) UID: 0 2023-12-07T04:08:04.139 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:08:04.141+0000 7ff4ae1b8700 -1 Fail to open '/proc/122261/cmdline' error = (2) No such file or directory 2023-12-07T04:08:04.139 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:08:04.141+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 122261) UID: 0 2023-12-07T04:11:23.189 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:11:23.228 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:11:23.298 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T04:11:23.300+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122322) UID: 0 2023-12-07T04:11:23.298 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:11:23.300+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122322) UID: 0 2023-12-07T04:11:23.299 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T04:11:23.300+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122322) UID: 0 2023-12-07T04:11:23.299 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:11:23.300+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122322) UID: 0 2023-12-07T04:14:38.404 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:14:38.407 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:14:38.502 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T04:14:38.504+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668654) UID: 0 2023-12-07T04:14:38.503 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T04:14:38.504+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668654) UID: 0 2023-12-07T04:14:38.503 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T04:14:38.504+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668654) UID: 0 2023-12-07T04:14:38.503 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T04:14:38.505+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668654) UID: 0 2023-12-07T04:18:00.903 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:18:00.906 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:18:00.990 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T04:18:00.992+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668704) UID: 0 2023-12-07T04:18:00.991 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T04:18:00.992+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668704) UID: 0 2023-12-07T04:18:00.991 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T04:18:00.992+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668704) UID: 0 2023-12-07T04:18:00.991 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T04:18:00.992+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 668704) UID: 0 2023-12-07T04:21:24.826 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:21:24.829 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:21:54.930 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:21:54.933 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:22:25.052 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:22:25.055 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:22:55.182 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:22:55.185 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:23:25.338 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:23:25.352 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:23:55.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:23:55.929 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:24:26.005 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:24:26.008 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:24:56.097 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:24:56.100 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:25:26.657 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:25:26.660 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:25:56.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:25:56.825 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:26:26.904 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:26:26.909 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:26:57.017 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:26:57.022 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:27:27.171 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:27:27.174 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:27:57.535 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:27:57.538 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:28:27.608 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:28:27.612 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:28:58.077 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:28:58.080 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:29:28.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:29:28.427 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:29:28.476 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T04:29:28.477+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 669171) UID: 0 2023-12-07T04:29:28.476 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T04:29:28.477+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 669171) UID: 0 2023-12-07T04:29:28.477 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T04:29:28.477+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 669171) UID: 0 2023-12-07T04:29:28.477 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T04:29:28.477+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 669171) UID: 0 2023-12-07T04:32:46.136 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:32:46.139 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:32:46.282 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:32:46.283+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122935) UID: 0 2023-12-07T04:32:46.282 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T04:32:46.283+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122935) UID: 0 2023-12-07T04:32:46.284 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:32:46.282+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122935) UID: 0 2023-12-07T04:32:46.285 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T04:32:46.282+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122935) UID: 0 2023-12-07T04:36:13.752 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:36:13.770 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:36:13.846 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:36:13.847+0000 7ff4ae1b8700 -1 Fail to open '/proc/122994/cmdline' error = (2) No such file or directory 2023-12-07T04:36:13.846 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:36:13.847+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 122994) UID: 0 2023-12-07T04:36:13.846 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:36:13.845+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122994) UID: 0 2023-12-07T04:36:13.846 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T04:36:13.847+0000 7fe9ce15f700 -1 received signal: Hangup from (PID: 122994) UID: 0 2023-12-07T04:36:13.847 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T04:36:13.845+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122994) UID: 0 2023-12-07T04:36:13.854 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T04:36:13.856+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 669278) UID: 0 2023-12-07T04:36:13.854 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T04:36:13.856+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 669278) UID: 0 2023-12-07T04:36:13.856 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T04:36:13.858+0000 7f918020f700 -1 Fail to open '/proc/669278/cmdline' error = (2) No such file or directory 2023-12-07T04:36:13.856 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T04:36:13.858+0000 7f918020f700 -1 received signal: Hangup from (PID: 669278) UID: 0 2023-12-07T04:36:13.856 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T04:36:13.857+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 669278) UID: 0 2023-12-07T04:39:18.384 INFO:teuthology.orchestra.run.smithi190.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2023-12-07T04:39:18.385 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: stdin: file size changed while zipping 2023-12-07T04:39:34.071 INFO:teuthology.orchestra.run.smithi179.stdout:generic/521 6312s 2023-12-07T04:39:34.095 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/521 2023-12-07T04:39:34.095 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T04:39:34.097 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T04:39:34.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T04:39:34.417 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-12-07T04:39:34.998 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T04:39:35.004 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T04:39:35.007 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T04:39:35.008 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T04:39:35.008 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T04:39:50.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:39:50.586 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:40:20.646 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:40:20.649 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:40:50.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:40:50.824 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:41:21.307 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:41:21.311 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:41:51.650 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:41:51.653 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:42:21.907 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:42:21.910 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:42:52.180 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:42:52.183 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:43:22.497 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:43:22.501 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:43:52.893 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:43:52.896 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:44:23.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:44:23.154 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:44:53.569 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:44:53.572 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:45:23.885 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:45:23.888 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:45:23.969 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T04:45:23.970+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123329) UID: 0 2023-12-07T04:45:23.969 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:45:23.970+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123329) UID: 0 2023-12-07T04:45:23.970 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T04:45:23.971+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 123329) UID: 0 2023-12-07T04:45:23.970 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:45:23.970+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123329) UID: 0 2023-12-07T04:48:43.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:48:43.786 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:48:43.859 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T04:48:43.861+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123379) UID: 0 2023-12-07T04:48:43.860 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T04:48:43.862+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123379) UID: 0 2023-12-07T04:48:43.860 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:48:43.862+0000 7ff4ae1b8700 -1 Fail to open '/proc/123379/cmdline' error = (2) No such file or directory 2023-12-07T04:48:43.860 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T04:48:43.862+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 123379) UID: 0 2023-12-07T04:48:43.863 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T04:48:43.861+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123379) UID: 0 2023-12-07T04:48:43.866 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T04:48:43.868+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670165) UID: 0 2023-12-07T04:48:43.867 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T04:48:43.868+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670165) UID: 0 2023-12-07T04:48:43.867 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T04:48:43.868+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670165) UID: 0 2023-12-07T04:48:43.867 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T04:48:43.869+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670165) UID: 0 2023-12-07T04:52:22.170 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:52:22.173 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:52:22.415 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T04:52:22.417+0000 7fe3fc6fb700 -1 Fail to open '/proc/670227/cmdline' error = (2) No such file or directory 2023-12-07T04:52:22.415 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T04:52:22.417+0000 7fe3fc6fb700 -1 received signal: Hangup from (PID: 670227) UID: 0 2023-12-07T04:52:22.417 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T04:52:22.419+0000 7f6899d25700 -1 Fail to open '/proc/670227/cmdline' error = (2) No such file or directory 2023-12-07T04:52:22.417 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T04:52:22.419+0000 7f6899d25700 -1 received signal: Hangup from (PID: 670227) UID: 0 2023-12-07T04:55:03.948 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T04:55:03.949+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670246) UID: 0 2023-12-07T04:55:03.949 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T04:55:03.949+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670246) UID: 0 2023-12-07T04:55:03.949 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T04:55:03.949+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670246) UID: 0 2023-12-07T04:55:03.983 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T04:55:03.949+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 670246) UID: 0 2023-12-07T04:58:17.714 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:58:17.717 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:58:47.824 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:58:47.827 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:59:18.208 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:59:18.212 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:59:48.305 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T04:59:48.308 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:00:18.386 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:00:18.389 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:00:48.458 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:00:48.461 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:00:48.530 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T05:00:48.531+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123641) UID: 0 2023-12-07T05:00:48.530 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:00:48.531+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123641) UID: 0 2023-12-07T05:00:48.530 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:00:48.531+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123641) UID: 0 2023-12-07T05:00:48.531 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:00:48.533+0000 7ff4ae1b8700 -1 Fail to open '/proc/123641/cmdline' error = (2) No such file or directory 2023-12-07T05:00:48.532 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:00:48.533+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 123641) UID: 0 2023-12-07T05:04:10.894 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:04:10.897 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:04:40.993 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:04:40.996 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:05:11.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:05:11.134 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:05:41.618 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:05:41.622 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:06:11.694 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:06:11.696 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:06:42.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:06:42.153 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:07:12.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:07:12.229 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:07:42.375 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:07:42.379 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:08:12.490 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:08:12.493 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:08:42.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:08:42.650 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:09:12.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:09:12.745 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:09:42.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:09:42.888 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:10:12.997 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:10:13.000 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:10:43.104 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:10:43.107 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:11:13.185 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:11:13.188 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:11:43.265 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:11:43.267 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:12:13.347 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:12:13.350 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:12:43.620 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:12:43.622 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:13:13.700 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:13:13.702 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:13:43.773 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:13:43.778 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:14:13.858 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:14:13.872 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:14:13.967 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T05:14:13.969+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124217) UID: 0 2023-12-07T05:14:13.968 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:14:13.969+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124217) UID: 0 2023-12-07T05:14:13.969 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:14:13.971+0000 7fc7d3de3700 -1 Fail to open '/proc/124217/cmdline' error = (2) No such file or directory 2023-12-07T05:14:13.969 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:14:13.971+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 124217) UID: 0 2023-12-07T05:14:13.970 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:14:13.971+0000 7fc4b5304700 -1 Fail to open '/proc/124217/cmdline' error = (2) No such file or directory 2023-12-07T05:14:13.970 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:14:13.971+0000 7fc4b5304700 -1 received signal: Hangup from (PID: 124217) UID: 0 2023-12-07T05:17:36.470 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:17:36.473 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:17:36.533 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T05:17:36.535+0000 7ff5f6948700 -1 received signal: Hangup from (PID: 671049) UID: 0 2023-12-07T05:17:36.537 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T05:17:36.537+0000 7f4df7d65700 -1 received signal: Hangup from (PID: 671049) UID: 0 2023-12-07T05:17:36.538 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T05:17:36.535+0000 7fd2f87cb700 -1 received signal: Hangup from (PID: 671049) UID: 0 2023-12-07T05:17:36.543 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T05:17:36.540+0000 7f918020f700 -1 Fail to open '/proc/671049/cmdline' error = (2) No such file or directory 2023-12-07T05:17:36.543 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T05:17:36.540+0000 7f918020f700 -1 received signal: Hangup from (PID: 671049) UID: 0 2023-12-07T05:20:53.937 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:20:53.940 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:20:54.034 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:20:54.034+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124318) UID: 0 2023-12-07T05:20:54.034 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:20:54.035+0000 7fc7d3de3700 -1 Fail to open '/proc/124318/cmdline' error = (2) No such file or directory 2023-12-07T05:20:54.035 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:20:54.035+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 124318) UID: 0 2023-12-07T05:20:54.035 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T05:20:54.034+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124318) UID: 0 2023-12-07T05:20:54.035 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:20:54.034+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124318) UID: 0 2023-12-07T05:24:22.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:24:22.652 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:24:22.697 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T05:24:22.698+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671158) UID: 0 2023-12-07T05:24:22.697 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T05:24:22.698+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671158) UID: 0 2023-12-07T05:24:22.698 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T05:24:22.698+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671158) UID: 0 2023-12-07T05:24:22.698 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T05:24:22.698+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671158) UID: 0 2023-12-07T05:27:46.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:27:46.126 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:27:46.186 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T05:27:46.187+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124424) UID: 0 2023-12-07T05:27:46.187 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:27:46.187+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124424) UID: 0 2023-12-07T05:27:46.187 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:27:46.187+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124424) UID: 0 2023-12-07T05:27:46.193 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:27:46.194+0000 7ff4ae1b8700 -1 Fail to open '/proc/124424/cmdline' error = (2) No such file or directory 2023-12-07T05:27:46.193 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:27:46.194+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 124424) UID: 0 2023-12-07T05:31:10.591 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:31:10.595 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:31:10.648 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T05:31:10.649+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671265) UID: 0 2023-12-07T05:31:10.649 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T05:31:10.650+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671265) UID: 0 2023-12-07T05:31:10.652 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T05:31:10.650+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671265) UID: 0 2023-12-07T05:31:10.652 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T05:31:10.650+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 671265) UID: 0 2023-12-07T05:37:17.479 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:37:17.482 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:37:17.585 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T05:37:17.586+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124750) UID: 0 2023-12-07T05:37:17.586 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:37:17.587+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 124750) UID: 0 2023-12-07T05:37:17.587 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:37:17.587+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 124750) UID: 0 2023-12-07T05:37:17.588 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:37:17.587+0000 7fc4b5304700 -1 received signal: Hangup from (PID: 124750) UID: 0 2023-12-07T05:40:59.676 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:40:59.679 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:40:59.775 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T05:40:59.773+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124805) UID: 0 2023-12-07T05:40:59.776 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:40:59.776+0000 7fc4b5304700 -1 Fail to open '/proc/124805/cmdline' error = (2) No such file or directory 2023-12-07T05:40:59.776 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:40:59.776+0000 7fc4b5304700 -1 received signal: Hangup from (PID: 124805) UID: 0 2023-12-07T05:40:59.776 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:40:59.777+0000 7fc7d3de3700 -1 Fail to open '/proc/124805/cmdline' error = (2) No such file or directory 2023-12-07T05:40:59.776 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:40:59.777+0000 7fc7d3de3700 -1 received signal: Hangup from (PID: 124805) UID: 0 2023-12-07T05:40:59.776 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:40:59.777+0000 7ff4ae1b8700 -1 Fail to open '/proc/124805/cmdline' error = (2) No such file or directory 2023-12-07T05:40:59.777 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:40:59.777+0000 7ff4ae1b8700 -1 received signal: Hangup from (PID: 124805) UID: 0 2023-12-07T05:43:57.919 INFO:teuthology.orchestra.run.smithi190.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.7.log.1: 2023-12-07T05:43:57.920 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: stdin: file size changed while zipping 2023-12-07T05:44:29.560 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:44:29.564 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:45:00.155 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:45:00.159 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:45:30.359 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:45:30.363 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:46:00.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:46:00.512 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:46:30.740 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:46:30.742 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:47:00.845 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:47:00.848 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:47:31.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:47:31.005 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:48:01.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:48:01.129 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:48:31.240 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:48:31.242 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:49:01.334 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:49:01.337 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:49:31.718 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:49:31.722 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:50:02.113 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:50:02.117 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:50:32.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:50:32.203 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:51:02.562 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:51:02.564 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:51:14.025 INFO:teuthology.orchestra.run.smithi179.stdout:generic/522 4299s 2023-12-07T05:51:14.048 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/522 2023-12-07T05:51:14.048 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:14.053 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:14.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:14.138 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-12-07T05:51:14.628 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:14.636 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:14.636 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:14.638 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:14.638 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:15.519 INFO:teuthology.orchestra.run.smithi179.stdout:generic/523 1s 2023-12-07T05:51:15.525 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/523 2023-12-07T05:51:15.525 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:15.527 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:15.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:15.538 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-12-07T05:51:15.880 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:15.884 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:15.885 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:15.886 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:15.886 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:21.505 INFO:teuthology.orchestra.run.smithi179.stdout:generic/524 5s 2023-12-07T05:51:21.514 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/524 2023-12-07T05:51:21.514 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:21.516 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:21.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:21.530 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-12-07T05:51:21.838 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:21.843 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:21.843 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:21.844 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:21.844 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:22.716 INFO:teuthology.orchestra.run.smithi179.stdout:generic/525 [not run] filesystem does not support huge file size 2023-12-07T05:51:22.745 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/525 2023-12-07T05:51:22.746 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/525 2023-12-07T05:51:22.746 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:22.748 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:22.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:22.783 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-12-07T05:51:23.117 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:23.125 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:23.126 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:23.127 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:23.127 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:24.306 INFO:teuthology.orchestra.run.smithi179.stdout:generic/526 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T05:51:24.315 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/526 2023-12-07T05:51:24.315 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/526 2023-12-07T05:51:24.315 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:24.319 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:24.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:24.378 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-12-07T05:51:24.714 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:24.734 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:24.734 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:24.735 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:24.735 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:25.277 INFO:teuthology.orchestra.run.smithi179.stdout:generic/527 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T05:51:25.285 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/527 2023-12-07T05:51:25.285 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/527 2023-12-07T05:51:25.285 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:25.288 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:25.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:25.330 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-12-07T05:51:25.681 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:25.685 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:25.686 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:25.687 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:25.687 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:26.296 INFO:teuthology.orchestra.run.smithi179.stdout:generic/528 1s 2023-12-07T05:51:26.302 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/528 2023-12-07T05:51:26.302 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:26.304 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:26.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:26.662 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-12-07T05:51:27.117 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:27.126 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:27.129 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:27.130 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:27.130 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:28.038 INFO:teuthology.orchestra.run.smithi179.stdout:generic/529 1s 2023-12-07T05:51:28.046 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/529 2023-12-07T05:51:28.046 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:28.047 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:28.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:28.059 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-12-07T05:51:28.368 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:28.376 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:28.377 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:28.379 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:28.380 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:29.083 INFO:teuthology.orchestra.run.smithi179.stdout:generic/530 [not run] ceph does not support shutdown 2023-12-07T05:51:29.120 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/530 2023-12-07T05:51:29.120 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/530 2023-12-07T05:51:29.120 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:29.122 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:29.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:29.154 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-12-07T05:51:29.544 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:29.549 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:29.550 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:29.551 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:29.551 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:30.024 INFO:teuthology.orchestra.run.smithi179.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-12-07T05:51:30.033 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/531 2023-12-07T05:51:30.033 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/531 2023-12-07T05:51:30.033 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:30.037 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:30.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:30.083 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-12-07T05:51:30.452 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:30.457 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:30.458 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:30.459 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:30.459 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:31.221 INFO:teuthology.orchestra.run.smithi179.stdout:generic/532 1s 2023-12-07T05:51:31.228 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/532 2023-12-07T05:51:31.228 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:31.230 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:31.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:31.280 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-12-07T05:51:31.595 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:31.600 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:31.600 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:31.608 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:31.608 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:32.636 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:51:32.640 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:51:32.919 INFO:teuthology.orchestra.run.smithi179.stdout:generic/533 1s 2023-12-07T05:51:32.933 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/533 2023-12-07T05:51:32.933 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:32.936 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:32.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:32.971 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-12-07T05:51:33.362 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:33.367 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:33.367 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:33.369 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:33.369 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:33.865 INFO:teuthology.orchestra.run.smithi179.stdout:generic/534 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T05:51:33.870 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/534 2023-12-07T05:51:33.871 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/534 2023-12-07T05:51:33.871 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:33.873 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:33.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:33.904 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-12-07T05:51:34.225 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:34.230 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:34.230 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:34.231 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:34.232 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:34.696 INFO:teuthology.orchestra.run.smithi179.stdout:generic/535 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T05:51:34.700 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/535 2023-12-07T05:51:34.701 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/535 2023-12-07T05:51:34.701 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:34.709 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:34.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:34.734 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-12-07T05:51:35.078 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:35.085 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:35.085 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:35.087 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:35.087 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:35.793 INFO:teuthology.orchestra.run.smithi179.stdout:generic/536 [not run] ceph does not support shutdown 2023-12-07T05:51:35.816 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/536 2023-12-07T05:51:35.817 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/536 2023-12-07T05:51:35.817 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:35.819 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:35.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:35.858 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-12-07T05:51:36.220 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:36.234 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:36.235 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:36.235 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:36.236 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:37.121 INFO:teuthology.orchestra.run.smithi179.stdout:generic/537 [not run] FSTRIM not supported 2023-12-07T05:51:37.145 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/537 2023-12-07T05:51:37.146 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/537 2023-12-07T05:51:37.146 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T05:51:37.148 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:51:37.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T05:51:37.180 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-12-07T05:51:37.560 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T05:51:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T05:51:37.574 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T05:51:37.575 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T05:51:37.575 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T05:52:02.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:52:02.745 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:52:32.822 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:52:32.826 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:53:02.955 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:53:02.959 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:53:33.086 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:53:33.089 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:54:03.587 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:54:03.590 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:54:03.650 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T05:54:03.651+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125847) UID: 0 2023-12-07T05:54:03.652 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T05:54:03.653+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125847) UID: 0 2023-12-07T05:54:03.653 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T05:54:03.653+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125847) UID: 0 2023-12-07T05:54:03.653 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T05:54:03.653+0000 7ff4ae1b8700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125847) UID: 0 2023-12-07T05:57:28.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:57:28.224 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:57:58.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:57:58.351 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:58:28.439 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:58:28.442 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:58:58.594 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:58:58.597 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:59:29.327 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:59:29.331 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:59:59.425 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T05:59:59.430 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:00:29.797 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:00:29.800 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:00:45.040 INFO:teuthology.orchestra.run.smithi179.stdout:generic/538 548s 2023-12-07T06:00:45.047 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/538 2023-12-07T06:00:45.047 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:45.048 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:45.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:45.490 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-12-07T06:00:45.981 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:45.991 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:45.991 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:45.992 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:45.992 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:48.482 INFO:teuthology.orchestra.run.smithi179.stdout:generic/539 2s 2023-12-07T06:00:48.487 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/539 2023-12-07T06:00:48.488 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:48.490 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:48.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:48.872 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-12-07T06:00:49.215 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:49.220 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:49.220 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:49.221 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:49.221 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:50.288 INFO:teuthology.orchestra.run.smithi179.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T06:00:50.295 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/540 2023-12-07T06:00:50.295 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/540 2023-12-07T06:00:50.296 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:50.329 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:50.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:50.527 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-12-07T06:00:50.829 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:50.833 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:50.834 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:50.835 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:50.835 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:51.971 INFO:teuthology.orchestra.run.smithi179.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T06:00:51.992 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/541 2023-12-07T06:00:51.992 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/541 2023-12-07T06:00:51.992 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:51.995 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:52.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:52.141 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-12-07T06:00:52.544 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:52.552 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:52.553 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:52.554 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:52.554 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:53.663 INFO:teuthology.orchestra.run.smithi179.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T06:00:53.671 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/542 2023-12-07T06:00:53.671 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/542 2023-12-07T06:00:53.671 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:53.675 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:53.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:53.773 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-12-07T06:00:54.123 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:54.127 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:54.128 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:54.129 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:54.129 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:55.483 INFO:teuthology.orchestra.run.smithi179.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T06:00:55.495 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/543 2023-12-07T06:00:55.495 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/543 2023-12-07T06:00:55.495 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:55.498 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:55.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:55.563 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-12-07T06:00:55.921 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:55.925 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:55.930 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:55.931 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:55.931 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:57.071 INFO:teuthology.orchestra.run.smithi179.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-07T06:00:57.075 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/544 2023-12-07T06:00:57.076 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/544 2023-12-07T06:00:57.076 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:57.078 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:57.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:57.222 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-12-07T06:00:57.560 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:57.565 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:57.567 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:57.568 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:57.568 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:58.156 INFO:teuthology.orchestra.run.smithi179.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-07T06:00:58.160 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/545 2023-12-07T06:00:58.161 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/545 2023-12-07T06:00:58.161 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:58.163 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:58.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:58.236 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-12-07T06:00:58.577 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:58.583 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:58.583 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:58.584 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:58.584 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:59.179 INFO:teuthology.orchestra.run.smithi179.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-07T06:00:59.185 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/546 2023-12-07T06:00:59.185 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/546 2023-12-07T06:00:59.185 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:00:59.188 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:59.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:00:59.246 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-12-07T06:00:59.600 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:00:59.604 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:00:59.605 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:00:59.606 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:00:59.606 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:00:59.960 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:00:59.962 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:01:00.163 INFO:teuthology.orchestra.run.smithi179.stdout:generic/547 [not run] require 172.21.15.179:6789:/scratch to be valid block disk 2023-12-07T06:01:00.168 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/547 2023-12-07T06:01:00.168 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/547 2023-12-07T06:01:00.168 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:01:00.171 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:01:00.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:01:00.198 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-12-07T06:01:00.522 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:01:00.526 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:01:00.527 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:01:00.528 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:01:00.528 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:01:01.304 INFO:teuthology.orchestra.run.smithi179.stdout:generic/548 [not run] kernel does not support ceph encryption 2023-12-07T06:01:01.331 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/548 2023-12-07T06:01:01.331 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/548 2023-12-07T06:01:01.331 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:01:01.333 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:01:01.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:01:01.377 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-12-07T06:01:01.747 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:01:01.752 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:01:01.752 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:01:01.759 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:01:01.759 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:01:02.573 INFO:teuthology.orchestra.run.smithi179.stdout:generic/549 [not run] kernel does not support ceph encryption 2023-12-07T06:01:02.597 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/549 2023-12-07T06:01:02.597 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/549 2023-12-07T06:01:02.597 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:01:02.599 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:01:02.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:01:02.637 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-12-07T06:01:03.002 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:01:03.006 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:01:03.007 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:01:03.008 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:01:03.008 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:01:03.791 INFO:teuthology.orchestra.run.smithi179.stdout:generic/550 [not run] kernel does not support ceph encryption 2023-12-07T06:01:03.821 INFO:teuthology.orchestra.run.smithi179.stdout:Ran: generic/550 2023-12-07T06:01:03.822 INFO:teuthology.orchestra.run.smithi179.stdout:Not run: generic/550 2023-12-07T06:01:03.822 INFO:teuthology.orchestra.run.smithi179.stdout:Passed all 1 tests 2023-12-07T06:01:03.824 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:01:03.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-07T06:01:03.852 DEBUG:teuthology.orchestra.run.smithi179:> (cd /tmp/tmp.poL8GbUio4xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-12-07T06:01:04.226 INFO:teuthology.orchestra.run.smithi179.stdout:FSTYP -- ceph 2023-12-07T06:01:04.235 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM -- Linux/x86_64 smithi179 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-12-07T06:01:04.235 INFO:teuthology.orchestra.run.smithi179.stdout:MKFS_OPTIONS -- 172.21.15.179:6789:/scratch 2023-12-07T06:01:04.237 INFO:teuthology.orchestra.run.smithi179.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaDnFlhk3AGRAAQYWESRCafGC9dzLr3SZnaA== -o context=system_u:object_r:root_t:s0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch 2023-12-07T06:01:04.237 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:01:30.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:01:30.057 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:01:47.484 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T06:01:47.480+0000 7ff4a4594700 -1 bdev(0x55f1ddf48000 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-07T06:01:47.546 INFO:tasks.ceph.osd.5.smithi190.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff4a4594700 time 2023-12-07T06:01:47.499523+0000 2023-12-07T06:01:47.546 INFO:tasks.ceph.osd.5.smithi190.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-07T06:01:47.546 INFO:tasks.ceph.osd.5.smithi190.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:01:47.546 INFO:tasks.ceph.osd.5.smithi190.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55f1db617ef9] 2023-12-07T06:01:47.546 INFO:tasks.ceph.osd.5.smithi190.stderr: 2: (KernelDevice::_aio_thread()+0x18a6) [0x55f1dc28fac6] 2023-12-07T06:01:47.546 INFO:tasks.ceph.osd.5.smithi190.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f1dc297a71] 2023-12-07T06:01:47.546 INFO:tasks.ceph.osd.5.smithi190.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ff4b68b51cf] 2023-12-07T06:01:47.546 INFO:tasks.ceph.osd.5.smithi190.stderr: 5: clone() 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr:*** Caught signal (Aborted) ** 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: in thread 7ff4a4594700 thread_name:bstore_aio 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T06:01:47.542+0000 7ff4a4594700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff4a4594700 time 2023-12-07T06:01:47.499523+0000 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55f1db617ef9] 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 2: (KernelDevice::_aio_thread()+0x18a6) [0x55f1dc28fac6] 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f1dc297a71] 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ff4b68b51cf] 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 5: clone() 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ff4b68bfce0] 2023-12-07T06:01:47.547 INFO:tasks.ceph.osd.5.smithi190.stderr: 2: gsignal() 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 3: abort() 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55f1db617fb9] 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 5: (KernelDevice::_aio_thread()+0x18a6) [0x55f1dc28fac6] 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f1dc297a71] 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ff4b68b51cf] 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 8: clone() 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-12-07T06:01:47.545+0000 7ff4a4594700 -1 *** Caught signal (Aborted) ** 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: in thread 7ff4a4594700 thread_name:bstore_aio 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ff4b68bfce0] 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 2: gsignal() 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 3: abort() 2023-12-07T06:01:47.548 INFO:tasks.ceph.osd.5.smithi190.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55f1db617fb9] 2023-12-07T06:01:47.549 INFO:tasks.ceph.osd.5.smithi190.stderr: 5: (KernelDevice::_aio_thread()+0x18a6) [0x55f1dc28fac6] 2023-12-07T06:01:47.549 INFO:tasks.ceph.osd.5.smithi190.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f1dc297a71] 2023-12-07T06:01:47.549 INFO:tasks.ceph.osd.5.smithi190.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ff4b68b51cf] 2023-12-07T06:01:47.549 INFO:tasks.ceph.osd.5.smithi190.stderr: 8: clone() 2023-12-07T06:01:47.549 INFO:tasks.ceph.osd.5.smithi190.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-07T06:01:47.549 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.558 INFO:tasks.ceph.osd.5.smithi190.stderr: -6562> 2023-12-07T06:01:47.480+0000 7ff4a4594700 -1 bdev(0x55f1ddf48000 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: -22> 2023-12-07T06:01:47.542+0000 7ff4a4594700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff4a4594700 time 2023-12-07T06:01:47.499523+0000 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55f1db617ef9] 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: 2: (KernelDevice::_aio_thread()+0x18a6) [0x55f1dc28fac6] 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f1dc297a71] 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ff4b68b51cf] 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: 5: clone() 2023-12-07T06:01:47.572 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 0> 2023-12-07T06:01:47.545+0000 7ff4a4594700 -1 *** Caught signal (Aborted) ** 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: in thread 7ff4a4594700 thread_name:bstore_aio 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ff4b68bfce0] 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 2: gsignal() 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 3: abort() 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55f1db617fb9] 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 5: (KernelDevice::_aio_thread()+0x18a6) [0x55f1dc28fac6] 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f1dc297a71] 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ff4b68b51cf] 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 8: clone() 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-07T06:01:47.573 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.579 INFO:tasks.ceph.osd.5.smithi190.stderr: -7563> 2023-12-07T06:01:47.480+0000 7ff4a4594700 -1 bdev(0x55f1ddf48000 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-07T06:01:47.588 INFO:tasks.ceph.osd.5.smithi190.stderr: -1023> 2023-12-07T06:01:47.542+0000 7ff4a4594700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7ff4a4594700 time 2023-12-07T06:01:47.499523+0000 2023-12-07T06:01:47.588 INFO:tasks.ceph.osd.5.smithi190.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-07T06:01:47.588 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.588 INFO:tasks.ceph.osd.5.smithi190.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:01:47.588 INFO:tasks.ceph.osd.5.smithi190.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55f1db617ef9] 2023-12-07T06:01:47.588 INFO:tasks.ceph.osd.5.smithi190.stderr: 2: (KernelDevice::_aio_thread()+0x18a6) [0x55f1dc28fac6] 2023-12-07T06:01:47.588 INFO:tasks.ceph.osd.5.smithi190.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f1dc297a71] 2023-12-07T06:01:47.588 INFO:tasks.ceph.osd.5.smithi190.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7ff4b68b51cf] 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 5: clone() 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: -1001> 2023-12-07T06:01:47.545+0000 7ff4a4594700 -1 *** Caught signal (Aborted) ** 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: in thread 7ff4a4594700 thread_name:bstore_aio 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7ff4b68bfce0] 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 2: gsignal() 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 3: abort() 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x55f1db617fb9] 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 5: (KernelDevice::_aio_thread()+0x18a6) [0x55f1dc28fac6] 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55f1dc297a71] 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7ff4b68b51cf] 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: 8: clone() 2023-12-07T06:01:47.589 INFO:tasks.ceph.osd.5.smithi190.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-07T06:01:47.590 INFO:tasks.ceph.osd.5.smithi190.stderr: 2023-12-07T06:01:47.907 INFO:tasks.ceph.osd.5.smithi190.stderr:daemon-helper: command failed with exit status 5 2023-12-07T06:01:52.087 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-07T06:01:58.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2023-12-07T06:02:00.218 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:02:00.221 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:02:05.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2023-12-07T06:02:11.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-12-07T06:02:18.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2023-12-07T06:02:25.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2023-12-07T06:02:30.618 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:02:30.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:02:30.690 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T06:02:30.689+0000 7fc4b5304700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127240) UID: 0 2023-12-07T06:02:30.690 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T06:02:30.689+0000 7fc7d3de3700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127240) UID: 0 2023-12-07T06:02:30.692 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T06:02:30.689+0000 7fe9ce15f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127240) UID: 0 2023-12-07T06:02:30.722 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T06:02:30.721+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695122) UID: 0 2023-12-07T06:02:30.722 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T06:02:30.721+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695122) UID: 0 2023-12-07T06:02:30.722 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T06:02:30.722+0000 7f4df7d65700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695122) UID: 0 2023-12-07T06:02:30.723 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T06:02:30.722+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695122) UID: 0 2023-12-07T06:02:31.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-12-07T06:02:38.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2023-12-07T06:02:45.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2023-12-07T06:02:51.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-12-07T06:02:58.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2023-12-07T06:03:04.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2023-12-07T06:03:07.731 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T06:03:07.730+0000 7f4dee141700 -1 bdev(0x558d6d4c0000 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-07T06:03:07.843 INFO:tasks.ceph.osd.3.smithi179.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f4dee141700 time 2023-12-07T06:03:07.841385+0000 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x558d696a0ef9] 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr: 2: (KernelDevice::_aio_thread()+0x18a6) [0x558d6a318ac6] 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x558d6a320a71] 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f4e004621cf] 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr: 5: clone() 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr:*** Caught signal (Aborted) ** 2023-12-07T06:03:07.844 INFO:tasks.ceph.osd.3.smithi179.stderr: in thread 7f4dee141700 thread_name:bstore_aio 2023-12-07T06:03:07.846 INFO:tasks.ceph.osd.3.smithi179.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:03:07.846 INFO:tasks.ceph.osd.3.smithi179.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f4e0046cce0] 2023-12-07T06:03:07.847 INFO:tasks.ceph.osd.3.smithi179.stderr: 2: gsignal() 2023-12-07T06:03:07.847 INFO:tasks.ceph.osd.3.smithi179.stderr: 3: abort() 2023-12-07T06:03:07.847 INFO:tasks.ceph.osd.3.smithi179.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x558d696a0fb9] 2023-12-07T06:03:07.847 INFO:tasks.ceph.osd.3.smithi179.stderr: 5: (KernelDevice::_aio_thread()+0x18a6) [0x558d6a318ac6] 2023-12-07T06:03:07.847 INFO:tasks.ceph.osd.3.smithi179.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x558d6a320a71] 2023-12-07T06:03:07.847 INFO:tasks.ceph.osd.3.smithi179.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f4e004621cf] 2023-12-07T06:03:07.847 INFO:tasks.ceph.osd.3.smithi179.stderr: 8: clone() 2023-12-07T06:03:07.848 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T06:03:07.843+0000 7f4dee141700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f4dee141700 time 2023-12-07T06:03:07.841385+0000 2023-12-07T06:03:07.848 INFO:tasks.ceph.osd.3.smithi179.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-07T06:03:07.848 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.848 INFO:tasks.ceph.osd.3.smithi179.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:03:07.848 INFO:tasks.ceph.osd.3.smithi179.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x558d696a0ef9] 2023-12-07T06:03:07.848 INFO:tasks.ceph.osd.3.smithi179.stderr: 2: (KernelDevice::_aio_thread()+0x18a6) [0x558d6a318ac6] 2023-12-07T06:03:07.849 INFO:tasks.ceph.osd.3.smithi179.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x558d6a320a71] 2023-12-07T06:03:07.849 INFO:tasks.ceph.osd.3.smithi179.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f4e004621cf] 2023-12-07T06:03:07.849 INFO:tasks.ceph.osd.3.smithi179.stderr: 5: clone() 2023-12-07T06:03:07.849 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr:2023-12-07T06:03:07.853+0000 7f4dee141700 -1 *** Caught signal (Aborted) ** 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: in thread 7f4dee141700 thread_name:bstore_aio 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f4e0046cce0] 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 2: gsignal() 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 3: abort() 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x558d696a0fb9] 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 5: (KernelDevice::_aio_thread()+0x18a6) [0x558d6a318ac6] 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x558d6a320a71] 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f4e004621cf] 2023-12-07T06:03:07.853 INFO:tasks.ceph.osd.3.smithi179.stderr: 8: clone() 2023-12-07T06:03:07.854 INFO:tasks.ceph.osd.3.smithi179.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-07T06:03:07.854 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: -4> 2023-12-07T06:03:07.843+0000 7f4dee141700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f4dee141700 time 2023-12-07T06:03:07.841385+0000 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x558d696a0ef9] 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: 2: (KernelDevice::_aio_thread()+0x18a6) [0x558d6a318ac6] 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x558d6a320a71] 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f4e004621cf] 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: 5: clone() 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.878 INFO:tasks.ceph.osd.3.smithi179.stderr: 0> 2023-12-07T06:03:07.853+0000 7f4dee141700 -1 *** Caught signal (Aborted) ** 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: in thread 7f4dee141700 thread_name:bstore_aio 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f4e0046cce0] 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 2: gsignal() 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 3: abort() 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x558d696a0fb9] 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 5: (KernelDevice::_aio_thread()+0x18a6) [0x558d6a318ac6] 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x558d6a320a71] 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f4e004621cf] 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 8: clone() 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-07T06:03:07.879 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr: -4> 2023-12-07T06:03:07.843+0000 7f4dee141700 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f4dee141700 time 2023-12-07T06:03:07.841385+0000 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/19.0.0-46-ga2cd52c0/rpm/el8/BUILD/ceph-19.0.0-46-ga2cd52c0/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x558d696a0ef9] 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr: 2: (KernelDevice::_aio_thread()+0x18a6) [0x558d6a318ac6] 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x558d6a320a71] 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr: 4: /lib64/libpthread.so.0(+0x81cf) [0x7f4e004621cf] 2023-12-07T06:03:07.901 INFO:tasks.ceph.osd.3.smithi179.stderr: 5: clone() 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 0> 2023-12-07T06:03:07.853+0000 7f4dee141700 -1 *** Caught signal (Aborted) ** 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: in thread 7f4dee141700 thread_name:bstore_aio 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: ceph version 19.0.0-46-ga2cd52c0 (a2cd52c00149b5caff897ea7f79d0529b62620da) reef (dev) 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 1: /lib64/libpthread.so.0(+0x12ce0) [0x7f4e0046cce0] 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 2: gsignal() 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 3: abort() 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x197) [0x558d696a0fb9] 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 5: (KernelDevice::_aio_thread()+0x18a6) [0x558d6a318ac6] 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x558d6a320a71] 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 7: /lib64/libpthread.so.0(+0x81cf) [0x7f4e004621cf] 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: 8: clone() 2023-12-07T06:03:07.902 INFO:tasks.ceph.osd.3.smithi179.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-07T06:03:07.903 INFO:tasks.ceph.osd.3.smithi179.stderr: 2023-12-07T06:03:08.150 INFO:tasks.ceph.osd.3.smithi179.stderr:daemon-helper: command failed with exit status 5 2023-12-07T06:03:11.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-07T06:03:11.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2023-12-07T06:03:17.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~7s 2023-12-07T06:03:17.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2023-12-07T06:03:24.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2023-12-07T06:03:24.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~92s 2023-12-07T06:03:30.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-12-07T06:03:30.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2023-12-07T06:03:37.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~26s 2023-12-07T06:03:37.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2023-12-07T06:03:43.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~33s 2023-12-07T06:03:43.901 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2023-12-07T06:03:50.410 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~39s 2023-12-07T06:03:50.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~118s 2023-12-07T06:03:56.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~46s 2023-12-07T06:03:56.921 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~125s 2023-12-07T06:04:03.430 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~52s 2023-12-07T06:04:03.431 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~131s 2023-12-07T06:04:09.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~59s 2023-12-07T06:04:09.940 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~138s 2023-12-07T06:04:16.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2023-12-07T06:04:16.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~144s 2023-12-07T06:04:22.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~72s 2023-12-07T06:04:22.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~151s 2023-12-07T06:04:29.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~78s 2023-12-07T06:04:29.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~157s 2023-12-07T06:04:35.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2023-12-07T06:04:35.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~164s 2023-12-07T06:04:42.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~91s 2023-12-07T06:04:42.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~171s 2023-12-07T06:04:49.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~98s 2023-12-07T06:04:49.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~177s 2023-12-07T06:04:55.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~104s 2023-12-07T06:04:55.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~184s 2023-12-07T06:05:02.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~111s 2023-12-07T06:05:02.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~190s 2023-12-07T06:05:08.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~117s 2023-12-07T06:05:08.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~197s 2023-12-07T06:05:15.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~124s 2023-12-07T06:05:15.050 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~203s 2023-12-07T06:05:16.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:05:16.054 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:05:16.098 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T06:05:16.098+0000 7ff5f6948700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695257) UID: 0 2023-12-07T06:05:16.099 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T06:05:16.098+0000 7fd2f87cb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695257) UID: 0 2023-12-07T06:05:16.099 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T06:05:16.098+0000 7f918020f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 695257) UID: 0 2023-12-07T06:05:21.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2023-12-07T06:05:21.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~210s 2023-12-07T06:05:28.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~137s 2023-12-07T06:05:28.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~216s 2023-12-07T06:05:34.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~143s 2023-12-07T06:05:34.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~223s 2023-12-07T06:05:41.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~150s 2023-12-07T06:05:41.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~229s 2023-12-07T06:05:47.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~156s 2023-12-07T06:05:47.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~236s 2023-12-07T06:05:54.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~163s 2023-12-07T06:05:54.119 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~242s 2023-12-07T06:06:00.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~169s 2023-12-07T06:06:00.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~249s 2023-12-07T06:06:07.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~176s 2023-12-07T06:06:07.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~255s 2023-12-07T06:06:13.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~182s 2023-12-07T06:06:13.658 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~262s 2023-12-07T06:06:20.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~189s 2023-12-07T06:06:20.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~268s 2023-12-07T06:06:26.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2023-12-07T06:06:26.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~275s 2023-12-07T06:06:33.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~202s 2023-12-07T06:06:33.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~281s 2023-12-07T06:06:39.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~208s 2023-12-07T06:06:39.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~288s 2023-12-07T06:06:46.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2023-12-07T06:06:46.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~294s 2023-12-07T06:06:52.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~221s 2023-12-07T06:06:52.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~301s 2023-12-07T06:06:52.729 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-07T06:06:52.729 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T06:06:52.730 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T06:06:53.387 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T06:06:53.387 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T06:06:53.445 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-07T06:06:54.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.669+0000 7f0f749bc700 1 Processor -- start 2023-12-07T06:06:54.669 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.669+0000 7f0f749bc700 1 -- start start 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.669+0000 7f0f749bc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0f70158560 0x7f0f700b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.669+0000 7f0f749bc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f700cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.669+0000 7f0f749bc700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7015b8d0 con 0x7f0f7015b010 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.669+0000 7f0f749bc700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7015bbb0 con 0x7f0f70158560 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f749bc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7015be90 con 0x7f0f700b2c70 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6e59c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0f70158560 0x7f0f700b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6ed9d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f700cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6e59c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0f70158560 0x7f0f700b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:55472/0 (socket says 172.21.15.179:55472) 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6e59c700 1 -- 172.21.15.179:0/729388825 learned_addr learned my addr 172.21.15.179:0/729388825 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T06:06:54.671 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6e59c700 1 -- 172.21.15.179:0/729388825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 msgr2=0x7f0f700cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T06:06:54.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6e59c700 1 --2- 172.21.15.179:0/729388825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f700cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.672 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6e59c700 1 -- 172.21.15.179:0/729388825 >> v1:172.21.15.190:6789/0 conn(0x7f0f7015b010 legacy=0x7f0f700b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:54.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6e59c700 1 -- 172.21.15.179:0/729388825 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f700ceec0 con 0x7f0f70158560 2023-12-07T06:06:54.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6ed9d700 1 --2- 172.21.15.179:0/729388825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f700cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T06:06:54.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.670+0000 7f0f6e59c700 1 --2- 172.21.15.179:0/729388825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f70158560 0x7f0f700b4470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f600098f0 tx=0x7f0f60009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca50588018867503 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:54.675 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f6d59a700 1 -- 172.21.15.179:0/729388825 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60011830 con 0x7f0f70158560 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f6d59a700 1 -- 172.21.15.179:0/729388825 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f60011990 con 0x7f0f70158560 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f6d59a700 1 -- 172.21.15.179:0/729388825 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f60011d20 con 0x7f0f70158560 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f749bc700 1 -- 172.21.15.179:0/729388825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f70158560 msgr2=0x7f0f700b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f749bc700 1 --2- 172.21.15.179:0/729388825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f70158560 0x7f0f700b4470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0f600098f0 tx=0x7f0f60009c00 comp rx=0 tx=0).stop 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f749bc700 1 -- 172.21.15.179:0/729388825 shutdown_connections 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f749bc700 1 --2- 172.21.15.179:0/729388825 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f700cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f749bc700 1 --2- 172.21.15.179:0/729388825 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f70158560 0x7f0f700b4470 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f749bc700 1 -- 172.21.15.179:0/729388825 >> 172.21.15.179:0/729388825 conn(0x7f0f70072970 msgr2=0x7f0f70072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f749bc700 1 -- 172.21.15.179:0/729388825 shutdown_connections 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.671+0000 7f0f749bc700 1 -- 172.21.15.179:0/729388825 wait complete. 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.672+0000 7f0f749bc700 1 Processor -- start 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.672+0000 7f0f749bc700 1 -- start start 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f749bc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f70158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f749bc700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f70158560 0x7f0f701463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:54.676 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f749bc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7015b010 0x7f0f7015c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f749bc700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c6820 con 0x7f0f70158560 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f749bc700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f701e8070 con 0x7f0f7015b010 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f749bc700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f700c6230 con 0x7f0f700b2c70 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f6dd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f70158560 0x7f0f701463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f6dd9b700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f70158560 0x7f0f701463d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:53228/0 (socket says 172.21.15.179:53228) 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f6dd9b700 1 -- 172.21.15.179:0/3357651863 learned_addr learned my addr 172.21.15.179:0/3357651863 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f6ed9d700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7015b010 0x7f0f7015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.673+0000 7f0f6e59c700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f70158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f6dd9b700 1 -- 172.21.15.179:0/3357651863 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 msgr2=0x7f0f70158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f6dd9b700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f70158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f6dd9b700 1 -- 172.21.15.179:0/3357651863 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7015b010 msgr2=0x7f0f7015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:54.677 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f6dd9b700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7015b010 0x7f0f7015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f6dd9b700 1 -- 172.21.15.179:0/3357651863 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009a70 con 0x7f0f70158560 2023-12-07T06:06:54.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f6dd9b700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f70158560 0x7f0f701463d0 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400c4d0 tx=0x7f0f6400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:54.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f5effd700 1 -- 172.21.15.179:0/3357651863 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640052d0 con 0x7f0f70158560 2023-12-07T06:06:54.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f5effd700 1 -- 172.21.15.179:0/3357651863 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f64005430 con 0x7f0f70158560 2023-12-07T06:06:54.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f60009550 con 0x7f0f70158560 2023-12-07T06:06:54.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f5effd700 1 -- 172.21.15.179:0/3357651863 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f640038f0 con 0x7f0f70158560 2023-12-07T06:06:54.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.674+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f701e8260 con 0x7f0f70158560 2023-12-07T06:06:54.678 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.675+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7004f290 con 0x7f0f70158560 2023-12-07T06:06:54.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.676+0000 7f0f5effd700 1 -- 172.21.15.179:0/3357651863 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f64003a50 con 0x7f0f70158560 2023-12-07T06:06:54.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.676+0000 7f0f5effd700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0f5006aed0 0x7f0f5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:54.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.676+0000 7f0f5effd700 1 -- 172.21.15.179:0/3357651863 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0f640889c0 con 0x7f0f70158560 2023-12-07T06:06:54.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.676+0000 7f0f6e59c700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0f5006aed0 0x7f0f5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:54.679 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.676+0000 7f0f6e59c700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0f5006aed0 0x7f0f5006d390 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009c40 tx=0x7f0f60008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:54.681 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.680+0000 7f0f5effd700 1 -- 172.21.15.179:0/3357651863 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f640539a0 con 0x7f0f70158560 2023-12-07T06:06:54.878 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.878+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f700685f0 con 0x7f0f70158560 2023-12-07T06:06:54.880 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.879+0000 7f0f5effd700 1 -- 172.21.15.179:0/3357651863 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16714 (secure 0 0 0) 0x7f0f64017090 con 0x7f0f70158560 2023-12-07T06:06:54.881 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-12-07T06:06:54.881 INFO:teuthology.orchestra.run.smithi179.stdout:{"epoch":47,"fsid":"4803447b-a0af-4501-a3c6-e46974a67250","created":"2023-12-07T00:13:48.843945+0000","modified":"2023-12-07T06:03:09.473425+0000","last_up_change":"2023-12-07T06:03:08.289855+0000","last_in_change":"2023-12-07T00:13:51.362700+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T00:14:02.562155+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-07T00:15:26.070056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 5 has some PGs where all OSDs are with primary_affinity 0 (at least pg 5.16), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-07T00:15:27.135451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 6 has some PGs where all OSDs are with primary_affinity 0 (at least pg 6.7), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"2834c04f-b470-4390-86dc-fdef4bc770b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6817","nonce":2631454879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6819","nonce":2631454879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6823","nonce":2631454879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":2631454879},{"type":"v1","addr":"172.21.15.179:6821","nonce":2631454879}]},"public_addr":"172.21.15.179:6817/2631454879","cluster_addr":"172.21.15.179:6819/2631454879","heartbeat_back_addr":"172.21.15.179:6823/2631454879","heartbeat_front_addr":"172.21.15.179:6821/2631454879","state":["exists","up"]},{"osd":1,"uuid":"e8840552-e7fa-4771-993b-0cba6b6043ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6801","nonce":3231224349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6803","nonce":3231224349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6806","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6807","nonce":3231224349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":3231224349},{"type":"v1","addr":"172.21.15.179:6805","nonce":3231224349}]},"public_addr":"172.21.15.179:6801/3231224349","cluster_addr":"172.21.15.179:6803/3231224349","heartbeat_back_addr":"172.21.15.179:6807/3231224349","heartbeat_front_addr":"172.21.15.179:6805/3231224349","state":["exists","up"]},{"osd":2,"uuid":"ca62303e-4e16-4119-a725-41a38a5402a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6809","nonce":2894829420}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6810","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6811","nonce":2894829420}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6815","nonce":2894829420}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2894829420},{"type":"v1","addr":"172.21.15.179:6813","nonce":2894829420}]},"public_addr":"172.21.15.179:6809/2894829420","cluster_addr":"172.21.15.179:6811/2894829420","heartbeat_back_addr":"172.21.15.179:6815/2894829420","heartbeat_front_addr":"172.21.15.179:6813/2894829420","state":["exists","up"]},{"osd":3,"uuid":"1cad41e6-04eb-4be7-b099-363dbb6c835a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6825","nonce":61917950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6827","nonce":61917950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6831","nonce":61917950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":61917950},{"type":"v1","addr":"172.21.15.179:6829","nonce":61917950}]},"public_addr":"172.21.15.179:6825/61917950","cluster_addr":"172.21.15.179:6827/61917950","heartbeat_back_addr":"172.21.15.179:6831/61917950","heartbeat_front_addr":"172.21.15.179:6829/61917950","state":["exists"]},{"osd":4,"uuid":"429a7f47-3ec1-4f96-a63f-859c03d5ba05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6802","nonce":933466321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6806","nonce":933466321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6814","nonce":933466321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":933466321},{"type":"v1","addr":"172.21.15.190:6810","nonce":933466321}]},"public_addr":"172.21.15.190:6802/933466321","cluster_addr":"172.21.15.190:6806/933466321","heartbeat_back_addr":"172.21.15.190:6814/933466321","heartbeat_front_addr":"172.21.15.190:6810/933466321","state":["exists","up"]},{"osd":5,"uuid":"7ac58fe4-ae1d-4a89-9d8f-ef710106f1f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6825","nonce":2894346431}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6827","nonce":2894346431}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6831","nonce":2894346431}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":2894346431},{"type":"v1","addr":"172.21.15.190:6829","nonce":2894346431}]},"public_addr":"172.21.15.190:6825/2894346431","cluster_addr":"172.21.15.190:6827/2894346431","heartbeat_back_addr":"172.21.15.190:6831/2894346431","heartbeat_front_addr":"172.21.15.190:6829/2894346431","state":["exists"]},{"osd":6,"uuid":"517aa14a-9773-4a04-8b84-d3ae1029b693","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6801","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6803","nonce":3690769319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6805","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6807","nonce":3690769319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6813","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6815","nonce":3690769319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6809","nonce":3690769319},{"type":"v1","addr":"172.21.15.190:6811","nonce":3690769319}]},"public_addr":"172.21.15.190:6803/3690769319","cluster_addr":"172.21.15.190:6807/3690769319","heartbeat_back_addr":"172.21.15.190:6815/3690769319","heartbeat_front_addr":"172.21.15.190:6811/3690769319","state":["exists","up"]},{"osd":7,"uuid":"1a4d4a4e-8b64-494c-a0ad-0ef0f8cc448e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6817","nonce":751556601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6819","nonce":751556601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6823","nonce":751556601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":751556601},{"type":"v1","addr":"172.21.15.190:6821","nonce":751556601}]},"public_addr":"172.21.15.190:6817/751556601","cluster_addr":"172.21.15.190:6819/751556601","heartbeat_back_addr":"172.21.15.190:6823/751556601","heartbeat_front_addr":"172.21.15.190:6821/751556601","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.576563+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.586020+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.629014+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.579746+0000","dead_epoch":46},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.512787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.557790+0000","dead_epoch":44},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.585808+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T00:13:56.542131+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.3d","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T06:06:54.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0f5006aed0 msgr2=0x7f0f5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:54.882 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0f5006aed0 0x7f0f5006d390 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f0f60009c40 tx=0x7f0f60008030 comp rx=0 tx=0).stop 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f70158560 msgr2=0x7f0f701463d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f70158560 0x7f0f701463d0 secure :-1 s=READY pgs=2602 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400c4d0 tx=0x7f0f6400c7e0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 shutdown_connections 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f0f5006aed0 0x7f0f5006d390 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7015b010 0x7f0f7015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700b2c70 0x7f0f70158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 --2- 172.21.15.179:0/3357651863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f0f70158560 0x7f0f701463d0 unknown :-1 s=CLOSED pgs=2602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 >> 172.21.15.179:0/3357651863 conn(0x7f0f70072970 msgr2=0x7f0f70157890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 shutdown_connections 2023-12-07T06:06:54.883 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:54.881+0000 7f0f749bc700 1 -- 172.21.15.179:0/3357651863 wait complete. 2023-12-07T06:06:54.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T00:14:02.562155+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-07T00:15:26.070056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 5 has some PGs where all OSDs are with primary_affinity 0 (at least pg 5.16), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-07T00:15:27.135451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 6 has some PGs where all OSDs are with primary_affinity 0 (at least pg 6.7), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}] 2023-12-07T06:06:54.895 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-07T06:06:55.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.023+0000 7f0881991700 1 Processor -- start 2023-12-07T06:06:55.024 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.023+0000 7f0881991700 1 -- start start 2023-12-07T06:06:55.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.024+0000 7f0881991700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f087c09a230 0x7f087c0cc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.024+0000 7f0881991700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.026 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.024+0000 7f0881991700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f087c0ccbe0 con 0x7f087c15be00 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.024+0000 7f0881991700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f087c0ccec0 con 0x7f087c09a230 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.024+0000 7f0881991700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c0cd1a0 con 0x7f087c0cdc80 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087b7fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087a7fc700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f087c09a230 0x7f087c0cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087affd700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f087c15be00 0x7f087c099b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:38582/0 (socket says 172.21.15.179:38582) 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087affd700 1 -- 172.21.15.179:0/637374428 learned_addr learned my addr 172.21.15.179:0/637374428 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f0879ffb700 1 -- 172.21.15.179:0/637374428 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341135754 0 0) 0x7f087c0ccbe0 con 0x7f087c15be00 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f0879ffb700 1 -- 172.21.15.179:0/637374428 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08640035b0 con 0x7f087c15be00 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087a7fc700 1 -- 172.21.15.179:0/637374428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 msgr2=0x7f087c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087a7fc700 1 --2- 172.21.15.179:0/637374428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c0cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087a7fc700 1 -- 172.21.15.179:0/637374428 >> v1:172.21.15.190:6789/0 conn(0x7f087c15be00 legacy=0x7f087c099b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087a7fc700 1 -- 172.21.15.179:0/637374428 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0cd480 con 0x7f087c09a230 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087b7fe700 1 --2- 172.21.15.179:0/637374428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f087a7fc700 1 --2- 172.21.15.179:0/637374428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 0x7f087c0cc570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0870009840 tx=0x7f0870009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9ce63771292154d server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f0879ffb700 1 -- 172.21.15.179:0/637374428 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870011830 con 0x7f087c09a230 2023-12-07T06:06:55.027 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f0879ffb700 1 -- 172.21.15.179:0/637374428 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870011990 con 0x7f087c09a230 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.025+0000 7f0879ffb700 1 -- 172.21.15.179:0/637374428 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870011d00 con 0x7f087c09a230 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.026+0000 7f0881991700 1 -- 172.21.15.179:0/637374428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 msgr2=0x7f087c0cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.026+0000 7f0881991700 1 --2- 172.21.15.179:0/637374428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 0x7f087c0cc570 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0870009840 tx=0x7f0870009b50 comp rx=0 tx=0).stop 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.026+0000 7f0881991700 1 -- 172.21.15.179:0/637374428 shutdown_connections 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.026+0000 7f0881991700 1 --2- 172.21.15.179:0/637374428 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.026+0000 7f0881991700 1 --2- 172.21.15.179:0/637374428 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 0x7f087c0cc570 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.026+0000 7f0881991700 1 -- 172.21.15.179:0/637374428 >> 172.21.15.179:0/637374428 conn(0x7f087c0b3550 msgr2=0x7f087c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.026+0000 7f0881991700 1 -- 172.21.15.179:0/637374428 shutdown_connections 2023-12-07T06:06:55.028 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.026+0000 7f0881991700 1 -- 172.21.15.179:0/637374428 wait complete. 2023-12-07T06:06:55.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.027+0000 7f0881991700 1 Processor -- start 2023-12-07T06:06:55.030 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.027+0000 7f0881991700 1 -- start start 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.028+0000 7f0881991700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 0x7f087c15cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.028+0000 7f0881991700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.028+0000 7f0881991700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f087c15be00 0x7f087c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.028+0000 7f0881991700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c1f1970 con 0x7f087c15be00 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.028+0000 7f0881991700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c15d1d0 con 0x7f087c09a230 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.028+0000 7f0881991700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087c15d4b0 con 0x7f087c0cdc80 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.028+0000 7f087b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f087c15be00 0x7f087c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087b7fe700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f087c15be00 0x7f087c15af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:53244/0 (socket says 172.21.15.179:53244) 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087b7fe700 1 -- 172.21.15.179:0/2442090678 learned_addr learned my addr 172.21.15.179:0/2442090678 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087affd700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 0x7f087c15cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.031 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087a7fc700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087b7fe700 1 -- 172.21.15.179:0/2442090678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 msgr2=0x7f087c15ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087b7fe700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c15ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087b7fe700 1 -- 172.21.15.179:0/2442090678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 msgr2=0x7f087c15cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087b7fe700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 0x7f087c15cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087b7fe700 1 -- 172.21.15.179:0/2442090678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0874009a70 con 0x7f087c15be00 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f087b7fe700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f087c15be00 0x7f087c15af00 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f087400efc0 tx=0x7f087400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f0863fff700 1 -- 172.21.15.179:0/2442090678 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087400ca90 con 0x7f087c15be00 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f0863fff700 1 -- 172.21.15.179:0/2442090678 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087400f040 con 0x7f087c15be00 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08700094a0 con 0x7f087c15be00 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f0863fff700 1 -- 172.21.15.179:0/2442090678 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087400ce10 con 0x7f087c15be00 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.029+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c15da70 con 0x7f087c15be00 2023-12-07T06:06:55.032 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.030+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c0685f0 con 0x7f087c15be00 2023-12-07T06:06:55.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.031+0000 7f0863fff700 1 -- 172.21.15.179:0/2442090678 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0874014480 con 0x7f087c15be00 2023-12-07T06:06:55.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.031+0000 7f0863fff700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f086806aed0 0x7f086806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.031+0000 7f0863fff700 1 -- 172.21.15.179:0/2442090678 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0874089e00 con 0x7f087c15be00 2023-12-07T06:06:55.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.031+0000 7f087affd700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f086806aed0 0x7f086806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.033 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.032+0000 7f087affd700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f086806aed0 0x7f086806d390 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f086c007fd0 tx=0x7f086c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.036 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.036+0000 7f0863fff700 1 -- 172.21.15.179:0/2442090678 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0874054cd0 con 0x7f087c15be00 2023-12-07T06:06:55.233 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.232+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f087c09a670 con 0x7f087c15be00 2023-12-07T06:06:55.233 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.233+0000 7f0863fff700 1 -- 172.21.15.179:0/2442090678 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0874009d70 con 0x7f087c15be00 2023-12-07T06:06:55.233 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 1 2023-12-07T06:06:55.235 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f086806aed0 msgr2=0x7f086806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.235 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f086806aed0 0x7f086806d390 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f086c007fd0 tx=0x7f086c009040 comp rx=0 tx=0).stop 2023-12-07T06:06:55.235 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f087c15be00 msgr2=0x7f087c15af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.235 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f087c15be00 0x7f087c15af00 secure :-1 s=READY pgs=2603 cs=0 l=1 rev1=1 crypto rx=0x7f087400efc0 tx=0x7f087400c3a0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.236 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 shutdown_connections 2023-12-07T06:06:55.236 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f086806aed0 0x7f086806d390 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.236 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f087c15be00 0x7f087c15af00 unknown :-1 s=CLOSED pgs=2603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.236 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f087c09a230 0x7f087c15cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.236 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 --2- 172.21.15.179:0/2442090678 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f087c0cdc80 0x7f087c15ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.236 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 >> 172.21.15.179:0/2442090678 conn(0x7f087c0b3550 msgr2=0x7f087c0cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:55.236 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 shutdown_connections 2023-12-07T06:06:55.236 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.235+0000 7f0881991700 1 -- 172.21.15.179:0/2442090678 wait complete. 2023-12-07T06:06:55.248 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-07T06:06:55.372 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.372+0000 7f3d1c3b4700 1 Processor -- start 2023-12-07T06:06:55.372 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.372+0000 7f3d1c3b4700 1 -- start start 2023-12-07T06:06:55.376 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.373+0000 7f3d1c3b4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d140b1860 0x7f3d140cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.373+0000 7f3d1c3b4700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d1415e740 con 0x7f3d140cd6a0 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.373+0000 7f3d1c3b4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140cf5d0 con 0x7f3d1415e360 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.373+0000 7f3d1c3b4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140cdb50 con 0x7f3d140b1860 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.373+0000 7f3d1a951700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3d140cd6a0 0x7f3d140cb740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:60154/0 (socket says 172.21.15.179:60154) 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.373+0000 7f3d1a951700 1 -- 172.21.15.179:0/2594305679 learned_addr learned my addr 172.21.15.179:0/2594305679 (peer_addr_for_me v1:172.21.15.179:0/0) 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1994f700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d140b1860 0x7f3d140cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 <== mon.0 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314194838 0 0) 0x7f3d1415e740 con 0x7f3d140cd6a0 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d000035b0 con 0x7f3d140cd6a0 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 <== mon.0 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2323951199 0 0) 0x7f3d000035b0 con 0x7f3d140cd6a0 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d140b1860 msgr2=0x7f3d140cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d140b1860 0x7f3d140cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 >> v1:172.21.15.190:6789/0 conn(0x7f3d1415e360 legacy=0x7f3d140ceec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140b3780 con 0x7f3d140cd6a0 2023-12-07T06:06:55.377 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 <== mon.0 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1016755363 0 0) 0x7f3d0c0019f0 con 0x7f3d140cd6a0 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 >> v1:172.21.15.179:6789/0 conn(0x7f3d140cd6a0 legacy=0x7f3d140cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d140b1860 0x7f3d00003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00003f70 0x7f3d00004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00004d90 0x7f3d00005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140cdb50 con 0x7f3d00004d90 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0000bb20 con 0x7f3d00003f70 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0000def0 con 0x7f3d140b1860 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1a951700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00004d90 0x7f3d00005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.378 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1a150700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d140b1860 0x7f3d00003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.379 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1994f700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00003f70 0x7f3d00004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.379 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1a951700 1 -- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d140b1860 msgr2=0x7f3d00003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T06:06:55.379 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1a951700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d140b1860 0x7f3d00003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.379 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1a951700 1 -- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00003f70 msgr2=0x7f3d00004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T06:06:55.379 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1a951700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00003f70 0x7f3d00004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.379 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.374+0000 7f3d1a951700 1 -- 172.21.15.179:0/2594305679 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000035b0 con 0x7f3d00004d90 2023-12-07T06:06:55.379 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1a951700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00004d90 0x7f3d00005210 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00a830 tx=0x7f3d00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5dc91eb10bfc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c012600 con 0x7f3d00004d90 2023-12-07T06:06:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c012780 con 0x7f3d00004d90 2023-12-07T06:06:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1914e700 1 -- 172.21.15.179:0/2594305679 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c012b30 con 0x7f3d00004d90 2023-12-07T06:06:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/2594305679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00004d90 msgr2=0x7f3d00005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1c3b4700 1 --2- 172.21.15.179:0/2594305679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d00004d90 0x7f3d00005210 secure :-1 s=READY pgs=2605 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00a830 tx=0x7f3d00005880 comp rx=0 tx=0).stop 2023-12-07T06:06:55.381 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1a951700 1 -- 172.21.15.179:0/2594305679 reap_dead start 2023-12-07T06:06:55.381 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/2594305679 shutdown_connections 2023-12-07T06:06:55.381 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/2594305679 >> 172.21.15.179:0/2594305679 conn(0x7f3d14099a40 msgr2=0x7f3d140d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:55.381 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/2594305679 shutdown_connections 2023-12-07T06:06:55.381 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.375+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/2594305679 wait complete. 2023-12-07T06:06:55.381 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.376+0000 7f3d1c3b4700 1 Processor -- start 2023-12-07T06:06:55.381 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.376+0000 7f3d1c3b4700 1 -- start start 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1c3b4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00004d90 0x7f3d140c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1c3b4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d14150380 0x7f3d14158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1c3b4700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d14158940 0x7f3d141f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1c3b4700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1415d6f0 con 0x7f3d14158940 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1c3b4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d14158dc0 con 0x7f3d00004d90 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1c3b4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140c5c90 con 0x7f3d14150380 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a951700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d14158940 0x7f3d141f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a951700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d14158940 0x7f3d141f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:53264/0 (socket says 172.21.15.179:53264) 2023-12-07T06:06:55.385 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a951700 1 -- 172.21.15.179:0/255807425 learned_addr learned my addr 172.21.15.179:0/255807425 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1994f700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d14150380 0x7f3d14158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a150700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00004d90 0x7f3d140c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a951700 1 -- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d14150380 msgr2=0x7f3d14158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a951700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d14150380 0x7f3d14158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a951700 1 -- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00004d90 msgr2=0x7f3d140c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a951700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00004d90 0x7f3d140c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a951700 1 -- 172.21.15.179:0/255807425 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d141f7db0 con 0x7f3d14158940 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.377+0000 7f3d1a150700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00004d90 0x7f3d140c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.378+0000 7f3d1a951700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d14158940 0x7f3d141f71a0 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c001cb0 tx=0x7f3d0c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.378+0000 7f3d0affd700 1 -- 172.21.15.179:0/255807425 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c012600 con 0x7f3d14158940 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.378+0000 7f3d0affd700 1 -- 172.21.15.179:0/255807425 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c022070 con 0x7f3d14158940 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.378+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d141f8090 con 0x7f3d14158940 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.378+0000 7f3d0affd700 1 -- 172.21.15.179:0/255807425 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c01e630 con 0x7f3d14158940 2023-12-07T06:06:55.386 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.378+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d140c5920 con 0x7f3d14158940 2023-12-07T06:06:55.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.379+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d140c5f70 con 0x7f3d14158940 2023-12-07T06:06:55.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.379+0000 7f3d0affd700 1 -- 172.21.15.179:0/255807425 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d0c01e790 con 0x7f3d14158940 2023-12-07T06:06:55.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.380+0000 7f3d0affd700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3cf806aed0 0x7f3cf806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.380+0000 7f3d1a150700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3cf806aed0 0x7f3cf806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.380+0000 7f3d0affd700 1 -- 172.21.15.179:0/255807425 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d0c08bfe0 con 0x7f3d14158940 2023-12-07T06:06:55.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.380+0000 7f3d1a150700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3cf806aed0 0x7f3cf806d390 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3d10007fd0 tx=0x7f3d10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.387 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.384+0000 7f3d0affd700 1 -- 172.21.15.179:0/255807425 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d0c056fc0 con 0x7f3d14158940 2023-12-07T06:06:55.581 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.580+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d140c54a0 con 0x7f3d14158940 2023-12-07T06:06:55.581 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.581+0000 7f3d0affd700 1 -- 172.21.15.179:0/255807425 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d140c54a0 con 0x7f3d14158940 2023-12-07T06:06:55.581 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 32 2023-12-07T06:06:55.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3cf806aed0 msgr2=0x7f3cf806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3cf806aed0 0x7f3cf806d390 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3d10007fd0 tx=0x7f3d10009040 comp rx=0 tx=0).stop 2023-12-07T06:06:55.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d14158940 msgr2=0x7f3d141f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d14158940 0x7f3d141f71a0 secure :-1 s=READY pgs=2606 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c001cb0 tx=0x7f3d0c001d80 comp rx=0 tx=0).stop 2023-12-07T06:06:55.584 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 shutdown_connections 2023-12-07T06:06:55.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7f3cf806aed0 0x7f3cf806d390 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3d14158940 0x7f3d141f71a0 unknown :-1 s=CLOSED pgs=2606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3d00004d90 0x7f3d140c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 --2- 172.21.15.179:0/255807425 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3d14150380 0x7f3d14158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 >> 172.21.15.179:0/255807425 conn(0x7f3d14099a40 msgr2=0x7f3d1406e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:55.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 shutdown_connections 2023-12-07T06:06:55.585 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.583+0000 7f3d1c3b4700 1 -- 172.21.15.179:0/255807425 wait complete. 2023-12-07T06:06:55.596 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-07T06:06:55.721 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.721+0000 7fe25f8bf700 1 Processor -- start 2023-12-07T06:06:55.722 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.721+0000 7fe25f8bf700 1 -- start start 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25f8bf700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe258161360 0x7fe2580cc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25f8bf700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe25806af70 0x7fe25806b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25f8bf700 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2580cb0f0 con 0x7fe258161c70 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25f8bf700 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25806b930 con 0x7fe258161360 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25f8bf700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2581627b0 con 0x7fe25806af70 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25d65b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe258161360 0x7fe2580cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25d65b700 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe258161360 0x7fe2580cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:53268/0 (socket says 172.21.15.179:53268) 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25de5c700 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fe258161c70 0x7fe2581620a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:60172/0 (socket says 172.21.15.179:60172) 2023-12-07T06:06:55.724 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25d65b700 1 -- 172.21.15.179:0/423786698 learned_addr learned my addr 172.21.15.179:0/423786698 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25d65b700 1 -- 172.21.15.179:0/423786698 >> v2:172.21.15.190:3300/0 conn(0x7fe25806af70 msgr2=0x7fe25806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25d65b700 1 --2- 172.21.15.179:0/423786698 >> v2:172.21.15.190:3300/0 conn(0x7fe25806af70 0x7fe25806b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25d65b700 1 -- 172.21.15.179:0/423786698 >> v1:172.21.15.179:6789/0 conn(0x7fe258161c70 legacy=0x7fe2581620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25d65b700 1 -- 172.21.15.179:0/423786698 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258161740 con 0x7fe258161360 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.722+0000 7fe25d65b700 1 --2- 172.21.15.179:0/423786698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580cc100 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7fe2580727c0 tx=0x7fe248009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ad69d62f4cd275 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe24ffff700 1 -- 172.21.15.179:0/423786698 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800b870 con 0x7fe258161360 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe24ffff700 1 -- 172.21.15.179:0/423786698 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24800b9d0 con 0x7fe258161360 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe24ffff700 1 -- 172.21.15.179:0/423786698 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800bd60 con 0x7fe258161360 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe25f8bf700 1 -- 172.21.15.179:0/423786698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 msgr2=0x7fe2580cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/423786698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580cc100 secure :-1 s=READY pgs=2608 cs=0 l=1 rev1=1 crypto rx=0x7fe2580727c0 tx=0x7fe248009bd0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe25f8bf700 1 -- 172.21.15.179:0/423786698 shutdown_connections 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/423786698 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580cc100 unknown :-1 s=CLOSED pgs=2608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/423786698 >> v2:172.21.15.190:3300/0 conn(0x7fe25806af70 0x7fe25806b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe25f8bf700 1 -- 172.21.15.179:0/423786698 >> 172.21.15.179:0/423786698 conn(0x7fe258099a40 msgr2=0x7fe258099e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe25f8bf700 1 -- 172.21.15.179:0/423786698 shutdown_connections 2023-12-07T06:06:55.725 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.723+0000 7fe25f8bf700 1 -- 172.21.15.179:0/423786698 wait complete. 2023-12-07T06:06:55.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.724+0000 7fe25f8bf700 1 Processor -- start 2023-12-07T06:06:55.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.724+0000 7fe25f8bf700 1 -- start start 2023-12-07T06:06:55.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25f8bf700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe25806af70 0x7fe25814eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25f8bf700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580b61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25f8bf700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe258161c70 0x7fe2581f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25f8bf700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580c8380 con 0x7fe258161360 2023-12-07T06:06:55.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25f8bf700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580ca250 con 0x7fe258161c70 2023-12-07T06:06:55.728 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25f8bf700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2580c7b70 con 0x7fe25806af70 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25ce5a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580b61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25ce5a700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580b61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:53274/0 (socket says 172.21.15.179:53274) 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25ce5a700 1 -- 172.21.15.179:0/1945157915 learned_addr learned my addr 172.21.15.179:0/1945157915 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25ce5a700 1 -- 172.21.15.179:0/1945157915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe25806af70 msgr2=0x7fe25814eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25ce5a700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe25806af70 0x7fe25814eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25ce5a700 1 -- 172.21.15.179:0/1945157915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe258161c70 msgr2=0x7fe2581f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25ce5a700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe258161c70 0x7fe2581f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.725+0000 7fe25ce5a700 1 -- 172.21.15.179:0/1945157915 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248009550 con 0x7fe258161360 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.726+0000 7fe25ce5a700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580b61f0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b4a0 tx=0x7fe25400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.726+0000 7fe24dffb700 1 -- 172.21.15.179:0/1945157915 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011830 con 0x7fe258161360 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.726+0000 7fe24dffb700 1 -- 172.21.15.179:0/1945157915 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe254011990 con 0x7fe258161360 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.726+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe258148760 con 0x7fe258161360 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.726+0000 7fe24dffb700 1 -- 172.21.15.179:0/1945157915 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe254011d40 con 0x7fe258161360 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.726+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2580c80a0 con 0x7fe258161360 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.727+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25804f380 con 0x7fe258161360 2023-12-07T06:06:55.729 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.727+0000 7fe24dffb700 1 -- 172.21.15.179:0/1945157915 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe25401a400 con 0x7fe258161360 2023-12-07T06:06:55.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.728+0000 7fe24dffb700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe23c06aed0 0x7fe23c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:55.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.728+0000 7fe24dffb700 1 -- 172.21.15.179:0/1945157915 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe254089770 con 0x7fe258161360 2023-12-07T06:06:55.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.728+0000 7fe25d65b700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe23c06aed0 0x7fe23c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:55.730 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.728+0000 7fe25d65b700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe23c06aed0 0x7fe23c06d390 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe248009c10 tx=0x7fe248010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:55.732 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.732+0000 7fe24dffb700 1 -- 172.21.15.179:0/1945157915 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2540546d0 con 0x7fe258161360 2023-12-07T06:06:55.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.933+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2580685f0 con 0x7fe258161360 2023-12-07T06:06:55.933 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.933+0000 7fe24dffb700 1 -- 172.21.15.179:0/1945157915 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe254057cf0 con 0x7fe258161360 2023-12-07T06:06:55.933 INFO:teuthology.orchestra.run.smithi179.stdout:pg_num: 64 2023-12-07T06:06:55.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe23c06aed0 msgr2=0x7fe23c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe23c06aed0 0x7fe23c06d390 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe248009c10 tx=0x7fe248010000 comp rx=0 tx=0).stop 2023-12-07T06:06:55.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 msgr2=0x7fe2580b61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:55.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580b61f0 secure :-1 s=READY pgs=2609 cs=0 l=1 rev1=1 crypto rx=0x7fe25400b4a0 tx=0x7fe25400b860 comp rx=0 tx=0).stop 2023-12-07T06:06:55.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 shutdown_connections 2023-12-07T06:06:55.936 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fe23c06aed0 0x7fe23c06d390 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe258161c70 0x7fe2581f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe25806af70 0x7fe25814eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 --2- 172.21.15.179:0/1945157915 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe258161360 0x7fe2580b61f0 unknown :-1 s=CLOSED pgs=2609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:55.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.935+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 >> 172.21.15.179:0/1945157915 conn(0x7fe258099a40 msgr2=0x7fe2580d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:55.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.936+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 shutdown_connections 2023-12-07T06:06:55.937 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:55.936+0000 7fe25f8bf700 1 -- 172.21.15.179:0/1945157915 wait complete. 2023-12-07T06:06:55.948 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-07T06:06:56.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.071+0000 7fc05a65c700 1 Processor -- start 2023-12-07T06:06:56.072 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.071+0000 7fc05a65c700 1 -- start start 2023-12-07T06:06:56.073 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.072+0000 7fc05a65c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc054158560 0x7fc0540b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.072+0000 7fc05a65c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc0540b2c70 0x7fc0540cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.072+0000 7fc05a65c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05415b8d0 con 0x7fc05415b010 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.072+0000 7fc05a65c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05415bbb0 con 0x7fc0540b2c70 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.072+0000 7fc05a65c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05415be90 con 0x7fc054158560 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc058bf9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc0540b2c70 0x7fc0540cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc053fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc054158560 0x7fc0540b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc058bf9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc0540b2c70 0x7fc0540cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.179:55536/0 (socket says 172.21.15.179:55536) 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc058bf9700 1 -- 172.21.15.179:0/2965459945 learned_addr learned my addr 172.21.15.179:0/2965459945 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc0537fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc05415b010 0x7fc0540b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.179:38630/0 (socket says 172.21.15.179:38630) 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc058bf9700 1 -- 172.21.15.179:0/2965459945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc054158560 msgr2=0x7fc0540b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc058bf9700 1 --2- 172.21.15.179:0/2965459945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc054158560 0x7fc0540b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc058bf9700 1 -- 172.21.15.179:0/2965459945 >> v1:172.21.15.190:6789/0 conn(0x7fc05415b010 legacy=0x7fc0540b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:56.074 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc058bf9700 1 -- 172.21.15.179:0/2965459945 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0540ceec0 con 0x7fc0540b2c70 2023-12-07T06:06:56.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc058bf9700 1 --2- 172.21.15.179:0/2965459945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0540b2c70 0x7fc0540cf3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009e50 tx=0x7fc04c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c4a04940dbd6d73 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:56.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc052ffd700 1 -- 172.21.15.179:0/2965459945 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00e070 con 0x7fc0540b2c70 2023-12-07T06:06:56.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc052ffd700 1 -- 172.21.15.179:0/2965459945 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00b910 con 0x7fc0540b2c70 2023-12-07T06:06:56.075 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.073+0000 7fc052ffd700 1 -- 172.21.15.179:0/2965459945 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c00bcc0 con 0x7fc0540b2c70 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.074+0000 7fc05a65c700 1 -- 172.21.15.179:0/2965459945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0540b2c70 msgr2=0x7fc0540cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.074+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2965459945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0540b2c70 0x7fc0540cf3e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009e50 tx=0x7fc04c00b330 comp rx=0 tx=0).stop 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.074+0000 7fc05a65c700 1 -- 172.21.15.179:0/2965459945 shutdown_connections 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.074+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2965459945 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc0540b2c70 0x7fc0540cf3e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.074+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2965459945 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc054158560 0x7fc0540b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.074+0000 7fc05a65c700 1 -- 172.21.15.179:0/2965459945 >> 172.21.15.179:0/2965459945 conn(0x7fc054072970 msgr2=0x7fc054072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.074+0000 7fc05a65c700 1 -- 172.21.15.179:0/2965459945 shutdown_connections 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.074+0000 7fc05a65c700 1 -- 172.21.15.179:0/2965459945 wait complete. 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.075+0000 7fc05a65c700 1 Processor -- start 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.075+0000 7fc05a65c700 1 -- start start 2023-12-07T06:06:56.078 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc05a65c700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0540b2c70 0x7fc0541e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc05a65c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc054158560 0x7fc054154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc05a65c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc05415b010 0x7fc0540b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc05a65c700 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541f7b70 con 0x7fc0540b2c70 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc05a65c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541f6f30 con 0x7fc054158560 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc05a65c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541f71d0 con 0x7fc05415b010 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0540b2c70 0x7fc0541e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0540b2c70 0x7fc0541e5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:53286/0 (socket says 172.21.15.179:53286) 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 -- 172.21.15.179:0/2000111611 learned_addr learned my addr 172.21.15.179:0/2000111611 (peer_addr_for_me v2:172.21.15.179:0/0) 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc0537fe700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc054158560 0x7fc054154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc058bf9700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc05415b010 0x7fc0540b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 -- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc05415b010 msgr2=0x7fc0540b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc05415b010 0x7fc0540b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 -- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc054158560 msgr2=0x7fc054154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:56.079 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc054158560 0x7fc054154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 -- 172.21.15.179:0/2000111611 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c009b30 con 0x7fc0540b2c70 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc0537fe700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc054158560 0x7fc054154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc053fff700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0540b2c70 0x7fc0541e5e70 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e9b0 tx=0x7fc04400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.076+0000 7fc050ff9700 1 -- 172.21.15.179:0/2000111611 <== mon.0 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc044009710 con 0x7fc0540b2c70 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.077+0000 7fc050ff9700 1 -- 172.21.15.179:0/2000111611 <== mon.0 v2:172.21.15.179:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04400ee50 con 0x7fc0540b2c70 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.077+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0541f74b0 con 0x7fc0540b2c70 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.077+0000 7fc050ff9700 1 -- 172.21.15.179:0/2000111611 <== mon.0 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04400ca50 con 0x7fc0540b2c70 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.077+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0541e63b0 con 0x7fc0540b2c70 2023-12-07T06:06:56.080 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.077+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05404f290 con 0x7fc0540b2c70 2023-12-07T06:06:56.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.078+0000 7fc050ff9700 1 -- 172.21.15.179:0/2000111611 <== mon.0 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc04400cbb0 con 0x7fc0540b2c70 2023-12-07T06:06:56.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.078+0000 7fc050ff9700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc04006aed0 0x7fc04006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-07T06:06:56.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.078+0000 7fc050ff9700 1 -- 172.21.15.179:0/2000111611 <== mon.0 v2:172.21.15.179:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc044089660 con 0x7fc0540b2c70 2023-12-07T06:06:56.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.078+0000 7fc0537fe700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc04006aed0 0x7fc04006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-07T06:06:56.081 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.079+0000 7fc0537fe700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc04006aed0 0x7fc04006d390 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc0541e5280 tx=0x7fc048007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-07T06:06:56.083 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.083+0000 7fc050ff9700 1 -- 172.21.15.179:0/2000111611 <== mon.0 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc044054640 con 0x7fc0540b2c70 2023-12-07T06:06:56.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.294+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc0541f7cb0 con 0x7fc0540b2c70 2023-12-07T06:06:56.295 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.295+0000 7fc050ff9700 1 -- 172.21.15.179:0/2000111611 <== mon.0 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc0541f7cb0 con 0x7fc0540b2c70 2023-12-07T06:06:56.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc04006aed0 msgr2=0x7fc04006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:56.297 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc04006aed0 0x7fc04006d390 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc0541e5280 tx=0x7fc048007ec0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0540b2c70 msgr2=0x7fc0541e5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0540b2c70 0x7fc0541e5e70 secure :-1 s=READY pgs=2610 cs=0 l=1 rev1=1 crypto rx=0x7fc04400e9b0 tx=0x7fc04400ecc0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 shutdown_connections 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:6832/1592863421,v1:172.21.15.179:6833/1592863421] conn(0x7fc04006aed0 0x7fc04006d390 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc05415b010 0x7fc0540b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc0540b2c70 0x7fc0541e5e70 unknown :-1 s=CLOSED pgs=2610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 --2- 172.21.15.179:0/2000111611 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc054158560 0x7fc054154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 >> 172.21.15.179:0/2000111611 conn(0x7fc054072970 msgr2=0x7fc054157470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 shutdown_connections 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:2023-12-07T06:06:56.297+0000 7fc05a65c700 1 -- 172.21.15.179:0/2000111611 wait complete. 2023-12-07T06:06:56.298 INFO:teuthology.orchestra.run.smithi179.stderr:listed 0 entries 2023-12-07T06:06:56.310 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-07T06:06:56.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T06:06:56.310 DEBUG:teuthology.orchestra.run.smithi179:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-07T06:06:56.379 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T06:06:56.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T06:06:56.380 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-07T06:06:56.418 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2023-12-07T06:06:56.418 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T06:06:56.475 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284224k,nr_inodes=4071056,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=37,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18687 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260544k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 172.21.15.179:6789:/test /tmp/tmp.YGf8tKAzkhtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=4803447b-a0af-4501-a3c6-e46974a67250,acl 0 0 172.21.15.179:6789:/scratch /tmp/tmp.0W7YXWNQIHscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=4803447b-a0af-4501-a3c6-e46974a67250,acl 0 0 2023-12-07T06:06:56.476 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi179.front.sepia.ceph.com 2023-12-07T06:06:56.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T06:06:56.476 DEBUG:teuthology.orchestra.run.smithi179:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-07T06:06:56.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T06:06:56.531 INFO:teuthology.orchestra.run.smithi179.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-07T06:06:56.531 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T06:06:56.531 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T06:06:56.561 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16917 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-12-07T06:06:56.561 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T06:06:56.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T06:06:56.561 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-07T06:06:56.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T06:06:56.625 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-07T06:06:56.625 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-12-07T06:06:56.625 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-07T06:06:56.684 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16917 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-12-07T06:06:56.685 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi190.front.sepia.ceph.com 2023-12-07T06:06:56.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-07T06:06:56.685 DEBUG:teuthology.orchestra.run.smithi190:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-07T06:06:56.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T06:06:56.743 INFO:teuthology.orchestra.run.smithi190.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-07T06:06:58.253 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-07T06:06:58.253 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-07T06:06:58.254 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-07T06:06:58.254 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-07T06:06:58.254 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-07T06:06:58.254 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-07T06:06:58.254 INFO:tasks.ceph.mds.a:Sent signal 15 2023-12-07T06:06:58.255 INFO:tasks.ceph.mds.c:Sent signal 15 2023-12-07T06:06:58.255 INFO:tasks.ceph.mds.b:Sent signal 15 2023-12-07T06:06:58.255 INFO:tasks.ceph.mds.d:Sent signal 15 2023-12-07T06:06:58.255 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-07T06:06:58.256 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-07T06:06:58.256 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-07T06:06:58.256 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-07T06:06:58.256 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-07T06:06:58.257 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fe9ce15f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 103790) UID: 0 2023-12-07T06:06:58.257 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fe9ce15f700 -1 osd.4 47 *** Got signal Terminated *** 2023-12-07T06:06:58.257 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fe9ce15f700 -1 osd.4 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T06:06:58.258 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fc4b5304700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 103797) UID: 0 2023-12-07T06:06:58.258 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fc4b5304700 -1 osd.6 47 *** Got signal Terminated *** 2023-12-07T06:06:58.258 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fc4b5304700 -1 osd.6 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T06:06:58.258 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fc7d3de3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 103796) UID: 0 2023-12-07T06:06:58.258 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fc7d3de3700 -1 osd.7 47 *** Got signal Terminated *** 2023-12-07T06:06:58.258 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-12-07T06:06:58.254+0000 7fc7d3de3700 -1 osd.7 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T06:06:58.259 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T06:06:58.253+0000 7f918020f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 103578) UID: 0 2023-12-07T06:06:58.259 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T06:06:58.253+0000 7f918020f700 -1 osd.0 47 *** Got signal Terminated *** 2023-12-07T06:06:58.259 INFO:tasks.ceph.osd.0.smithi179.stderr:2023-12-07T06:06:58.253+0000 7f918020f700 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T06:06:58.259 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T06:06:58.254+0000 7ff5f6948700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 103582) UID: 0 2023-12-07T06:06:58.259 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T06:06:58.254+0000 7ff5f6948700 -1 osd.1 47 *** Got signal Terminated *** 2023-12-07T06:06:58.259 INFO:tasks.ceph.osd.1.smithi179.stderr:2023-12-07T06:06:58.254+0000 7ff5f6948700 -1 osd.1 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T06:06:58.260 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T06:06:58.254+0000 7fd2f87cb700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 103586) UID: 0 2023-12-07T06:06:58.260 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T06:06:58.254+0000 7fd2f87cb700 -1 osd.2 47 *** Got signal Terminated *** 2023-12-07T06:06:58.260 INFO:tasks.ceph.osd.2.smithi179.stderr:2023-12-07T06:06:58.254+0000 7fd2f87cb700 -1 osd.2 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T06:06:58.260 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T06:06:58.255+0000 7f6899d25700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 119346) UID: 0 2023-12-07T06:06:58.260 INFO:tasks.ceph.mds.a.smithi179.stderr:2023-12-07T06:06:58.255+0000 7f6899d25700 -1 mds.a *** got signal Terminated *** 2023-12-07T06:06:58.260 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T06:06:58.255+0000 7fe3fc6fb700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 119345) UID: 0 2023-12-07T06:06:58.261 INFO:tasks.ceph.mds.c.smithi179.stderr:2023-12-07T06:06:58.255+0000 7fe3fc6fb700 -1 mds.c *** got signal Terminated *** 2023-12-07T06:06:58.261 INFO:tasks.ceph.mon.a.smithi179.stderr:2023-12-07T06:06:58.256+0000 7f26162e6700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 103249) UID: 0 2023-12-07T06:06:58.261 INFO:tasks.ceph.mon.a.smithi179.stderr:2023-12-07T06:06:58.256+0000 7f26162e6700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-07T06:06:58.261 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T06:06:58.256+0000 7f8a63bf8700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 103291) UID: 0 2023-12-07T06:06:58.261 INFO:tasks.ceph.mgr.y.smithi179.stderr:2023-12-07T06:06:58.256+0000 7f8a63bf8700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-07T06:06:58.295 INFO:tasks.ceph.mds.b.smithi190.stderr:2023-12-07T06:06:58.273+0000 7f3e18c4f700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 111332) UID: 0 2023-12-07T06:06:58.296 INFO:tasks.ceph.mon.c.smithi190.stderr:2023-12-07T06:06:58.295+0000 7f4b066ab700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 103140) UID: 0 2023-12-07T06:06:58.296 INFO:tasks.ceph.mon.c.smithi190.stderr:2023-12-07T06:06:58.295+0000 7f4b066ab700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-07T06:06:58.297 INFO:tasks.ceph.mon.b.smithi190.stderr:2023-12-07T06:06:58.295+0000 7fcfdd4fa700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 103139) UID: 0 2023-12-07T06:06:58.297 INFO:tasks.ceph.mon.b.smithi190.stderr:2023-12-07T06:06:58.295+0000 7fcfdd4fa700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-07T06:06:58.297 INFO:tasks.ceph.mds.d.smithi190.stderr:2023-12-07T06:06:58.295+0000 7f90ab554700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 111331) UID: 0 2023-12-07T06:06:58.297 INFO:tasks.ceph.mds.b.smithi190.stderr:2023-12-07T06:06:58.295+0000 7f3e18c4f700 -1 mds.b *** got signal Terminated *** 2023-12-07T06:06:58.298 INFO:tasks.ceph.mds.d.smithi190.stderr:2023-12-07T06:06:58.295+0000 7f90ab554700 -1 mds.d *** got signal Terminated *** 2023-12-07T06:06:58.343 INFO:tasks.ceph.mon.a.smithi179.stderr:2023-12-07T06:06:58.343+0000 7f2610adb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-07T06:06:58.496 INFO:tasks.ceph.mgr.x.smithi190.stderr:daemon-helper: command crashed with signal 15 2023-12-07T06:07:46.545 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:07:46.549 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:08:16.700 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:08:16.704 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:08:46.764 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:08:46.767 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:09:16.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:09:16.922 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:09:47.056 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:09:47.060 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:10:17.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:10:17.223 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:10:47.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:10:47.355 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:11:17.472 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:11:17.475 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:11:47.547 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:11:47.550 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:12:17.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:12:17.691 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:12:47.746 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:12:47.750 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:13:17.910 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:13:17.913 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:13:48.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:13:48.052 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:14:18.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:14:18.190 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:14:48.331 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:14:48.335 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:15:18.470 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:15:18.474 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:15:48.670 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:15:48.673 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:16:18.819 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:16:18.822 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:16:48.956 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:16:48.960 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:17:19.127 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:17:19.130 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:17:49.273 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:17:49.283 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:18:19.435 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:18:19.442 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:18:49.572 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:18:49.576 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:19:19.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:19:19.700 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:19:49.856 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:19:49.860 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:20:20.007 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:20:20.011 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:20:50.139 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:20:50.142 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:21:20.286 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:21:20.290 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:21:50.415 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:21:50.419 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:22:20.562 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:22:20.565 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:22:50.715 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:22:50.719 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:23:20.870 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:23:20.873 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:23:51.024 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:23:51.027 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:24:21.158 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:24:21.161 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:24:51.309 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:24:51.313 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:25:21.453 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:25:21.456 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:25:51.615 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:25:51.619 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:26:21.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:26:21.759 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:26:51.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:26:51.929 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:27:22.061 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:27:22.065 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:27:52.203 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:27:52.206 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:28:22.336 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:28:22.340 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:28:52.471 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:28:52.531 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:29:22.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:29:22.678 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:29:52.815 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:29:52.819 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:30:22.953 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:30:22.956 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:30:53.074 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:30:53.078 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:31:23.203 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:31:23.206 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:31:53.332 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:31:53.336 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:32:23.486 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:32:23.489 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:32:53.633 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:32:53.636 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:33:23.768 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:33:23.771 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:33:53.917 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:33:53.920 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:34:24.061 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:34:24.065 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:34:54.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:34:54.196 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:35:24.304 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:35:24.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:35:54.449 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:35:54.453 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:36:24.587 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:36:24.591 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:36:54.724 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:36:54.727 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:37:24.853 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:37:24.857 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:37:55.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:37:55.020 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:38:25.163 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:38:25.166 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:38:55.316 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:38:55.319 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:39:25.454 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:39:25.458 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:39:55.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:39:55.596 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:40:25.729 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:40:25.733 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:40:55.875 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:40:55.878 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:41:26.004 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:41:26.007 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:41:56.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:41:56.161 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:42:26.312 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:42:26.316 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:42:56.526 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:42:56.530 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:43:26.704 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:43:26.708 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:43:56.842 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:43:56.846 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:44:27.001 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:44:27.005 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:44:57.139 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:44:57.142 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:45:27.271 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:45:27.274 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:45:57.392 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:45:57.395 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:46:27.671 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:46:27.675 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:46:57.818 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:46:57.821 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:47:27.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:47:27.993 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:47:58.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:47:58.129 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:48:28.288 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:48:28.291 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:48:58.426 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:48:58.429 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:49:28.570 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:49:28.574 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:49:58.712 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:49:58.715 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:50:28.846 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:50:28.849 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:50:58.986 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:50:58.990 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:51:29.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:51:29.134 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:51:59.318 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:51:59.321 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:52:29.456 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:52:29.459 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:52:59.602 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:52:59.606 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:53:29.764 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:53:29.767 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:53:59.899 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:53:59.902 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:54:30.064 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:54:30.068 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:55:00.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:55:00.221 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:55:30.598 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:55:30.602 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:56:00.735 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:56:00.739 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:56:30.880 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:56:30.884 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:57:01.018 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:57:01.022 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:57:31.164 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:57:31.167 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:58:01.277 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:58:01.280 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:58:31.440 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:58:31.443 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:59:01.626 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:59:01.630 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:59:31.807 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T06:59:31.810 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:00:01.952 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:00:01.955 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:00:32.007 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:00:32.011 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:01:02.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:01:02.160 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:01:32.327 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:01:32.331 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:02:02.402 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:02:02.406 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:02:32.536 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:02:32.540 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:03:02.600 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:03:02.603 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:03:32.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:03:32.742 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:04:02.877 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:04:02.880 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:04:33.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:04:33.036 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:05:03.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:05:03.190 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:05:33.326 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:05:33.329 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:06:03.469 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:06:03.473 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:06:33.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:06:33.615 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:07:03.770 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:07:03.773 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:07:33.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:07:33.928 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:08:04.068 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:08:04.072 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:08:34.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:08:34.236 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:09:04.371 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:09:04.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:09:34.550 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:09:34.553 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:10:04.687 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:10:04.691 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:10:34.833 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:10:34.837 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:11:04.975 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:11:04.979 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:11:35.109 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:11:35.112 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:12:05.222 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:12:05.225 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:12:35.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:12:35.345 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:13:05.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:13:05.492 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:13:35.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:13:35.637 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:14:05.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:14:05.835 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:14:35.983 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:14:35.987 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:15:06.121 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:15:06.125 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:15:36.266 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:15:36.269 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:16:06.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:16:06.409 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:16:36.565 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:16:36.569 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:17:06.722 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:17:06.726 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:17:36.868 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:17:36.871 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:18:07.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:18:07.005 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:18:37.076 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:18:37.079 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:19:07.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:19:07.220 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:19:37.343 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:19:37.347 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:20:07.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:20:07.492 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:20:37.627 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:20:37.630 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:21:07.773 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:21:07.776 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:21:37.926 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:21:37.930 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:22:08.072 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:22:08.075 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:22:38.226 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:22:38.230 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:23:08.380 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:23:08.383 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:23:38.532 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:23:38.535 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:24:08.657 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:24:08.660 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:24:38.802 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:24:38.805 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:25:08.931 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:25:09.029 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:25:39.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:25:39.173 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:26:09.298 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:26:09.301 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:26:39.452 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:26:39.456 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:27:09.602 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:27:09.605 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:27:39.704 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:27:39.707 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:28:09.848 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:28:09.851 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:28:39.995 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:28:39.998 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:29:10.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:29:10.126 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:29:40.277 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:29:40.281 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:30:10.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:30:10.410 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:30:40.553 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:30:40.557 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:31:10.674 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:31:10.677 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:31:40.803 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:31:40.807 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:32:10.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:32:10.954 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:32:41.095 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:32:41.101 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:33:11.240 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:33:11.244 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:33:41.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:33:41.409 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:34:11.570 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:34:11.573 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:34:41.712 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:34:41.715 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:35:11.858 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:35:11.862 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:35:42.013 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:35:42.016 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:36:12.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:36:12.155 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:36:42.287 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:36:42.291 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:37:12.447 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:37:12.450 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:37:42.583 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:37:42.586 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:38:12.725 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:38:12.729 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:38:42.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:38:42.807 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:39:12.907 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:39:12.910 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:39:43.037 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:39:43.042 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:40:13.100 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:40:13.104 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:40:43.174 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:40:43.177 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:41:13.311 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:41:13.314 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:41:43.424 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:41:43.427 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:42:13.546 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:42:13.551 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:42:43.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:42:43.705 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:43:13.834 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:43:13.838 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:43:43.980 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:43:43.984 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:44:14.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:44:14.155 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:44:44.288 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:44:44.291 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:45:14.426 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:45:14.430 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:45:44.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:45:44.611 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:46:14.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:46:14.741 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:46:44.872 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:46:44.876 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:47:15.026 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:47:15.029 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:47:45.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:47:45.190 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:48:15.318 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:48:15.321 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:48:45.473 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:48:45.477 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:49:15.617 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:49:15.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:49:45.788 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:49:45.792 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:50:15.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:50:15.922 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:50:46.039 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:50:46.042 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:51:16.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:51:16.180 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:51:46.314 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:51:46.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:52:16.451 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:52:16.455 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:52:46.639 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:52:46.642 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:53:16.776 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:53:16.780 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:53:46.922 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:53:46.926 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:54:17.113 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:54:17.117 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:54:47.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:54:47.245 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:55:17.394 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:55:17.398 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:55:47.529 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:55:47.532 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:56:17.668 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:56:17.672 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:56:47.806 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:56:47.810 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:57:17.945 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:57:17.949 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:57:48.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:57:48.203 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:58:18.254 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:58:18.258 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:58:48.410 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:58:48.414 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:59:18.524 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:59:18.527 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:59:48.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T07:59:48.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:00:18.694 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:00:18.697 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:00:48.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:00:48.761 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:01:18.912 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:01:18.916 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:01:49.057 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:01:49.060 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:02:19.204 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:02:19.207 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:02:49.332 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:02:49.339 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:03:19.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:03:19.508 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:03:49.655 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:03:49.659 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:04:19.810 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:04:19.813 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:04:49.949 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:04:49.953 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:05:20.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:05:20.132 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:05:50.267 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:05:50.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:06:20.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:06:20.410 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:06:50.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:06:50.537 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:07:20.662 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:07:20.665 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:07:50.799 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:07:50.803 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:08:20.937 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:08:20.940 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:08:51.066 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:08:51.069 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:09:21.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:09:21.209 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:09:51.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:09:51.345 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:10:21.471 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:10:21.474 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:10:51.617 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:10:51.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:11:21.767 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:11:21.770 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:11:51.933 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:11:51.937 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:12:22.095 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:12:22.099 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:12:52.249 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:12:52.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:13:22.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:13:22.409 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:13:52.569 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:13:52.572 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:14:22.815 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:14:22.819 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:14:52.967 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:14:52.970 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:15:23.114 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:15:23.117 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:15:53.239 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:15:53.244 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:16:23.369 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:16:23.373 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:16:53.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:16:53.513 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:17:23.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:17:23.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:17:53.760 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:17:53.764 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:18:23.899 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:18:23.903 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:18:54.054 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:18:54.057 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:19:24.193 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:19:24.196 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:19:54.331 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:19:54.335 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:20:24.395 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:20:24.399 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:20:54.522 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:20:54.525 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:21:24.680 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:21:24.684 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:21:54.835 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:21:54.862 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:22:24.973 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:22:24.976 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:22:55.085 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:22:55.088 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:23:25.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:23:25.218 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:23:55.398 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:23:55.402 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:24:25.532 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:24:25.535 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:24:55.677 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:24:55.680 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:25:25.826 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:25:25.831 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:25:55.960 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:25:55.963 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:26:26.099 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:26:26.105 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:26:56.273 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:26:56.276 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:27:26.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:27:26.421 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:27:56.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:27:56.559 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:28:26.699 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:28:26.702 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:28:56.992 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:28:56.995 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:29:27.123 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:29:27.150 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:29:57.334 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:29:57.337 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:30:27.456 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:30:27.460 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:30:57.594 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:30:57.598 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:31:27.782 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:31:27.785 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:31:57.920 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:31:57.924 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:32:28.076 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:32:28.082 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:32:58.219 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:32:58.223 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:33:28.282 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:33:28.295 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:33:58.461 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:33:58.464 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:34:28.647 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:34:28.656 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:34:58.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:34:58.815 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:35:28.949 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:35:28.953 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:35:59.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:35:59.108 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:36:29.267 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:36:29.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:36:59.420 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:36:59.424 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:37:29.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:37:29.570 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:37:59.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:37:59.725 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:38:29.873 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:38:29.876 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:39:00.037 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:39:00.041 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:39:30.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:39:32.581 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:40:02.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:40:02.708 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:40:33.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:40:33.040 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:41:03.162 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:41:03.165 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:41:33.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:41:33.311 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:42:03.455 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:42:03.458 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:42:33.617 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:42:33.626 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:43:03.772 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:43:03.776 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:43:33.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:43:33.914 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:44:04.096 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:44:04.099 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:44:34.217 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:44:34.221 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:45:04.354 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:45:04.357 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:45:34.492 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:45:34.495 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:46:04.641 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:46:04.645 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:46:34.800 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:46:34.804 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:47:04.929 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:47:04.932 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:47:35.068 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:47:35.073 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:48:05.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:48:05.217 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:48:35.367 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:48:35.371 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:49:05.538 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:49:05.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:49:35.692 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:49:35.697 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:50:05.810 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:50:05.814 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:50:35.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:50:35.980 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:51:06.114 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:51:06.118 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:51:36.243 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:51:36.248 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:52:06.389 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:52:06.393 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:52:36.528 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:52:36.532 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:53:06.671 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:53:06.675 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:53:36.839 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:53:36.843 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:54:06.964 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:54:06.968 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:54:37.110 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:54:37.113 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:55:07.247 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:55:07.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:55:37.393 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:55:37.396 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:56:07.540 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:56:07.544 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:56:37.686 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:56:37.689 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:57:07.841 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:57:07.845 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:57:37.979 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:57:37.982 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:58:08.145 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:58:08.148 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:58:38.278 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:58:38.282 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:59:08.446 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:59:08.450 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:59:38.585 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T08:59:38.589 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:00:08.709 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:00:08.712 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:00:38.846 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:00:38.850 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:01:08.926 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:01:08.930 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:01:39.163 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:01:39.167 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:02:09.303 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:02:09.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:02:39.450 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:02:39.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:03:09.605 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:03:09.609 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:03:39.750 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:03:39.754 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:04:09.932 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:04:09.934 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:04:40.086 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:04:40.090 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:05:10.227 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:05:10.230 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:05:40.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:05:40.368 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:06:10.517 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:06:10.521 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:06:40.656 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:06:40.659 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:07:10.794 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:07:10.797 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:07:40.939 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:07:40.945 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:08:11.085 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:08:11.089 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:08:41.214 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:08:41.218 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:09:11.360 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:09:11.363 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:09:41.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:09:41.510 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:10:11.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:10:11.638 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:10:41.776 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:10:41.779 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:11:11.839 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:11:11.843 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:11:41.982 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:11:41.985 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:12:12.102 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:12:12.106 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:12:42.248 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:12:42.251 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:13:12.394 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:13:12.402 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:13:42.541 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:13:42.545 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:14:12.694 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:14:12.697 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:14:42.824 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:14:42.827 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:15:12.936 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:15:12.939 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:15:43.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:15:43.069 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:16:13.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:16:13.214 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:16:43.365 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:16:43.369 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:17:13.520 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:17:13.523 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:17:43.666 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:17:43.669 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:18:13.805 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:18:13.808 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:18:43.957 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:18:43.960 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:19:14.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:19:14.124 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:19:44.268 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:19:44.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:20:14.404 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:20:14.408 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:20:44.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:20:44.566 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:21:14.696 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:21:14.699 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:21:44.842 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:21:45.127 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:22:15.254 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:22:15.258 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:22:45.416 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:22:45.449 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:23:15.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:23:15.592 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:23:45.766 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:23:45.769 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:24:15.925 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:24:15.929 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:24:46.073 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:24:46.076 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:25:16.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:25:16.234 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:25:46.383 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:25:46.387 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:26:16.554 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:26:16.557 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:26:46.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:26:46.705 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:27:16.858 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:27:16.862 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:27:47.013 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:27:47.016 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:28:17.160 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:28:17.164 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:28:47.334 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:28:47.338 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:29:17.496 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:29:17.499 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:29:47.658 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:29:47.662 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:30:17.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:30:17.824 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:30:47.984 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:30:47.988 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:31:18.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:31:18.160 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:31:48.306 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:31:48.310 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:32:18.447 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:32:18.451 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:32:48.594 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:32:48.598 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:33:18.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:33:18.758 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:33:48.896 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:33:48.899 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:34:19.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:34:19.053 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:34:49.170 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:34:49.174 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:35:19.316 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:35:19.320 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:35:49.638 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:35:49.641 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:36:19.800 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:36:19.803 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:36:49.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:36:49.924 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:37:20.058 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:37:20.063 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:37:50.204 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:37:50.208 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:38:20.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:38:20.353 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:38:50.504 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:38:50.514 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:39:20.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:39:20.671 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:39:50.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:39:50.807 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:40:20.933 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:40:20.937 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:40:51.088 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:40:51.092 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:41:21.216 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:41:21.220 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:41:51.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:41:51.361 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:42:21.494 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:42:21.497 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:42:51.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:42:51.633 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:43:21.767 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:43:21.771 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:43:51.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:43:51.924 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:44:22.076 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:44:22.085 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:44:52.221 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:44:52.225 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:45:22.359 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:45:22.362 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:45:52.504 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:45:52.508 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:46:22.651 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:46:22.655 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:46:52.796 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:46:52.800 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:47:22.859 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:47:22.862 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:47:52.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:47:52.925 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:48:22.984 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:48:22.988 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:48:53.047 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:48:53.050 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:49:23.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:49:23.130 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:49:53.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:49:53.203 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:50:23.269 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:50:23.272 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:50:53.330 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:50:53.417 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:51:23.568 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:51:23.571 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:51:53.722 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:51:53.725 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:52:23.877 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:52:23.881 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:52:54.023 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:52:54.026 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:53:24.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:53:24.172 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:53:54.289 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:53:54.293 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:54:24.579 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:54:24.582 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:54:54.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:54:54.746 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:55:24.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:55:24.893 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:55:55.031 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:55:55.034 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:56:25.168 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:56:25.172 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:56:55.306 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:56:55.310 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:57:25.452 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:57:25.455 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:57:55.606 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:57:55.610 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:58:25.760 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:58:25.764 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:58:55.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:58:55.894 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:59:26.052 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:59:26.055 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:59:56.173 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T09:59:56.177 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:00:26.320 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:00:26.324 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:00:56.457 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:00:56.460 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:01:26.578 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:01:26.582 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:01:56.757 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:01:56.761 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:02:26.911 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:02:26.915 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:02:57.054 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:02:57.058 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:27.195 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:27.198 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:57.360 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:03:57.363 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:04:27.545 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:04:27.548 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:04:57.691 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:04:57.695 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:05:27.828 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:05:27.832 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:05:57.978 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:05:57.982 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:06:28.111 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:06:28.115 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:06:58.258 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:06:58.262 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:07:28.396 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:07:28.399 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:07:58.533 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:07:58.537 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:08:28.706 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:08:28.709 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:08:58.851 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:08:58.854 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:09:29.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:09:29.033 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:09:59.159 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:09:59.163 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:10:29.304 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:10:29.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:10:59.426 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:10:59.429 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:11:29.570 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:11:29.573 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:11:59.734 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:11:59.739 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:12:29.872 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:12:29.876 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:13:00.000 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:13:00.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:13:30.063 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:13:30.066 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:14:00.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:14:00.128 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:14:30.297 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:14:30.301 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:15:00.434 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:15:00.437 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:15:30.571 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:15:30.575 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:16:00.726 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:16:00.729 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:16:30.869 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:16:30.872 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:17:01.026 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:17:01.029 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:17:31.154 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:17:31.157 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:18:01.315 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:18:01.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:18:31.508 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:18:31.512 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:19:01.650 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:19:01.654 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:19:31.823 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:19:31.826 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:20:01.959 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:20:01.962 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:20:32.091 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:20:32.094 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:21:02.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:21:02.246 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:21:32.379 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:21:32.382 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:22:02.508 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:22:02.511 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:22:32.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:22:32.632 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:23:02.794 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:23:02.797 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:23:32.930 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:23:32.933 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:24:03.087 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:24:03.091 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:24:33.229 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:24:33.232 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:25:03.357 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:25:03.360 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:25:33.512 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:25:33.515 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:26:03.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:26:03.638 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:26:33.781 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:26:33.785 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:27:03.937 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:27:03.941 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:27:34.083 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:27:34.087 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:28:04.248 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:28:04.251 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:28:34.388 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:28:34.391 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:29:04.683 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:29:04.686 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:29:34.880 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:29:34.883 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:30:05.037 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:30:05.041 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:30:35.196 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:30:35.200 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:31:05.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:31:05.362 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:31:35.510 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:31:35.513 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:32:05.657 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:32:05.660 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:32:35.813 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:32:35.816 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:33:05.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:33:05.956 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:33:36.104 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:33:36.108 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:34:06.250 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:34:06.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:34:36.405 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:34:36.408 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:35:06.534 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:35:06.538 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:35:36.663 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:35:36.666 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:36:06.725 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:36:06.728 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:36:36.910 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:36:36.913 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:37:07.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:37:07.053 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:37:37.188 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:37:37.191 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:38:07.339 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:38:07.342 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:38:37.478 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:38:37.481 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:39:07.666 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:39:07.669 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:39:37.838 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:39:37.841 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:40:07.968 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:40:07.971 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:40:38.041 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:40:38.044 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:41:08.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:41:08.190 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:41:38.338 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:41:38.341 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:42:08.473 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:42:08.477 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:42:38.613 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:42:38.616 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:43:08.759 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:43:08.762 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:43:38.888 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:43:38.891 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:44:09.017 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:44:09.021 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:44:39.164 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:44:39.167 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:45:09.318 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:45:09.321 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:45:39.447 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:45:39.451 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:46:09.594 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:46:09.597 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:46:39.913 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:46:39.917 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:47:10.028 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:47:10.031 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:47:40.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:47:40.161 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:48:10.279 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:48:10.283 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:48:40.351 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:48:40.355 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:49:10.457 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:49:10.461 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:49:40.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:49:40.566 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:50:10.693 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:50:10.697 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:50:40.831 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:50:40.835 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:51:10.980 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:51:10.983 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:51:41.066 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:51:41.070 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:52:11.128 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:52:11.130 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:52:41.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:52:41.215 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:53:11.275 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:53:11.280 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:53:41.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:53:41.409 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:54:11.561 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:54:11.565 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:54:41.718 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:54:41.721 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:55:11.863 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:55:11.866 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:55:42.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:55:42.006 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:56:12.149 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:56:12.152 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:56:42.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:56:42.304 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:57:12.421 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:57:12.425 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:57:42.542 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:57:42.548 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:58:12.671 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:58:12.675 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:58:42.809 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:58:42.812 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:59:12.946 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:59:12.950 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:59:43.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T10:59:43.125 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:00:13.267 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:00:13.270 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:00:43.400 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:00:43.403 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:01:13.539 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:01:13.543 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:01:43.685 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:01:43.689 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:02:13.833 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:02:13.836 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:02:43.979 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:02:43.982 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:03:14.126 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:03:14.130 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:03:44.269 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:03:44.272 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:04:14.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:04:14.428 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:04:44.569 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:04:44.572 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:05:14.723 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:05:14.726 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:05:44.854 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:05:44.857 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:06:15.007 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:06:15.010 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:06:45.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:06:45.190 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:07:15.329 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:07:15.332 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:07:45.459 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:07:45.463 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:08:15.615 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:08:15.618 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:08:45.753 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:08:45.757 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:09:15.932 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:09:15.936 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:09:46.070 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:09:46.073 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:10:16.224 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:10:16.228 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:10:46.363 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:10:46.367 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:11:16.491 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:11:16.494 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:11:46.621 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:11:46.625 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:12:16.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:12:16.761 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:12:46.904 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:12:46.910 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:13:17.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:13:17.053 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:13:47.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:13:47.203 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:14:17.355 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:14:17.359 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:14:47.506 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:14:47.511 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:15:17.666 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:15:17.670 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:15:47.798 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:15:47.801 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:16:17.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:16:17.953 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:16:48.090 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:16:48.094 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:17:18.259 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:17:18.262 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:17:48.409 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:17:48.413 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:18:18.556 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:18:18.559 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:18:48.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:18:48.708 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:19:18.827 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:19:18.830 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:19:48.967 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:19:48.971 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:20:19.100 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:20:19.104 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:20:49.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:20:49.179 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:21:19.327 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:21:19.330 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:21:49.461 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:21:49.464 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:22:19.610 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:22:19.614 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:22:49.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:22:49.759 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:23:19.919 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:23:19.922 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:23:50.048 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:23:50.052 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:24:20.185 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:24:20.189 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:24:50.314 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:24:50.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:25:20.468 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:25:20.472 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:25:50.606 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:25:50.609 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:26:20.736 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:26:20.739 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:26:50.909 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:26:50.912 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:27:21.044 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:27:21.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:27:51.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:27:51.180 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:28:21.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:28:21.332 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:28:51.477 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:28:51.481 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:29:21.619 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:29:21.622 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:29:51.818 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:29:51.822 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:30:21.960 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:30:21.963 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:30:52.090 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:30:52.094 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:31:22.245 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:31:22.248 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:31:52.374 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:31:52.377 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:32:22.503 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:32:22.507 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:32:52.650 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:32:52.653 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:33:22.970 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:33:22.974 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:33:53.090 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:33:53.094 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:34:23.229 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:34:23.232 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:34:53.391 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:34:53.394 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:35:23.538 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:35:23.541 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:35:53.683 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:35:53.686 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:36:23.812 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:36:23.815 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:36:53.941 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:36:53.945 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:37:24.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:37:24.076 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:37:54.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:37:54.236 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:38:24.362 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:38:24.366 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:38:54.524 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:38:54.528 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:39:24.662 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:39:24.665 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:39:54.817 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:39:54.820 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:40:24.966 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:40:24.970 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:40:55.119 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:40:55.127 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:41:25.280 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:41:25.603 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:41:55.744 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:41:55.747 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:42:25.882 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:42:25.885 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:42:56.038 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:42:56.041 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:43:26.176 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:43:26.180 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:43:56.359 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:43:56.363 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:44:26.488 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:44:26.493 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:44:56.642 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:44:56.645 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:45:26.789 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:45:26.792 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:45:56.944 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:45:56.947 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:46:27.258 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:46:27.262 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:46:57.402 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:46:57.405 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:47:27.555 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:47:27.560 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:47:57.694 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:47:57.697 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:48:27.847 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:48:27.851 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:48:58.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:48:58.030 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:49:28.164 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:49:28.168 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:49:58.303 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:49:58.307 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:50:28.451 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:50:28.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:50:58.597 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:50:58.601 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:51:28.738 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:51:28.741 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:51:58.816 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:51:58.821 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:52:28.988 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:52:28.992 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:52:59.053 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:52:59.056 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:53:29.125 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:53:29.129 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:53:59.261 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:53:59.265 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:54:29.398 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:54:29.402 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:54:59.561 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:54:59.564 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:55:29.698 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:55:29.702 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:55:59.836 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:55:59.839 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:56:29.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:56:29.994 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:57:00.119 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:57:00.122 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:57:30.257 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:57:30.261 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:58:00.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:58:00.410 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:58:30.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:58:30.567 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:59:00.736 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:59:00.739 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:59:30.888 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T11:59:30.891 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:00:01.045 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:00:01.048 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:00:31.167 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:00:31.171 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:01:01.281 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:01:01.285 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:01:31.411 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:01:31.415 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-07T12:01:43.243 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-12-07T12:01:43.243 DEBUG:teuthology.task.console_log:Killing console logger for smithi179 2023-12-07T12:01:43.244 DEBUG:teuthology.task.console_log:Killing console logger for smithi190 2023-12-07T12:01:43.244 DEBUG:teuthology.exit:Finished running handlers